Nameexact_genome_1542531604_189_6237_1
Workunit4096960
Created18 Nov 2018, 9:52:14 UTC
Sent18 Nov 2018, 10:09:37 UTC
Report deadline5 Feb 2019, 22:03:11 UTC
Received22 Nov 2018, 21:22:04 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID58065
Run time1 days 10 hours 18 min 23 sec
CPU time1 days 10 hours 8 min 17 sec
Validate stateValid
Credit19,873.88
Device peak FLOPS2.77 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
:     11731.67871 on epoch:    14, epoch:   15/100, mu: 0.7702429295, learning_rate: 0.0003939645, weight_decay: 0.0002367203

epoch time: 3659.2487792969s, input_fired_time: 35.0602493286, output_fired_time: 21.9069328308, propagate_forward_time: 1468.8546142578, propagate_backward_time: 2092.7482910156, weight_update_time: 2.5912020206, other_time: 40.6784667969
epoch time: 290.6864624023s, input_fired_time: 2.2323760986, output_fired_time: 0.0000000000, propagate_forward_time: 278.8839111328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.5701904297
validation[          , genome  6237] predictions:    5773/  10000 (57.73%), best:    5969/10000 (59.69%), error:     12039.39063, best error:     11731.67871 on epoch:    14, epoch:   16/100, mu: 0.7815510631, learning_rate: 0.0003680121, weight_decay: 0.0002244608

epoch time: 3557.9370117188s, input_fired_time: 38.6751861572, output_fired_time: 22.7844371796, propagate_forward_time: 1452.0008544922, propagate_backward_time: 2015.3625488281, weight_update_time: 2.5869073868, other_time: 29.1138916016
epoch time: 313.3240356445s, input_fired_time: 2.4120478630, output_fired_time: 0.0000000000, propagate_forward_time: 301.2019958496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.7099914551
validation[          , genome  6237] predictions:    6011/  10000 (60.11%), best:    6011/10000 (60.11%), error:     11634.45020, best error:     11634.45020 on epoch:    17, epoch:   17/100, mu: 0.7922772765, learning_rate: 0.0003437694, weight_decay: 0.0002128362

epoch time: 3692.4538574219s, input_fired_time: 34.9625930786, output_fired_time: 31.9793529510, propagate_forward_time: 1459.0791015625, propagate_backward_time: 2127.7607421875, weight_update_time: 0.5968033075, other_time: 38.6721191406
epoch time: 306.5146179199s, input_fired_time: 4.2827463150, output_fired_time: 0.0000000000, propagate_forward_time: 298.6356811523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5961914063
validation[          , genome  6237] predictions:    5880/  10000 (58.80%), best:    6011/10000 (60.11%), error:     11789.14746, best error:     11634.45020 on epoch:    17, epoch:   18/100, mu: 0.8024515510, learning_rate: 0.0003211237, weight_decay: 0.0002018135

epoch time: 3640.0544433594s, input_fired_time: 34.8761863708, output_fired_time: 19.7914028168, propagate_forward_time: 1470.6782226563, propagate_backward_time: 2070.9421386719, weight_update_time: 0.5973177552, other_time: 43.7663574219
epoch time: 287.9032897949s, input_fired_time: 3.2368543148, output_fired_time: 0.0000000000, propagate_forward_time: 280.1704101563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4960327148
validation[          , genome  6237] predictions:    5937/  10000 (59.37%), best:    5937/10000 (59.37%), error:     11446.60156, best error:     11446.60156 on epoch:    19, epoch:   19/100, mu: 0.8121023178, learning_rate: 0.0002999698, weight_decay: 0.0001913618

epoch time: 3496.3312988281s, input_fired_time: 38.3487052917, output_fired_time: 20.3299083710, propagate_forward_time: 1416.8981933594, propagate_backward_time: 1991.1973876953, weight_update_time: 3.5129158497, other_time: 29.5572509766
epoch time: 294.8856506348s, input_fired_time: 3.1419157982, output_fired_time: 0.0000000000, propagate_forward_time: 288.3624572754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3812866211
validation[          , genome  6237] predictions:    5997/  10000 (59.97%), best:    5997/10000 (59.97%), error:     11372.64648, best error:     11372.64648 on epoch:    20, epoch:   20/100, mu: 0.8212564588, learning_rate: 0.0002802094, weight_decay: 0.0001814513

epoch time: 3511.6457519531s, input_fired_time: 36.4943580627, output_fired_time: 12.1681957245, propagate_forward_time: 1422.5000000000, propagate_backward_time: 2009.7011718750, weight_update_time: 0.5803315043, other_time: 30.7819824219
epoch time: 291.5423889160s, input_fired_time: 1.2225370407, output_fired_time: 0.0000000000, propagate_forward_time: 288.0205688477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2992858887
validation[          , genome  6237] predictions:    6029/  10000 (60.29%), best:    5997/10000 (59.97%), error:     11488.45801, best error:     11372.64648 on epoch:    20, epoch:   21/100, mu: 0.8299395442, learning_rate: 0.0002617506, weight_decay: 0.0001720541

epoch time: 3527.1208496094s, input_fired_time: 53.6648406982, output_fired_time: 23.3904304504, propagate_forward_time: 1394.3461914063, propagate_backward_time: 2020.8123779297, weight_update_time: 0.5674442649, other_time: 34.9071044922
epoch time: 290.6799316406s, input_fired_time: 2.2484548092, output_fired_time: 0.0000000000, propagate_forward_time: 280.0130310059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.4184570313
validation[          , genome  6237] predictions:    6032/  10000 (60.32%), best:    5997/10000 (59.97%), error:     11391.62598, best error:     11372.64648 on epoch:    20, epoch:   22/100, mu: 0.8381758332, learning_rate: 0.0002445079, weight_decay: 0.0001631436

epoch time: 3503.7326660156s, input_fired_time: 47.7909622192, output_fired_time: 21.2062168121, propagate_forward_time: 1409.9942626953, propagate_backward_time: 1982.9980468750, weight_update_time: 0.5701581836, other_time: 41.7430419922
epoch time: 292.0963745117s, input_fired_time: 3.1928651333, output_fired_time: 0.0000000000, propagate_forward_time: 284.6589660645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2445373535
validation[          , genome  6237] predictions:    6030/  10000 (60.30%), best:    6030/10000 (60.30%), error:     11351.65625, best error:     11351.65625 on epoch:    23, epoch:   23/100, mu: 0.8459883332, learning_rate: 0.0002284010, weight_decay: 0.0001546945

epoch time: 3508.2351074219s, input_fired_time: 38.8592414856, output_fired_time: 16.3448944092, propagate_forward_time: 1423.6739501953, propagate_backward_time: 1994.5289306641, weight_update_time: 0.5718870163, other_time: 34.8281250000
epoch time: 292.2546081543s, input_fired_time: 5.2972588539, output_fired_time: 0.0000000000, propagate_forward_time: 281.6487121582, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3086242676
validation[          , genome  6237] predictions:    6079/  10000 (60.79%), best:    6079/10000 (60.79%), error:     11149.82910, best error:     11149.82910 on epoch:    24, epoch:   24/100, mu: 0.8533987999, learning_rate: 0.0002133551, weight_decay: 0.0001466830

epoch time: 3489.5817871094s, input_fired_time: 48.5942192078, output_fired_time: 19.2253532410, propagate_forward_time: 1394.5070800781, propagate_backward_time: 1994.5953369141, weight_update_time: 0.5737414360, other_time: 32.6597900391
epoch time: 289.7365722656s, input_fired_time: 5.2670555115, output_fired_time: 0.0000000000, propagate_forward_time: 278.0778503418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3916625977
validation[          , genome  6237] predictions:    6026/  10000 (60.26%), best:    6079/10000 (60.79%), error:     11342.19434, best error:     11149.82910 on epoch:    24, epoch:   25/100, mu: 0.8604279160, learning_rate: 0.0001993004, weight_decay: 0.0001390864

epoch time: 3517.9912109375s, input_fired_time: 43.5620269775, output_fired_time: 17.5334835052, propagate_forward_time: 1407.8835449219, propagate_backward_time: 2018.4515380859, weight_update_time: 2.5879008770, other_time: 30.5606689453
epoch time: 287.4198303223s, input_fired_time: 3.2595157623, output_fired_time: 0.0000000000, propagate_forward_time: 280.8228149414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3374938965
validation[          , genome  6237] predictions:    6174/  10000 (61.74%), best:    6174/10000 (61.74%), error:     11012.25098, best error:     11012.25098 on epoch:    26, epoch:   26/100, mu: 0.8670953512, learning_rate: 0.0001861715, weight_decay: 0.0001318832

epoch time: 3514.0339355469s, input_fired_time: 35.7096366882, output_fired_time: 17.4472332001, propagate_forward_time: 1407.3115234375, propagate_backward_time: 2008.3726806641, weight_update_time: 3.5650751591, other_time: 45.1927490234
epoch time: 291.2950134277s, input_fired_time: 4.2893471718, output_fired_time: 0.0000000000, propagate_forward_time: 283.7279663086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2777099609
validation[          , genome  6237] predictions:    6113/  10000 (61.13%), best:    6174/10000 (61.74%), error:     11119.82520, best error:     11012.25098 on epoch:    26, epoch:   27/100, mu: 0.8734197021, learning_rate: 0.0001739075, weight_decay: 0.0001250531

epoch time: 3501.2646484375s, input_fired_time: 38.6590156555, output_fired_time: 11.3485765457, propagate_forward_time: 1406.5993652344, propagate_backward_time: 2006.0013427734, weight_update_time: 1.6026320457, other_time: 38.6563720703
epoch time: 290.6517333984s, input_fired_time: 3.2431526184, output_fired_time: 0.0000000000, propagate_forward_time: 277.0803222656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.3282470703
validation[          , genome  6237] predictions:    6234/  10000 (62.34%), best:    6234/10000 (62.34%), error:     10941.23438, best error:     10941.23438 on epoch:    28, epoch:   28/100, mu: 0.8794186115, learning_rate: 0.0001624514, weight_decay: 0.0001185767

epoch time: 3511.4213867188s, input_fired_time: 45.7362213135, output_fired_time: 23.4595317841, propagate_forward_time: 1396.0664062500, propagate_backward_time: 2005.3485107422, weight_update_time: 3.5812015533, other_time: 40.8106689453
epoch time: 290.0312805176s, input_fired_time: 3.2603275776, output_fired_time: 0.0000000000, propagate_forward_time: 280.3917236328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3792419434
validation[          , genome  6237] predictions:    6116/  10000 (61.16%), best:    6234/10000 (62.34%), error:     11265.38672, best error:     10941.23438 on epoch:    28, epoch:   29/100, mu: 0.8851088285, learning_rate: 0.0001517500, weight_decay: 0.0001124357

epoch time: 3506.8557128906s, input_fired_time: 40.7944793701, output_fired_time: 17.5015830994, propagate_forward_time: 1412.5529785156, propagate_backward_time: 2006.3404541016, weight_update_time: 2.4957153797, other_time: 29.6663818359
epoch time: 286.4624328613s, input_fired_time: 3.1390783787, output_fired_time: 0.0000000000, propagate_forward_time: 281.0450134277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2783508301
validation[          , genome  6237] predictions:    6195/  10000 (61.95%), best:    6234/10000 (62.34%), error:     11025.40820, best error:     10941.23438 on epoch:    28, epoch:   30/100, mu: 0.8905062675, learning_rate: 0.0001417535, weight_decay: 0.0001066128

epoch time: 3438.7746582031s, input_fired_time: 44.6651725769, output_fired_time: 35.6203079224, propagate_forward_time: 1385.5722656250, propagate_backward_time: 1939.9235839844, weight_update_time: 2.6140460968, other_time: 32.9931640625
epoch time: 288.0730895996s, input_fired_time: 6.2846312523, output_fired_time: 0.0000000000, propagate_forward_time: 270.3402709961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.4481811523
validation[          , genome  6237] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     10837.49121, best error:     10837.49121 on epoch:    31, epoch:   31/100, mu: 0.8956259489, learning_rate: 0.0001324155, weight_decay: 0.0001010914

epoch time: 3403.6079101563s, input_fired_time: 32.5409736633, output_fired_time: 19.2667026520, propagate_forward_time: 1351.9954833984, propagate_backward_time: 1964.9538574219, weight_update_time: 1.5903080702, other_time: 34.8509521484
epoch time: 284.5310974121s, input_fired_time: 3.2600004673, output_fired_time: 0.0000000000, propagate_forward_time: 277.9473266602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3237609863
validation[          , genome  6237] predictions:    6285/  10000 (62.85%), best:    6285/10000 (62.85%), error:     10752.76367, best error:     10752.76367 on epoch:    32, epoch:   32/100, mu: 0.9004821777, learning_rate: 0.0001236926, weight_decay: 0.0000958559

epoch time: 3484.9465332031s, input_fired_time: 43.7603225708, output_fired_time: 17.2919769287, propagate_forward_time: 1404.8173828125, propagate_backward_time: 1989.4471435547, weight_update_time: 0.5626978874, other_time: 29.6297607422
epoch time: 290.5888671875s, input_fired_time: 1.2327486277, output_fired_time: 0.0000000000, propagate_forward_time: 279.0024719238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.3536376953
validation[          , genome  6237] predictions:    6214/  10000 (62.14%), best:    6285/10000 (62.85%), error:     10967.08008, best error:     10752.76367 on epoch:    32, epoch:   33/100, mu: 0.9050885439, learning_rate: 0.0001155444, weight_decay: 0.0000908916

epoch time: 3492.8957519531s, input_fired_time: 40.3623313904, output_fired_time: 23.4757804871, propagate_forward_time: 1406.8999023438, propagate_backward_time: 1982.3751220703, weight_update_time: 0.5614568591, other_time: 39.7825927734
epoch time: 290.1752624512s, input_fired_time: 3.1646327972, output_fired_time: 0.0000000000, propagate_forward_time: 277.6885375977, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.3220825195
validation[          , genome  6237] predictions:    6056/  10000 (60.56%), best:    6285/10000 (62.85%), error:     11361.24805, best error:     10752.76367 on epoch:    32, epoch:   34/100, mu: 0.9094578624, learning_rate: 0.0001079330, weight_decay: 0.0000861844

epoch time: 3496.9423828125s, input_fired_time: 46.6812858582, output_fired_time: 18.4173660278, propagate_forward_time: 1407.8491210938, propagate_backward_time: 1997.3267822266, weight_update_time: 0.5667585135, other_time: 26.6676025391
epoch time: 290.2789611816s, input_fired_time: 4.2852182388, output_fired_time: 0.0000000000, propagate_forward_time: 278.5982360840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.3955078125
validation[          , genome  6237] predictions:    6233/  10000 (62.33%), best:    6285/10000 (62.85%), error:     10880.32227, best error:     10752.76367 on epoch:    32, epoch:   35/100, mu: 0.9136023521, learning_rate: 0.0001008229, weight_decay: 0.0000817210

epoch time: 3486.7912597656s, input_fired_time: 38.6686935425, output_fired_time: 20.4287853241, propagate_forward_time: 1396.7325439453, propagate_backward_time: 1992.4952392578, weight_update_time: 2.7017962933, other_time: 38.4660644531
epoch time: 305.4421386719s, input_fired_time: 4.3381581306, output_fired_time: 0.0000000000, propagate_forward_time: 295.4412231445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6627502441
validation[          , genome  6237] predictions:    6170/  10000 (61.70%), best:    6285/10000 (62.85%), error:     11028.04980, best error:     10752.76367 on epoch:    32, epoch:   36/100, mu: 0.9175335765, learning_rate: 0.0000941812, weight_decay: 0.0000774888

epoch time: 3662.0954589844s, input_fired_time: 39.7856864929, output_fired_time: 21.6828193665, propagate_forward_time: 1453.9095458984, propagate_backward_time: 2098.4553222656, weight_update_time: 0.6010527015, other_time: 48.2619628906
epoch time: 286.8848876953s, input_fired_time: 6.3505034447, output_fired_time: 0.0000000000, propagate_forward_time: 277.0838623047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4505310059
validation[          , genome  6237] predictions:    6302/  10000 (63.02%), best:    6302/10000 (63.02%), error:     10728.50586, best error:     10728.50586 on epoch:    37, epoch:   37/100, mu: 0.9212625027, learning_rate: 0.0000879771, weight_decay: 0.0000734757

epoch time: 3500.1579589844s, input_fired_time: 28.4366817474, output_fired_time: 17.2196102142, propagate_forward_time: 1428.8492431641, propagate_backward_time: 1996.7481689453, weight_update_time: 0.5631893277, other_time: 28.9040527344
epoch time: 275.4522399902s, input_fired_time: 1.2043207884, output_fired_time: 0.0000000000, propagate_forward_time: 268.0051879883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2427368164
validation[          , genome  6237] predictions:    6214/  10000 (62.14%), best:    6302/10000 (63.02%), error:     10877.72949, best error:     10728.50586 on epoch:    37, epoch:   38/100, mu: 0.9247995615, learning_rate: 0.0000821816, weight_decay: 0.0000696704

epoch time: 3448.4865722656s, input_fired_time: 41.4669036865, output_fired_time: 15.3036556244, propagate_forward_time: 1390.3289794922, propagate_backward_time: 1973.2589111328, weight_update_time: 1.5863760710, other_time: 28.1281738281
epoch time: 292.5671997070s, input_fired_time: 2.2577300072, output_fired_time: 0.0000000000, propagate_forward_time: 284.8383789063, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4710998535
validation[          , genome  6237] predictions:    6215/  10000 (62.15%), best:    6302/10000 (63.02%), error:     10917.82031, best error:     10728.50586 on epoch:    37, epoch:   39/100, mu: 0.9281545877, learning_rate: 0.0000767679, weight_decay: 0.0000660623

epoch time: 3642.8977050781s, input_fired_time: 47.8248405457, output_fired_time: 26.9722518921, propagate_forward_time: 1456.9064941406, propagate_backward_time: 2075.0554199219, weight_update_time: 2.6164388657, other_time: 36.1386718750
epoch time: 295.0828857422s, input_fired_time: 2.2994120121, output_fired_time: 0.0000000000, propagate_forward_time: 282.0896606445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.6938171387
validation[          , genome  6237] predictions:    6248/  10000 (62.48%), best:    6302/10000 (63.02%), error:     10831.32715, best error:     10728.50586 on epoch:    37, epoch:   40/100, mu: 0.9313369989, learning_rate: 0.0000717108, weight_decay: 0.0000626410

epoch time: 3625.0297851563s, input_fired_time: 42.9473762512, output_fired_time: 15.7255010605, propagate_forward_time: 1456.9434814453, propagate_backward_time: 2077.5407714844, weight_update_time: 0.5940536857, other_time: 31.8728027344
epoch time: 277.8842468262s, input_fired_time: 1.2105717659, output_fired_time: 0.0000000000, propagate_forward_time: 270.2139892578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4596862793
validation[          , genome  6237] predictions:    6288/  10000 (62.88%), best:    6288/10000 (62.88%), error:     10631.43848, best error:     10631.43848 on epoch:    41, epoch:   41/100, mu: 0.9343556166, learning_rate: 0.0000669869, weight_decay: 0.0000593968

epoch time: 3354.1020507813s, input_fired_time: 37.4002609253, output_fired_time: 20.2035007477, propagate_forward_time: 1350.0833740234, propagate_backward_time: 1914.3967285156, weight_update_time: 1.5904585123, other_time: 32.0181884766
epoch time: 264.1970214844s, input_fired_time: 3.1568830013, output_fired_time: 0.0000000000, propagate_forward_time: 256.6526794434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3874511719
validation[          , genome  6237] predictions:    6301/  10000 (63.01%), best:    6288/10000 (62.88%), error:     10642.16211, best error:     10631.43848 on epoch:    41, epoch:   42/100, mu: 0.9372189045, learning_rate: 0.0000625742, weight_decay: 0.0000563207

epoch time: 3202.3806152344s, input_fired_time: 36.1168785095, output_fired_time: 22.8192729950, propagate_forward_time: 1274.4508056641, propagate_backward_time: 1823.7030029297, weight_update_time: 2.5747153759, other_time: 45.2905273438
epoch time: 269.0674133301s, input_fired_time: 1.1728858948, output_fired_time: 0.0000000000, propagate_forward_time: 262.6713867188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2231445313
validation[          , genome  6237] predictions:    6290/  10000 (62.90%), best:    6288/10000 (62.88%), error:     10724.67773, best error:     10631.43848 on epoch:    41, epoch:   43/100, mu: 0.9399349093, learning_rate: 0.0000584521, weight_decay: 0.0000534039

epoch time: 3239.3103027344s, input_fired_time: 36.7371864319, output_fired_time: 20.6942806244, propagate_forward_time: 1277.9770507813, propagate_backward_time: 1864.9005126953, weight_update_time: 4.5716142654, other_time: 39.0010986328
epoch time: 266.3242797852s, input_fired_time: 3.1029880047, output_fired_time: 0.0000000000, propagate_forward_time: 258.9742431641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2470397949
validation[          , genome  6237] predictions:    6219/  10000 (62.19%), best:    6288/10000 (62.88%), error:     10896.24121, best error:     10631.43848 on epoch:    41, epoch:   44/100, mu: 0.9425111413, learning_rate: 0.0000546016, weight_decay: 0.0000506382

epoch time: 3234.0014648438s, input_fired_time: 26.9776725769, output_fired_time: 24.8051223755, propagate_forward_time: 1292.0749511719, propagate_backward_time: 1844.2573242188, weight_update_time: 2.7722485065, other_time: 45.8862304688
epoch time: 269.8291320801s, input_fired_time: 1.1722936630, output_fired_time: 0.0000000000, propagate_forward_time: 264.4028015137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2540283203
validation[          , genome  6237] predictions:    6271/  10000 (62.71%), best:    6288/10000 (62.88%), error:     10778.79297, best error:     10631.43848 on epoch:    41, epoch:   45/100, mu: 0.9449548125, learning_rate: 0.0000510047, weight_decay: 0.0000480157

epoch time: 3251.6589355469s, input_fired_time: 42.4199066162, output_fired_time: 23.9892349243, propagate_forward_time: 1302.1566162109, propagate_backward_time: 1847.7248535156, weight_update_time: 0.5356754065, other_time: 35.3682861328
epoch time: 269.1181945801s, input_fired_time: 4.2458405495, output_fired_time: 0.0000000000, propagate_forward_time: 261.6086730957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2636718750
validation[          , genome  6237] predictions:    6269/  10000 (62.69%), best:    6288/10000 (62.88%), error:     10738.36719, best error:     10631.43848 on epoch:    41, epoch:   46/100, mu: 0.9472727180, learning_rate: 0.0000476448, weight_decay: 0.0000455290

epoch time: 3186.3371582031s, input_fired_time: 41.8881378174, output_fired_time: 16.6763801575, propagate_forward_time: 1273.7265625000, propagate_backward_time: 1827.0706787109, weight_update_time: 1.5578955412, other_time: 26.9754638672
epoch time: 239.6279449463s, input_fired_time: 3.1151161194, output_fired_time: 0.0000000000, propagate_forward_time: 233.3719787598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1408538818
validation[          , genome  6237] predictions:    6268/  10000 (62.68%), best:    6288/10000 (62.88%), error:     10709.76074, best error:     10631.43848 on epoch:    41, epoch:   47/100, mu: 0.9494713545, learning_rate: 0.0000445062, weight_decay: 0.0000431711

epoch time: 2895.0766601563s, input_fired_time: 28.1933002472, output_fired_time: 15.1518030167, propagate_forward_time: 1179.1612548828, propagate_backward_time: 1636.9412841797, weight_update_time: 2.4547972679, other_time: 35.6289062500
epoch time: 239.4211120605s, input_fired_time: 4.1223759651, output_fired_time: 0.0000000000, propagate_forward_time: 221.1329498291, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.1657867432
validation[          , genome  6237] predictions:    6250/  10000 (62.50%), best:    6288/10000 (62.88%), error:     10715.53125, best error:     10631.43848 on epoch:    41, epoch:   48/100, mu: 0.9515568614, learning_rate: 0.0000415744, weight_decay: 0.0000409353

epoch time: 2900.6872558594s, input_fired_time: 39.1346893311, output_fired_time: 18.0659084320, propagate_forward_time: 1140.1843261719, propagate_backward_time: 1673.9100341797, weight_update_time: 1.5005470514, other_time: 29.3922119141
epoch time: 239.5686645508s, input_fired_time: 1.0852400064, output_fired_time: 0.0000000000, propagate_forward_time: 234.3004608154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1829681396
validation[          , genome  6237] predictions:    6256/  10000 (62.56%), best:    6288/10000 (62.88%), error:     10800.28516, best error:     10631.43848 on epoch:    41, epoch:   49/100, mu: 0.9535350204, learning_rate: 0.0000388357, weight_decay: 0.0000388153

epoch time: 2914.6069335938s, input_fired_time: 33.5477523804, output_fired_time: 11.0983724594, propagate_forward_time: 1144.3509521484, propagate_backward_time: 1686.6353759766, weight_update_time: 0.5046386123, other_time: 38.9743652344
epoch time: 235.8782196045s, input_fired_time: 3.0536422729, output_fired_time: 0.0000000000, propagate_forward_time: 230.7804870605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0440979004
validation[          , genome  6237] predictions:    6358/  10000 (63.58%), best:    6358/10000 (63.58%), error:     10528.46289, best error:     10528.46289 on epoch:    50, epoch:   50/100, mu: 0.9554114342, learning_rate: 0.0000362774, weight_decay: 0.0000368051

epoch time: 2861.2570800781s, input_fired_time: 34.3150100708, output_fired_time: 18.7952594757, propagate_forward_time: 1091.3386230469, propagate_backward_time: 1682.4371337891, weight_update_time: 4.5237803459, other_time: 34.3712158203
epoch time: 208.1119384766s, input_fired_time: 0.9637135863, output_fired_time: 0.0000000000, propagate_forward_time: 199.0776824951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0705413818
validation[          , genome  6237] predictions:    6181/  10000 (61.81%), best:    6358/10000 (63.58%), error:     10884.48340, best error:     10528.46289 on epoch:    50, epoch:   51/100, mu: 0.9571912885, learning_rate: 0.0000338876, weight_decay: 0.0000348990

epoch time: 2542.4409179688s, input_fired_time: 45.7875289917, output_fired_time: 15.0839986801, propagate_forward_time: 1002.5301513672, propagate_backward_time: 1440.0388183594, weight_update_time: 0.4429624081, other_time: 39.0003662109
epoch time: 188.3413696289s, input_fired_time: 1.9918341637, output_fired_time: 0.0000000000, propagate_forward_time: 182.3750610352, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9744720459
validation[          , genome  6237] predictions:    6305/  10000 (63.05%), best:    6358/10000 (63.58%), error:     10695.25293, best error:     10528.46289 on epoch:    50, epoch:   52/100, mu: 0.9588795304, learning_rate: 0.0000316553, weight_decay: 0.0000330916

epoch time: 2546.6232910156s, input_fired_time: 27.5181198120, output_fired_time: 17.0900440216, propagate_forward_time: 1028.2294921875, propagate_backward_time: 1452.0887451172, weight_update_time: 0.4463385642, other_time: 21.6968994141
epoch time: 208.6570739746s, input_fired_time: 0.9772930145, output_fired_time: 0.0000000000, propagate_forward_time: 201.8628845215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.8168945313
validation[          , genome  6237] predictions:    6401/  10000 (64.01%), best:    6401/10000 (64.01%), error:     10461.35449, best error:     10461.35449 on epoch:    53, epoch:   53/100, mu: 0.9604809284, learning_rate: 0.0000295700, weight_decay: 0.0000313778

epoch time: 2556.9750976563s, input_fired_time: 38.3197669983, output_fired_time: 8.2015113831, propagate_forward_time: 992.0797729492, propagate_backward_time: 1490.5280761719, weight_update_time: 0.4387890100, other_time: 27.8459472656
epoch time: 203.6476440430s, input_fired_time: 0.9649432898, output_fired_time: 0.0000000000, propagate_forward_time: 196.7371520996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.9455413818
validation[          , genome  6237] predictions:    6299/  10000 (62.99%), best:    6401/10000 (64.01%), error:     10717.21680, best error:     10461.35449 on epoch:    53, epoch:   54/100, mu: 0.9619998932, learning_rate: 0.0000276221, weight_decay: 0.0000297528

epoch time: 2549.4626464844s, input_fired_time: 26.4611930847, output_fired_time: 21.1233386993, propagate_forward_time: 1005.2395019531, propagate_backward_time: 1457.7290039063, weight_update_time: 0.4379270077, other_time: 38.9096679688
epoch time: 209.7757415771s, input_fired_time: 2.0264282227, output_fired_time: 0.0000000000, propagate_forward_time: 203.8924560547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8568572998
validation[          , genome  6237] predictions:    6373/  10000 (63.73%), best:    6373/10000 (63.73%), error:     10432.29590, best error:     10432.29590 on epoch:    55, epoch:   55/100, mu: 0.9634407163, learning_rate: 0.0000258025, weight_decay: 0.0000282119

epoch time: 2584.7607421875s, input_fired_time: 20.5279560089, output_fired_time: 15.3801116943, propagate_forward_time: 1032.0549316406, propagate_backward_time: 1484.7828369141, weight_update_time: 0.4425755739, other_time: 32.0147705078
epoch time: 225.6779479980s, input_fired_time: 5.0862474442, output_fired_time: 0.0000000000, propagate_forward_time: 212.3927154541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.1989898682
validation[          , genome  6237] predictions:    6350/  10000 (63.50%), best:    6373/10000 (63.73%), error:     10546.18359, best error:     10432.29590 on epoch:    55, epoch:   56/100, mu: 0.9648073912, learning_rate: 0.0000241027, weight_decay: 0.0000267508

epoch time: 2547.1892089844s, input_fired_time: 31.3442859650, output_fired_time: 19.1981868744, propagate_forward_time: 1004.0073852539, propagate_backward_time: 1463.7736816406, weight_update_time: 1.4473959208, other_time: 28.8657226563
epoch time: 207.4461975098s, input_fired_time: 2.0431995392, output_fired_time: 0.0000000000, propagate_forward_time: 201.4502563477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9527435303
validation[          , genome  6237] predictions:    6395/  10000 (63.95%), best:    6373/10000 (63.73%), error:     10483.62891, best error:     10432.29590 on epoch:    55, epoch:   57/100, mu: 0.9661037326, learning_rate: 0.0000225150, weight_decay: 0.0000253654

epoch time: 2599.3718261719s, input_fired_time: 27.5500392914, output_fired_time: 8.2617616653, propagate_forward_time: 1017.1085205078, propagate_backward_time: 1509.3695068359, weight_update_time: 0.4443995059, other_time: 37.0820312500
epoch time: 208.7419433594s, input_fired_time: 0.9764148593, output_fired_time: 0.0000000000, propagate_forward_time: 197.8607482910, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.9047851563
validation[          , genome  6237] predictions:    6325/  10000 (63.25%), best:    6373/10000 (63.73%), error:     10607.50977, best error:     10432.29590 on epoch:    55, epoch:   58/100, mu: 0.9673333764, learning_rate: 0.0000210318, weight_decay: 0.0000240518

epoch time: 2541.4089355469s, input_fired_time: 40.2964515686, output_fired_time: 22.0705528259, propagate_forward_time: 1007.4370117188, propagate_backward_time: 1446.8776855469, weight_update_time: 0.4388361275, other_time: 24.7272949219
epoch time: 207.2757263184s, input_fired_time: 4.9490160942, output_fired_time: 0.0000000000, propagate_forward_time: 196.4438476563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.8828582764
validation[          , genome  6237] predictions:    6343/  10000 (63.43%), best:    6373/10000 (63.73%), error:     10511.54492, best error:     10432.29590 on epoch:    55, epoch:   59/100, mu: 0.9684997201, learning_rate: 0.0000196463, weight_decay: 0.0000228061

epoch time: 2568.9458007813s, input_fired_time: 21.2290077209, output_fired_time: 16.1909046173, propagate_forward_time: 1010.1372070313, propagate_backward_time: 1496.7819824219, weight_update_time: 0.4358101785, other_time: 24.6066894531
epoch time: 211.5624237061s, input_fired_time: 0.9761874080, output_fired_time: 0.0000000000, propagate_forward_time: 208.6316070557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9546356201
validation[          , genome  6237] predictions:    6413/  10000 (64.13%), best:    6413/10000 (64.13%), error:     10384.05664, best error:     10384.05664 on epoch:    60, epoch:   60/100, mu: 0.9696060419, learning_rate: 0.0000183521, weight_decay: 0.0000216250

epoch time: 2581.0476074219s, input_fired_time: 33.4409637451, output_fired_time: 13.2036733627, propagate_forward_time: 999.9429931641, propagate_backward_time: 1507.6562500000, weight_update_time: 0.4482591450, other_time: 26.8038330078
epoch time: 212.1126251221s, input_fired_time: 2.0094077587, output_fired_time: 0.0000000000, propagate_forward_time: 206.0275573730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0756530762
validation[          , genome  6237] predictions:    6398/  10000 (63.98%), best:    6413/10000 (64.13%), error:     10438.91406, best error:     10384.05664 on epoch:    60, epoch:   61/100, mu: 0.9706554413, learning_rate: 0.0000171432, weight_decay: 0.0000205051

epoch time: 2559.8491210938s, input_fired_time: 32.2213668823, output_fired_time: 16.2185306549, propagate_forward_time: 998.2979125977, propagate_backward_time: 1484.4226074219, weight_update_time: 0.4339148998, other_time: 28.6887207031
epoch time: 213.4890136719s, input_fired_time: 1.9172084332, output_fired_time: 0.0000000000, propagate_forward_time: 207.5940704346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9777374268
validation[          , genome  6237] predictions:    6396/  10000 (63.96%), best:    6396/10000 (63.96%), error:     10331.77344, best error:     10331.77344 on epoch:    62, epoch:   62/100, mu: 0.9716508389, learning_rate: 0.0000160139, weight_decay: 0.0000194431

epoch time: 2569.2438964844s, input_fired_time: 35.7931556702, output_fired_time: 15.3482542038, propagate_forward_time: 1020.5376586914, propagate_backward_time: 1466.1346435547, weight_update_time: 2.3820877075, other_time: 31.4302978516
epoch time: 206.8287963867s, input_fired_time: 1.9814047813, output_fired_time: 0.0000000000, propagate_forward_time: 199.8891448975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9582519531
validation[          , genome  6237] predictions:    6385/  10000 (63.85%), best:    6396/10000 (63.96%), error:     10420.59082, best error:     10331.77344 on epoch:    62, epoch:   63/100, mu: 0.9725950360, learning_rate: 0.0000149590, weight_decay: 0.0000184362

epoch time: 2585.4172363281s, input_fired_time: 35.4945068359, output_fired_time: 16.2183055878, propagate_forward_time: 1003.4161376953, propagate_backward_time: 1489.5312500000, weight_update_time: 0.4394644201, other_time: 40.7572021484
epoch time: 212.6875457764s, input_fired_time: 0.9898220301, output_fired_time: 0.0000000000, propagate_forward_time: 209.7662200928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9315032959
validation[          , genome  6237] predictions:    6466/  10000 (64.66%), best:    6466/10000 (64.66%), error:     10313.86914, best error:     10313.86914 on epoch:    64, epoch:   64/100, mu: 0.9734906554, learning_rate: 0.0000139736, weight_decay: 0.0000174814

epoch time: 2545.7246093750s, input_fired_time: 25.5138607025, output_fired_time: 20.2946224213, propagate_forward_time: 996.3415527344, propagate_backward_time: 1469.8626708984, weight_update_time: 0.4421519339, other_time: 33.7117919922
epoch time: 193.9259338379s, input_fired_time: 2.8540110588, output_fired_time: 0.0000000000, propagate_forward_time: 186.1204528809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9514770508
validation[          , genome  6237] predictions:    6431/  10000 (64.31%), best:    6466/10000 (64.66%), error:     10349.88672, best error:     10313.86914 on epoch:    64, epoch:   65/100, mu: 0.9743402004, learning_rate: 0.0000130531, weight_decay: 0.0000165761

epoch time: 2233.0583496094s, input_fired_time: 34.4980926514, output_fired_time: 13.5313930511, propagate_forward_time: 870.2318115234, propagate_backward_time: 1284.9913330078, weight_update_time: 0.3975544870, other_time: 29.8056640625
epoch time: 158.3078002930s, input_fired_time: 1.7163618803, output_fired_time: 0.0000000000, propagate_forward_time: 151.8850250244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7064208984
validation[          , genome  6237] predictions:    6404/  10000 (64.04%), best:    6466/10000 (64.66%), error:     10449.69531, best error:     10313.86914 on epoch:    64, epoch:   66/100, mu: 0.9751459956, learning_rate: 0.0000121932, weight_decay: 0.0000157176

epoch time: 1968.8763427734s, input_fired_time: 31.5500335693, output_fired_time: 12.8465232849, propagate_forward_time: 768.0848999023, propagate_backward_time: 1125.4428710938, weight_update_time: 2.3772604465, other_time: 30.9519042969
epoch time: 168.2132568359s, input_fired_time: 2.7795636654, output_fired_time: 0.0000000000, propagate_forward_time: 157.6172637939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.8164367676
validation[          , genome  6237] predictions:    6407/  10000 (64.07%), best:    6466/10000 (64.66%), error:     10430.92773, best error:     10313.86914 on epoch:    64, epoch:   67/100, mu: 0.9759103656, learning_rate: 0.0000113900, weight_decay: 0.0000149036

epoch time: 2050.5434570313s, input_fired_time: 36.9109230042, output_fired_time: 6.8916659355, propagate_forward_time: 793.0802001953, propagate_backward_time: 1181.1770019531, weight_update_time: 0.3703234792, other_time: 32.4836425781
epoch time: 168.3766784668s, input_fired_time: 0.8221757412, output_fired_time: 0.0000000000, propagate_forward_time: 163.8312835693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7232208252
validation[          , genome  6237] predictions:    6430/  10000 (64.30%), best:    6466/10000 (64.66%), error:     10346.30566, best error:     10313.86914 on epoch:    64, epoch:   68/100, mu: 0.9766353965, learning_rate: 0.0000106397, weight_decay: 0.0000141318

epoch time: 2060.1391601563s, input_fired_time: 40.9873962402, output_fired_time: 13.8744182587, propagate_forward_time: 803.3457641602, propagate_backward_time: 1177.6324462891, weight_update_time: 0.3650562167, other_time: 24.2991943359
epoch time: 166.5031738281s, input_fired_time: 3.7076597214, output_fired_time: 0.0000000000, propagate_forward_time: 161.0484466553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7470703125
validation[          , genome  6237] predictions:    6385/  10000 (63.85%), best:    6466/10000 (64.66%), error:     10427.97168, best error:     10313.86914 on epoch:    64, epoch:   69/100, mu: 0.9773231149, learning_rate: 0.0000099388, weight_decay: 0.0000133999

epoch time: 2076.5720214844s, input_fired_time: 35.0176239014, output_fired_time: 17.0815830231, propagate_forward_time: 817.3038940430, propagate_backward_time: 1185.8199462891, weight_update_time: 0.3743579090, other_time: 21.3489990234
epoch time: 170.2319946289s, input_fired_time: 0.8388970494, output_fired_time: 0.0000000000, propagate_forward_time: 165.5596466064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8334503174
validation[          , genome  6237] predictions:    6413/  10000 (64.13%), best:    6466/10000 (64.66%), error:     10390.17969, best error:     10313.86914 on epoch:    64, epoch:   70/100, mu: 0.9779754281, learning_rate: 0.0000092841, weight_decay: 0.0000127059

epoch time: 2059.8137207031s, input_fired_time: 33.0033302307, output_fired_time: 14.8262844086, propagate_forward_time: 802.2762451172, propagate_backward_time: 1180.3120117188, weight_update_time: 0.3702477813, other_time: 29.3958740234
epoch time: 166.6393585205s, input_fired_time: 3.7442262173, output_fired_time: 0.0000000000, propagate_forward_time: 158.1066436768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7884826660
validation[          , genome  6237] predictions:    6423/  10000 (64.23%), best:    6423/10000 (64.23%), error:     10292.81934, best error:     10292.81934 on epoch:    71, epoch:   71/100, mu: 0.9785941839, learning_rate: 0.0000086725, weight_decay: 0.0000120479

epoch time: 2059.1870117188s, input_fired_time: 29.0410537720, output_fired_time: 11.9468727112, propagate_forward_time: 802.2094116211, propagate_backward_time: 1192.2542724609, weight_update_time: 0.3681172729, other_time: 23.7354736328
epoch time: 174.0245513916s, input_fired_time: 0.8490864038, output_fired_time: 0.0000000000, propagate_forward_time: 169.1692810059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0061798096
validation[          , genome  6237] predictions:    6442/  10000 (64.42%), best:    6442/10000 (64.42%), error:     10281.14844, best error:     10281.14844 on epoch:    72, epoch:   72/100, mu: 0.9791811109, learning_rate: 0.0000081012, weight_decay: 0.0000114239

epoch time: 1917.8033447266s, input_fired_time: 26.3013362885, output_fired_time: 10.5044898987, propagate_forward_time: 753.5128784180, propagate_backward_time: 1107.7811279297, weight_update_time: 0.3512356877, other_time: 19.7034912109
epoch time: 146.6747131348s, input_fired_time: 0.7411798835, output_fired_time: 0.0000000000, propagate_forward_time: 142.3680419922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5654907227
validation[          , genome  6237] predictions:    6422/  10000 (64.22%), best:    6422/10000 (64.22%), error:     10262.05664, best error:     10262.05664 on epoch:    73, epoch:   73/100, mu: 0.9797378182, learning_rate: 0.0000075675, weight_decay: 0.0000108323

epoch time: 1804.4074707031s, input_fired_time: 20.8427314758, output_fired_time: 12.3287706375, propagate_forward_time: 724.7037963867, propagate_backward_time: 1022.2347412109, weight_update_time: 2.3370828629, other_time: 24.2974853516
epoch time: 148.3622589111s, input_fired_time: 2.6644341946, output_fired_time: 0.0000000000, propagate_forward_time: 144.1363677979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5614624023
validation[          , genome  6237] predictions:    6391/  10000 (63.91%), best:    6422/10000 (64.22%), error:     10391.23047, best error:     10262.05664 on epoch:    73, epoch:   74/100, mu: 0.9802658558, learning_rate: 0.0000070690, weight_decay: 0.0000102713

epoch time: 1844.0559082031s, input_fired_time: 21.9815196991, output_fired_time: 12.4042272568, propagate_forward_time: 741.8908691406, propagate_backward_time: 1052.4044189453, weight_update_time: 1.3512979746, other_time: 15.3748779297
epoch time: 155.8431549072s, input_fired_time: 0.7731876969, output_fired_time: 0.0000000000, propagate_forward_time: 151.4344940186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6354675293
validation[          , genome  6237] predictions:    6442/  10000 (64.42%), best:    6422/10000 (64.22%), error:     10356.56934, best error:     10262.05664 on epoch:    73, epoch:   75/100, mu: 0.9807667732, learning_rate: 0.0000066033, weight_decay: 0.0000097394

epoch time: 1912.6973876953s, input_fired_time: 21.2789573669, output_fired_time: 14.7453536987, propagate_forward_time: 724.2036132813, propagate_backward_time: 1131.5791015625, weight_update_time: 0.3449618518, other_time: 20.8903808594
epoch time: 153.4170989990s, input_fired_time: 1.8018103838, output_fired_time: 0.0000000000, propagate_forward_time: 149.0042114258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6110839844
validation[          , genome  6237] predictions:    6489/  10000 (64.89%), best:    6489/10000 (64.89%), error:     10222.60352, best error:     10222.60352 on epoch:    76, epoch:   76/100, mu: 0.9812418818, learning_rate: 0.0000061683, weight_decay: 0.0000092350

epoch time: 1897.4401855469s, input_fired_time: 22.2323360443, output_fired_time: 7.6085815430, propagate_forward_time: 723.1892089844, propagate_backward_time: 1114.7310791016, weight_update_time: 0.3729463220, other_time: 29.6790771484
epoch time: 151.7260894775s, input_fired_time: 0.7646813989, output_fired_time: 0.0000000000, propagate_forward_time: 146.2797241211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6816864014
validation[          , genome  6237] predictions:    6495/  10000 (64.95%), best:    6495/10000 (64.95%), error:     10208.26660, best error:     10208.26660 on epoch:    77, epoch:   77/100, mu: 0.9816925526, learning_rate: 0.0000057620, weight_decay: 0.0000087567

epoch time: 1890.4794921875s, input_fired_time: 24.4421463013, output_fired_time: 11.5676221848, propagate_forward_time: 744.3859863281, propagate_backward_time: 1083.3319091797, weight_update_time: 2.4033768177, other_time: 26.7518310547
epoch time: 153.6048431396s, input_fired_time: 0.7684990764, output_fired_time: 0.0000000000, propagate_forward_time: 150.1925354004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6438140869
validation[          , genome  6237] predictions:    6482/  10000 (64.82%), best:    6495/10000 (64.95%), error:     10261.06543, best error:     10208.26660 on epoch:    77, epoch:   78/100, mu: 0.9821200371, learning_rate: 0.0000053824, weight_decay: 0.0000083032

epoch time: 1917.0258789063s, input_fired_time: 24.1688995361, output_fired_time: 9.6355323792, propagate_forward_time: 739.4757690430, propagate_backward_time: 1128.1142578125, weight_update_time: 0.3506237566, other_time: 15.6313476563
epoch time: 155.8429107666s, input_fired_time: 1.6953802109, output_fired_time: 0.0000000000, propagate_forward_time: 151.5506896973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5968475342
validation[          , genome  6237] predictions:    6479/  10000 (64.79%), best:    6495/10000 (64.95%), error:     10243.41797, best error:     10208.26660 on epoch:    77, epoch:   79/100, mu: 0.9825255275, learning_rate: 0.0000050279, weight_decay: 0.0000078732

epoch time: 1918.3973388672s, input_fired_time: 17.1593475342, output_fired_time: 15.6225605011, propagate_forward_time: 755.4132690430, propagate_backward_time: 1096.2735595703, weight_update_time: 0.3400135934, other_time: 33.9285888672
epoch time: 157.7274627686s, input_fired_time: 1.7233536243, output_fired_time: 0.0000000000, propagate_forward_time: 152.3822174072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6218872070
validation[          , genome  6237] predictions:    6498/  10000 (64.98%), best:    6498/10000 (64.98%), error:     10198.96680, best error:     10198.96680 on epoch:    80, epoch:   80/100, mu: 0.9829101563, learning_rate: 0.0000046967, weight_decay: 0.0000074654

epoch time: 1901.8294677734s, input_fired_time: 35.4817314148, output_fired_time: 10.5926141739, propagate_forward_time: 724.9080810547, propagate_backward_time: 1109.1372070313, weight_update_time: 0.3432390988, other_time: 21.7098388672
epoch time: 158.8217010498s, input_fired_time: 0.7892951965, output_fired_time: 0.0000000000, propagate_forward_time: 154.3667449951, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6656646729
validation[          , genome  6237] predictions:    6464/  10000 (64.64%), best:    6498/10000 (64.98%), error:     10269.12500, best error:     10198.96680 on epoch:    80, epoch:   81/100, mu: 0.9832749963, learning_rate: 0.0000043873, weight_decay: 0.0000070788

epoch time: 1962.6701660156s, input_fired_time: 31.9116668701, output_fired_time: 15.5506448746, propagate_forward_time: 735.4070434570, propagate_backward_time: 1155.6409912109, weight_update_time: 0.3604899347, other_time: 24.1597900391
epoch time: 154.2707519531s, input_fired_time: 2.8157386780, output_fired_time: 0.0000000000, propagate_forward_time: 144.8633575439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5916595459
validation[          , genome  6237] predictions:    6500/  10000 (65.00%), best:    6500/10000 (65.00%), error:     10169.52930, best error:     10169.52930 on epoch:    82, epoch:   82/100, mu: 0.9836210608, learning_rate: 0.0000040983, weight_decay: 0.0000067122

epoch time: 1915.6508789063s, input_fired_time: 31.4950256348, output_fired_time: 8.6227159500, propagate_forward_time: 743.9855957031, propagate_backward_time: 1111.7570800781, weight_update_time: 0.3470886946, other_time: 19.7905273438
epoch time: 159.5650177002s, input_fired_time: 1.6877161264, output_fired_time: 0.0000000000, propagate_forward_time: 152.2322998047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6450042725
validation[          , genome  6237] predictions:    6509/  10000 (65.09%), best:    6500/10000 (65.00%), error:     10221.58887, best error:     10169.52930 on epoch:    82, epoch:   83/100, mu: 0.9839493036, learning_rate: 0.0000038283, weight_decay: 0.0000063646

epoch time: 1903.7442626953s, input_fired_time: 29.4874229431, output_fired_time: 8.5883417130, propagate_forward_time: 758.9054565430, propagate_backward_time: 1089.0314941406, weight_update_time: 0.3415243924, other_time: 17.7314453125
epoch time: 156.9197235107s, input_fired_time: 0.7800989151, output_fired_time: 0.0000000000, propagate_forward_time: 146.3790740967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.7605438232
validation[          , genome  6237] predictions:    6459/  10000 (64.59%), best:    6500/10000 (65.00%), error:     10201.66504, best error:     10169.52930 on epoch:    82, epoch:   84/100, mu: 0.9842606783, learning_rate: 0.0000035761, weight_decay: 0.0000060350

epoch time: 1976.4533691406s, input_fired_time: 28.7920150757, output_fired_time: 11.6550693512, propagate_forward_time: 767.6751098633, propagate_backward_time: 1147.4025878906, weight_update_time: 2.3146879673, other_time: 20.9287109375
epoch time: 156.2363739014s, input_fired_time: 1.8047130108, output_fired_time: 0.0000000000, propagate_forward_time: 150.9047851563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5268707275
validation[          , genome  6237] predictions:    6475/  10000 (64.75%), best:    6500/10000 (65.00%), error:     10203.83594, best error:     10169.52930 on epoch:    82, epoch:   85/100, mu: 0.9845560193, learning_rate: 0.0000033405, weight_decay: 0.0000057224

epoch time: 1910.1745605469s, input_fired_time: 25.2833156586, output_fired_time: 15.4388923645, propagate_forward_time: 757.9954223633, propagate_backward_time: 1089.8013916016, weight_update_time: 0.3470468521, other_time: 21.6556396484
epoch time: 153.9609527588s, input_fired_time: 4.7502040863, output_fired_time: 0.0000000000, propagate_forward_time: 142.5266265869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6841278076
validation[          , genome  6237] predictions:    6494/  10000 (64.94%), best:    6494/10000 (64.94%), error:     10168.74902, best error:     10168.74902 on epoch:    86, epoch:   86/100, mu: 0.9848361611, learning_rate: 0.0000031205, weight_decay: 0.0000054261

epoch time: 1902.4548339844s, input_fired_time: 32.2717895508, output_fired_time: 9.5616922379, propagate_forward_time: 749.5498657227, propagate_backward_time: 1085.4196777344, weight_update_time: 0.3454498053, other_time: 25.6518554688
epoch time: 156.2202301025s, input_fired_time: 0.7744695544, output_fired_time: 0.0000000000, propagate_forward_time: 150.7559814453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6897735596
validation[          , genome  6237] predictions:    6509/  10000 (65.09%), best:    6494/10000 (64.94%), error:     10169.35254, best error:     10168.74902 on epoch:    86, epoch:   87/100, mu: 0.9851018786, learning_rate: 0.0000029149, weight_decay: 0.0000051450

epoch time: 1914.5418701172s, input_fired_time: 30.1282577515, output_fired_time: 13.5324649811, propagate_forward_time: 729.7788696289, propagate_backward_time: 1125.4162597656, weight_update_time: 0.3440962136, other_time: 15.6860351563
epoch time: 156.2274017334s, input_fired_time: 3.8518781662, output_fired_time: 0.0000000000, propagate_forward_time: 148.6654663086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7100524902
validation[          , genome  6237] predictions:    6441/  10000 (64.41%), best:    6494/10000 (64.94%), error:     10246.52246, best error:     10168.74902 on epoch:    86, epoch:   88/100, mu: 0.9853539467, learning_rate: 0.0000027229, weight_decay: 0.0000048786

epoch time: 1902.5996093750s, input_fired_time: 24.2618160248, output_fired_time: 13.5021486282, propagate_forward_time: 726.3642578125, propagate_backward_time: 1106.5079345703, weight_update_time: 0.3475737572, other_time: 31.9633789063
epoch time: 160.4767761230s, input_fired_time: 0.8102110028, output_fired_time: 0.0000000000, propagate_forward_time: 155.9798431396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6867218018
validation[          , genome  6237] predictions:    6519/  10000 (65.19%), best:    6519/10000 (65.19%), error:     10157.21777, best error:     10157.21777 on epoch:    89, epoch:   89/100, mu: 0.9855930209, learning_rate: 0.0000025435, weight_decay: 0.0000046259

epoch time: 1843.6179199219s, input_fired_time: 22.2111873627, output_fired_time: 9.3137969971, propagate_forward_time: 717.0347900391, propagate_backward_time: 1070.4301757813, weight_update_time: 0.3349688947, other_time: 24.6279296875
epoch time: 155.4181976318s, input_fired_time: 1.6703246832, output_fired_time: 0.0000000000, propagate_forward_time: 152.0090332031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7388458252
validation[          , genome  6237] predictions:    6489/  10000 (64.89%), best:    6519/10000 (65.19%), error:     10170.04492, best error:     10157.21777 on epoch:    89, epoch:   90/100, mu: 0.9858198166, learning_rate: 0.0000023760, weight_decay: 0.0000043864

epoch time: 1847.6706542969s, input_fired_time: 21.0958271027, output_fired_time: 12.3281745911, propagate_forward_time: 722.7118530273, propagate_backward_time: 1061.0527343750, weight_update_time: 0.3396089971, other_time: 30.4821777344
epoch time: 149.0606536865s, input_fired_time: 4.6699261665, output_fired_time: 0.0000000000, propagate_forward_time: 139.7871551514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6035766602
validation[          , genome  6237] predictions:    6527/  10000 (65.27%), best:    6519/10000 (65.19%), error:     10183.95703, best error:     10157.21777 on epoch:    89, epoch:   91/100, mu: 0.9860349298, learning_rate: 0.0000022195, weight_decay: 0.0000041592

epoch time: 1845.6829833984s, input_fired_time: 32.2295913696, output_fired_time: 7.3111333847, propagate_forward_time: 716.5770874023, propagate_backward_time: 1060.0266113281, weight_update_time: 2.2441027164, other_time: 29.5385742188
epoch time: 148.8149871826s, input_fired_time: 1.7599174976, output_fired_time: 0.0000000000, propagate_forward_time: 144.5639190674, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4911499023
validation[          , genome  6237] predictions:    6487/  10000 (64.87%), best:    6519/10000 (65.19%), error:     10161.41699, best error:     10157.21777 on epoch:    89, epoch:   92/100, mu: 0.9862389565, learning_rate: 0.0000020732, weight_decay: 0.0000039438

epoch time: 2060.4868164063s, input_fired_time: 41.0348320007, output_fired_time: 16.2183914185, propagate_forward_time: 784.9702758789, propagate_backward_time: 1196.8098144531, weight_update_time: 0.3728784025, other_time: 21.4536132813
epoch time: 173.4413604736s, input_fired_time: 2.8942484856, output_fired_time: 0.0000000000, propagate_forward_time: 166.7084350586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8386840820
validation[          , genome  6237] predictions:    6493/  10000 (64.93%), best:    6519/10000 (65.19%), error:     10182.38086, best error:     10157.21777 on epoch:    89, epoch:   93/100, mu: 0.9864324927, learning_rate: 0.0000019367, weight_decay: 0.0000037395

epoch time: 1895.4301757813s, input_fired_time: 31.3732070923, output_fired_time: 13.5027322769, propagate_forward_time: 745.5058593750, propagate_backward_time: 1085.0936279297, weight_update_time: 0.3445607424, other_time: 19.9548339844
epoch time: 146.2823028564s, input_fired_time: 0.7579738498, output_fired_time: 0.0000000000, propagate_forward_time: 143.9823760986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5419464111
validation[          , genome  6237] predictions:    6450/  10000 (64.50%), best:    6519/10000 (65.19%), error:     10205.00391, best error:     10157.21777 on epoch:    89, epoch:   94/100, mu: 0.9866160750, learning_rate: 0.0000018091, weight_decay: 0.0000035459

epoch time: 1868.0096435547s, input_fired_time: 29.2987899780, output_fired_time: 10.4818458557, propagate_forward_time: 747.5109252930, propagate_backward_time: 1059.1654052734, weight_update_time: 0.3346765339, other_time: 21.5526123047
epoch time: 153.9160003662s, input_fired_time: 0.7576414943, output_fired_time: 0.0000000000, propagate_forward_time: 148.4963531494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6620025635
validation[          , genome  6237] predictions:    6519/  10000 (65.19%), best:    6519/10000 (65.19%), error:     10124.82227, best error:     10124.82227 on epoch:    95, epoch:   95/100, mu: 0.9867901802, learning_rate: 0.0000016899, weight_decay: 0.0000033622

epoch time: 1871.6820068359s, input_fired_time: 16.1666946411, output_fired_time: 17.3959655762, propagate_forward_time: 736.6133422852, propagate_backward_time: 1073.7347412109, weight_update_time: 0.3407513499, other_time: 27.7711181641
epoch time: 150.9152679443s, input_fired_time: 2.7908792496, output_fired_time: 0.0000000000, propagate_forward_time: 142.4877471924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6366424561
validation[          , genome  6237] predictions:    6509/  10000 (65.09%), best:    6519/10000 (65.19%), error:     10143.66113, best error:     10124.82227 on epoch:    95, epoch:   96/100, mu: 0.9869553447, learning_rate: 0.0000015786, weight_decay: 0.0000031881

epoch time: 1933.9589843750s, input_fired_time: 30.5815448761, output_fired_time: 10.4422664642, propagate_forward_time: 731.2736816406, propagate_backward_time: 1136.8444824219, weight_update_time: 1.3717670441, other_time: 24.8170166016
epoch time: 162.0877075195s, input_fired_time: 0.7994170785, output_fired_time: 0.0000000000, propagate_forward_time: 155.5916748047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6966094971
validation[          , genome  6237] predictions:    6520/  10000 (65.20%), best:    6520/10000 (65.20%), error:     10115.05176, best error:     10115.05176 on epoch:    97, epoch:   97/100, mu: 0.9871119857, learning_rate: 0.0000014746, weight_decay: 0.0000030230

epoch time: 1944.4799804688s, input_fired_time: 32.6426124573, output_fired_time: 14.5210618973, propagate_forward_time: 750.3129882813, propagate_backward_time: 1124.8391113281, weight_update_time: 1.3711217642, other_time: 22.1641845703
epoch time: 159.6560363770s, input_fired_time: 0.7906171679, output_fired_time: 0.0000000000, propagate_forward_time: 150.2407684326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.6246490479
validation[          , genome  6237] predictions:    6507/  10000 (65.07%), best:    6520/10000 (65.20%), error:     10144.51953, best error:     10115.05176 on epoch:    97, epoch:   98/100, mu: 0.9872605801, learning_rate: 0.0000013775, weight_decay: 0.0000028664

epoch time: 1944.9249267578s, input_fired_time: 20.5261173248, output_fired_time: 7.6179432869, propagate_forward_time: 758.0847167969, propagate_backward_time: 1130.9114990234, weight_update_time: 0.3496970832, other_time: 27.7846679688
epoch time: 159.3354797363s, input_fired_time: 0.7912821770, output_fired_time: 0.0000000000, propagate_forward_time: 156.9109344482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6332702637
validation[          , genome  6237] predictions:    6470/  10000 (64.70%), best:    6520/10000 (65.20%), error:     10176.27344, best error:     10115.05176 on epoch:    97, epoch:   99/100, mu: 0.9874015450, learning_rate: 0.0000012867, weight_decay: 0.0000027180

epoch time: 1947.9544677734s, input_fired_time: 30.8444671631, output_fired_time: 9.6761274338, propagate_forward_time: 763.1838989258, propagate_backward_time: 1125.1647949219, weight_update_time: 0.3504393101, other_time: 19.0852050781
epoch time: 161.9449005127s, input_fired_time: 0.7972043753, output_fired_time: 0.0000000000, propagate_forward_time: 157.4567413330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6909484863
validation[          , genome  6237] predictions:    6508/  10000 (65.08%), best:    6520/10000 (65.20%), error:     10138.39063, best error:     10115.05176 on epoch:    97, epoch:  100/100, mu: 0.9875352383, learning_rate: 0.0000012020, weight_decay: 0.0000025772

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 792.5136718750s, input_fired_time: 7.0003767014, output_fired_time: 0.0000000000, propagate_forward_time: 765.2072143555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 20.3060913086
best training[          , genome  6237] predictions:   35497/  50000 (70.99%), best:    6520/10000 (65.20%), error:     44604.90234, best error:     10115.05176 on epoch:    97, epoch:  101/100, mu: 0.9876620770, learning_rate: 0.0000011228, weight_decay: 0.0000024438
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 161.8277282715s, input_fired_time: 3.8725199699, output_fired_time: 0.0000000000, propagate_forward_time: 146.6026306152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.3525848389
   testing[          , genome  6237] predictions:    6520/  10000 (65.20%), best:    6520/10000 (65.20%), error:     10115.05176, best error:     10115.05176 on epoch:    97, epoch:  101/100, mu: 0.9876620770, learning_rate: 0.0000011228, weight_decay: 0.0000024438
backpropagation finished successfully!
16:21:45 (21992): called boinc_finish(0)

</stderr_txt>
]]>