Nameexact_genome_1542531604_189_6237_0
Workunit4096960
Created18 Nov 2018, 9:52:14 UTC
Sent18 Nov 2018, 10:17:58 UTC
Report deadline5 Feb 2019, 22:11:32 UTC
Received24 Nov 2018, 13:11:17 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID83973
Run time2 days 17 hours 59 min 30 sec
CPU time2 days 17 hours 39 min 9 sec
Validate stateValid
Credit19,873.88
Device peak FLOPS2.50 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size533.95 MB
Peak swap size553.56 MB
Peak disk usage10.39 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
9%), error:     11977.93164, best error:     11731.67871 on epoch:    14, epoch:   15/100, mu: 0.7702429295, learning_rate: 0.0003939645, weight_decay: 0.0002367203

epoch time: 2426.4106445313s, input_fired_time: 27.2000331879, output_fired_time: 15.7749938965, propagate_forward_time: 945.7612915039, propagate_backward_time: 1410.7025146484, weight_update_time: 0.7476224303, other_time: 26.9720458984
epoch time: 193.6737365723s, input_fired_time: 1.9083092213, output_fired_time: 0.0000000000, propagate_forward_time: 186.2956542969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4697723389
validation[          , genome  6237] predictions:    5773/  10000 (57.73%), best:    5969/10000 (59.69%), error:     12039.39063, best error:     11731.67871 on epoch:    14, epoch:   16/100, mu: 0.7815510631, learning_rate: 0.0003680121, weight_decay: 0.0002244608

epoch time: 2420.3090820313s, input_fired_time: 25.3232479095, output_fired_time: 14.7950572968, propagate_forward_time: 942.9184570313, propagate_backward_time: 1407.9768066406, weight_update_time: 0.7532932162, other_time: 29.2954101563
epoch time: 193.0824584961s, input_fired_time: 1.9503870010, output_fired_time: 0.0000000000, propagate_forward_time: 185.6423187256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4897460938
validation[          , genome  6237] predictions:    6011/  10000 (60.11%), best:    6011/10000 (60.11%), error:     11634.45020, best error:     11634.45020 on epoch:    17, epoch:   17/100, mu: 0.7922772765, learning_rate: 0.0003437694, weight_decay: 0.0002128362

epoch time: 2408.6655273438s, input_fired_time: 26.9828071594, output_fired_time: 16.3616962433, propagate_forward_time: 930.9157714844, propagate_backward_time: 1408.3266601563, weight_update_time: 0.7497669458, other_time: 26.0783691406
epoch time: 196.4223937988s, input_fired_time: 1.9134345055, output_fired_time: 0.0000000000, propagate_forward_time: 189.1167297363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3922271729
validation[          , genome  6237] predictions:    5880/  10000 (58.80%), best:    6011/10000 (60.11%), error:     11789.14746, best error:     11634.45020 on epoch:    17, epoch:   18/100, mu: 0.8024515510, learning_rate: 0.0003211237, weight_decay: 0.0002018135

epoch time: 2416.8388671875s, input_fired_time: 27.3070087433, output_fired_time: 15.4859476089, propagate_forward_time: 929.9577026367, propagate_backward_time: 1415.8381347656, weight_update_time: 1.7166907787, other_time: 28.2500000000
epoch time: 196.4612731934s, input_fired_time: 1.9359632730, output_fired_time: 0.0000000000, propagate_forward_time: 189.9787597656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5465545654
validation[          , genome  6237] predictions:    5937/  10000 (59.37%), best:    5937/10000 (59.37%), error:     11446.60156, best error:     11446.60156 on epoch:    19, epoch:   19/100, mu: 0.8121023178, learning_rate: 0.0002999698, weight_decay: 0.0001913618

epoch time: 2407.3713378906s, input_fired_time: 25.2568340302, output_fired_time: 14.7655305862, propagate_forward_time: 934.8103637695, propagate_backward_time: 1405.1562500000, weight_update_time: 0.7579446435, other_time: 27.3823242188
epoch time: 193.5818176270s, input_fired_time: 1.9220260382, output_fired_time: 0.0000000000, propagate_forward_time: 186.1647186279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4950714111
validation[          , genome  6237] predictions:    5997/  10000 (59.97%), best:    5997/10000 (59.97%), error:     11372.64648, best error:     11372.64648 on epoch:    20, epoch:   20/100, mu: 0.8212564588, learning_rate: 0.0002802094, weight_decay: 0.0001814513

epoch time: 2414.5786132813s, input_fired_time: 26.2025089264, output_fired_time: 13.5877504349, propagate_forward_time: 935.5103149414, propagate_backward_time: 1413.0892333984, weight_update_time: 0.7558454871, other_time: 26.1890869141
epoch time: 191.9724273682s, input_fired_time: 2.8900153637, output_fired_time: 0.0000000000, propagate_forward_time: 183.7057189941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3766937256
validation[          , genome  6237] predictions:    6029/  10000 (60.29%), best:    5997/10000 (59.97%), error:     11488.45801, best error:     11372.64648 on epoch:    20, epoch:   21/100, mu: 0.8299395442, learning_rate: 0.0002617506, weight_decay: 0.0001720541

epoch time: 2414.4306640625s, input_fired_time: 24.3049812317, output_fired_time: 15.7741289139, propagate_forward_time: 940.1058349609, propagate_backward_time: 1404.7087402344, weight_update_time: 0.7577455640, other_time: 29.5369873047
epoch time: 192.8469390869s, input_fired_time: 2.9056234360, output_fired_time: 0.0000000000, propagate_forward_time: 184.5628509521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3784637451
validation[          , genome  6237] predictions:    6032/  10000 (60.32%), best:    5997/10000 (59.97%), error:     11391.62598, best error:     11372.64648 on epoch:    20, epoch:   22/100, mu: 0.8381758332, learning_rate: 0.0002445079, weight_decay: 0.0001631436

epoch time: 2421.9262695313s, input_fired_time: 27.3693466187, output_fired_time: 15.7226524353, propagate_forward_time: 933.9341430664, propagate_backward_time: 1417.5822753906, weight_update_time: 0.7508037686, other_time: 27.3178710938
epoch time: 196.4697113037s, input_fired_time: 1.9678165913, output_fired_time: 0.0000000000, propagate_forward_time: 189.9519500732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5499420166
validation[          , genome  6237] predictions:    6030/  10000 (60.30%), best:    6030/10000 (60.30%), error:     11351.65625, best error:     11351.65625 on epoch:    23, epoch:   23/100, mu: 0.8459883332, learning_rate: 0.0002284010, weight_decay: 0.0001546945

epoch time: 2416.4467773438s, input_fired_time: 25.5287590027, output_fired_time: 14.6100978851, propagate_forward_time: 934.4528198242, propagate_backward_time: 1411.2261962891, weight_update_time: 1.7541335821, other_time: 30.6287841797
epoch time: 196.2048339844s, input_fired_time: 2.9224996567, output_fired_time: 0.0000000000, propagate_forward_time: 188.6915893555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5907440186
validation[          , genome  6237] predictions:    6079/  10000 (60.79%), best:    6079/10000 (60.79%), error:     11149.82910, best error:     11149.82910 on epoch:    24, epoch:   24/100, mu: 0.8533987999, learning_rate: 0.0002133551, weight_decay: 0.0001466830

epoch time: 2421.6728515625s, input_fired_time: 27.4039249420, output_fired_time: 16.8758296967, propagate_forward_time: 935.4862060547, propagate_backward_time: 1412.4453125000, weight_update_time: 0.7517243028, other_time: 29.4617919922
epoch time: 193.2429656982s, input_fired_time: 1.9229302406, output_fired_time: 0.0000000000, propagate_forward_time: 185.8295593262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4904785156
validation[          , genome  6237] predictions:    6026/  10000 (60.26%), best:    6079/10000 (60.79%), error:     11342.19434, best error:     11149.82910 on epoch:    24, epoch:   25/100, mu: 0.8604279160, learning_rate: 0.0001993004, weight_decay: 0.0001390864

epoch time: 2412.9243164063s, input_fired_time: 25.3758754730, output_fired_time: 14.7020454407, propagate_forward_time: 938.6301879883, propagate_backward_time: 1407.1579589844, weight_update_time: 0.7457692623, other_time: 27.0581054688
epoch time: 195.7122497559s, input_fired_time: 1.9529876709, output_fired_time: 0.0000000000, propagate_forward_time: 189.2189483643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5403137207
validation[          , genome  6237] predictions:    6174/  10000 (61.74%), best:    6174/10000 (61.74%), error:     11012.25098, best error:     11012.25098 on epoch:    26, epoch:   26/100, mu: 0.8670953512, learning_rate: 0.0001861715, weight_decay: 0.0001318832

epoch time: 2414.2810058594s, input_fired_time: 26.3739528656, output_fired_time: 14.6256055832, propagate_forward_time: 932.8758544922, propagate_backward_time: 1413.1459960938, weight_update_time: 0.7554754019, other_time: 27.2596435547
epoch time: 194.2706604004s, input_fired_time: 1.9397763014, output_fired_time: 0.0000000000, propagate_forward_time: 186.8737640381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4571228027
validation[          , genome  6237] predictions:    6113/  10000 (61.13%), best:    6174/10000 (61.74%), error:     11119.82520, best error:     11012.25098 on epoch:    26, epoch:   27/100, mu: 0.8734197021, learning_rate: 0.0001739075, weight_decay: 0.0001250531

epoch time: 2416.4433593750s, input_fired_time: 28.3910083771, output_fired_time: 13.6664409637, propagate_forward_time: 932.8763427734, propagate_backward_time: 1411.0800781250, weight_update_time: 0.7564178109, other_time: 30.4293212891
epoch time: 196.0700988770s, input_fired_time: 1.9672399759, output_fired_time: 0.0000000000, propagate_forward_time: 189.5644378662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5384216309
validation[          , genome  6237] predictions:    6234/  10000 (62.34%), best:    6234/10000 (62.34%), error:     10941.23438, best error:     10941.23438 on epoch:    28, epoch:   28/100, mu: 0.8794186115, learning_rate: 0.0001624514, weight_decay: 0.0001185767

epoch time: 2414.4284667969s, input_fired_time: 30.1084308624, output_fired_time: 18.5562343597, propagate_forward_time: 929.3875122070, propagate_backward_time: 1411.2702636719, weight_update_time: 0.7427874804, other_time: 25.1062011719
epoch time: 192.5459136963s, input_fired_time: 1.9168179035, output_fired_time: 0.0000000000, propagate_forward_time: 186.3179626465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3111267090
validation[          , genome  6237] predictions:    6116/  10000 (61.16%), best:    6234/10000 (62.34%), error:     11265.38672, best error:     10941.23438 on epoch:    28, epoch:   29/100, mu: 0.8851088285, learning_rate: 0.0001517500, weight_decay: 0.0001124357

epoch time: 2432.3796386719s, input_fired_time: 28.4699840546, output_fired_time: 14.5980415344, propagate_forward_time: 923.6397705078, propagate_backward_time: 1437.0975341797, weight_update_time: 0.7518294454, other_time: 28.5742187500
epoch time: 197.0627136230s, input_fired_time: 2.0030910969, output_fired_time: 0.0000000000, propagate_forward_time: 188.5523529053, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5072631836
validation[          , genome  6237] predictions:    6195/  10000 (61.95%), best:    6234/10000 (62.34%), error:     11025.40820, best error:     10941.23438 on epoch:    28, epoch:   30/100, mu: 0.8905062675, learning_rate: 0.0001417535, weight_decay: 0.0001066128

epoch time: 2417.0927734375s, input_fired_time: 29.4847240448, output_fired_time: 16.7659530640, propagate_forward_time: 934.9226684570, propagate_backward_time: 1407.7443847656, weight_update_time: 0.7432565093, other_time: 28.1752929688
epoch time: 195.1614685059s, input_fired_time: 1.9498063326, output_fired_time: 0.0000000000, propagate_forward_time: 187.8001098633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4115447998
validation[          , genome  6237] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     10837.49121, best error:     10837.49121 on epoch:    31, epoch:   31/100, mu: 0.8956259489, learning_rate: 0.0001324155, weight_decay: 0.0001010914

epoch time: 2422.1411132813s, input_fired_time: 26.4291267395, output_fired_time: 14.6097049713, propagate_forward_time: 934.9013061523, propagate_backward_time: 1419.8465576172, weight_update_time: 0.7531488538, other_time: 26.3543701172
epoch time: 192.6496276855s, input_fired_time: 1.9458730221, output_fired_time: 0.0000000000, propagate_forward_time: 184.2784423828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4253082275
validation[          , genome  6237] predictions:    6285/  10000 (62.85%), best:    6285/10000 (62.85%), error:     10752.76367, best error:     10752.76367 on epoch:    32, epoch:   32/100, mu: 0.9004821777, learning_rate: 0.0001236926, weight_decay: 0.0000958559

epoch time: 2421.4716796875s, input_fired_time: 27.3790054321, output_fired_time: 16.5826683044, propagate_forward_time: 927.4020996094, propagate_backward_time: 1421.7741699219, weight_update_time: 0.7459758520, other_time: 28.3337402344
epoch time: 191.9936676025s, input_fired_time: 1.9319111109, output_fired_time: 0.0000000000, propagate_forward_time: 185.4959716797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5657806396
validation[          , genome  6237] predictions:    6214/  10000 (62.14%), best:    6285/10000 (62.85%), error:     10967.08008, best error:     10752.76367 on epoch:    32, epoch:   33/100, mu: 0.9050885439, learning_rate: 0.0001155444, weight_decay: 0.0000908916

epoch time: 2414.7500000000s, input_fired_time: 25.3457603455, output_fired_time: 18.6837139130, propagate_forward_time: 935.0905151367, propagate_backward_time: 1409.6384277344, weight_update_time: 0.7438126206, other_time: 25.9916992188
epoch time: 196.4678039551s, input_fired_time: 1.9683600664, output_fired_time: 0.0000000000, propagate_forward_time: 190.0282287598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4712219238
validation[          , genome  6237] predictions:    6056/  10000 (60.56%), best:    6285/10000 (62.85%), error:     11361.24805, best error:     10752.76367 on epoch:    32, epoch:   34/100, mu: 0.9094578624, learning_rate: 0.0001079330, weight_decay: 0.0000861844

epoch time: 2417.5053710938s, input_fired_time: 26.2930717468, output_fired_time: 15.4882383347, propagate_forward_time: 937.3739624023, propagate_backward_time: 1411.0093994141, weight_update_time: 0.7489919662, other_time: 27.3406982422
epoch time: 195.5491333008s, input_fired_time: 3.0400054455, output_fired_time: 0.0000000000, propagate_forward_time: 187.9497833252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5593414307
validation[          , genome  6237] predictions:    6233/  10000 (62.33%), best:    6285/10000 (62.85%), error:     10880.32227, best error:     10752.76367 on epoch:    32, epoch:   35/100, mu: 0.9136023521, learning_rate: 0.0001008229, weight_decay: 0.0000817210

epoch time: 2423.3771972656s, input_fired_time: 27.5684795380, output_fired_time: 13.8505773544, propagate_forward_time: 941.6426391602, propagate_backward_time: 1407.7108154297, weight_update_time: 1.7133021355, other_time: 32.6048583984
epoch time: 195.8854980469s, input_fired_time: 1.9629943371, output_fired_time: 0.0000000000, propagate_forward_time: 187.4815673828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4409332275
validation[          , genome  6237] predictions:    6170/  10000 (61.70%), best:    6285/10000 (62.85%), error:     11028.04980, best error:     10752.76367 on epoch:    32, epoch:   36/100, mu: 0.9175335765, learning_rate: 0.0000941812, weight_decay: 0.0000774888

epoch time: 2414.9865722656s, input_fired_time: 25.1290397644, output_fired_time: 16.5524692535, propagate_forward_time: 933.7517700195, propagate_backward_time: 1409.4086914063, weight_update_time: 1.7333559990, other_time: 30.1445312500
epoch time: 184.3409118652s, input_fired_time: 1.8164162636, output_fired_time: 0.0000000000, propagate_forward_time: 177.4047851563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1197052002
validation[          , genome  6237] predictions:    6302/  10000 (63.02%), best:    6302/10000 (63.02%), error:     10728.50586, best error:     10728.50586 on epoch:    37, epoch:   37/100, mu: 0.9212625027, learning_rate: 0.0000879771, weight_decay: 0.0000734757

epoch time: 2433.7634277344s, input_fired_time: 26.3682174683, output_fired_time: 13.8738727570, propagate_forward_time: 936.3925170898, propagate_backward_time: 1430.7467041016, weight_update_time: 0.7485251427, other_time: 26.3822021484
epoch time: 200.5275115967s, input_fired_time: 1.9676940441, output_fired_time: 0.0000000000, propagate_forward_time: 193.9883728027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5714416504
validation[          , genome  6237] predictions:    6214/  10000 (62.14%), best:    6302/10000 (63.02%), error:     10877.72949, best error:     10728.50586 on epoch:    37, epoch:   38/100, mu: 0.9247995615, learning_rate: 0.0000821816, weight_decay: 0.0000696704

epoch time: 2421.4702148438s, input_fired_time: 27.1844902039, output_fired_time: 13.7363033295, propagate_forward_time: 935.7736816406, propagate_backward_time: 1414.8509521484, weight_update_time: 0.7448197603, other_time: 29.9246826172
epoch time: 193.0381622314s, input_fired_time: 1.9583503008, output_fired_time: 0.0000000000, propagate_forward_time: 186.7017211914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3780975342
validation[          , genome  6237] predictions:    6215/  10000 (62.15%), best:    6302/10000 (63.02%), error:     10917.82031, best error:     10728.50586 on epoch:    37, epoch:   39/100, mu: 0.9281545877, learning_rate: 0.0000767679, weight_decay: 0.0000660623

epoch time: 2414.5417480469s, input_fired_time: 26.3307952881, output_fired_time: 15.6093101501, propagate_forward_time: 937.1061401367, propagate_backward_time: 1409.5080566406, weight_update_time: 0.7472254038, other_time: 25.9873046875
epoch time: 195.1929473877s, input_fired_time: 2.9728419781, output_fired_time: 0.0000000000, propagate_forward_time: 187.6970062256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5231018066
validation[          , genome  6237] predictions:    6248/  10000 (62.48%), best:    6302/10000 (63.02%), error:     10831.32715, best error:     10728.50586 on epoch:    37, epoch:   40/100, mu: 0.9313369989, learning_rate: 0.0000717108, weight_decay: 0.0000626410

epoch time: 2419.7011718750s, input_fired_time: 26.4981708527, output_fired_time: 13.6190452576, propagate_forward_time: 937.8447265625, propagate_backward_time: 1410.6229248047, weight_update_time: 0.7379599810, other_time: 31.1160888672
epoch time: 195.9149627686s, input_fired_time: 1.9897183180, output_fired_time: 0.0000000000, propagate_forward_time: 189.3435058594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5817413330
validation[          , genome  6237] predictions:    6288/  10000 (62.88%), best:    6288/10000 (62.88%), error:     10631.43848, best error:     10631.43848 on epoch:    41, epoch:   41/100, mu: 0.9343556166, learning_rate: 0.0000669869, weight_decay: 0.0000593968

epoch time: 2421.1530761719s, input_fired_time: 26.4221382141, output_fired_time: 16.7235546112, propagate_forward_time: 934.1544799805, propagate_backward_time: 1411.4320068359, weight_update_time: 0.7442526817, other_time: 32.4207763672
epoch time: 195.2015686035s, input_fired_time: 1.9981615543, output_fired_time: 0.0000000000, propagate_forward_time: 188.5825958252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6208038330
validation[          , genome  6237] predictions:    6301/  10000 (63.01%), best:    6288/10000 (62.88%), error:     10642.16211, best error:     10631.43848 on epoch:    41, epoch:   42/100, mu: 0.9372189045, learning_rate: 0.0000625742, weight_decay: 0.0000563207

epoch time: 2415.1091308594s, input_fired_time: 27.5114631653, output_fired_time: 14.4385519028, propagate_forward_time: 931.3981933594, propagate_backward_time: 1411.5097656250, weight_update_time: 0.7363943458, other_time: 30.2512207031
epoch time: 196.2565002441s, input_fired_time: 1.9738075733, output_fired_time: 0.0000000000, propagate_forward_time: 189.7457427979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5369567871
validation[          , genome  6237] predictions:    6290/  10000 (62.90%), best:    6288/10000 (62.88%), error:     10724.67773, best error:     10631.43848 on epoch:    41, epoch:   43/100, mu: 0.9399349093, learning_rate: 0.0000584521, weight_decay: 0.0000534039

epoch time: 2420.1149902344s, input_fired_time: 29.3963966370, output_fired_time: 16.5812091827, propagate_forward_time: 933.7556762695, propagate_backward_time: 1409.0991210938, weight_update_time: 0.7377464175, other_time: 31.2824707031
epoch time: 194.9716644287s, input_fired_time: 1.9671741724, output_fired_time: 0.0000000000, propagate_forward_time: 188.5161590576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4883270264
validation[          , genome  6237] predictions:    6219/  10000 (62.19%), best:    6288/10000 (62.88%), error:     10896.24121, best error:     10631.43848 on epoch:    41, epoch:   44/100, mu: 0.9425111413, learning_rate: 0.0000546016, weight_decay: 0.0000506382

epoch time: 2422.8317871094s, input_fired_time: 28.3878440857, output_fired_time: 13.6294059753, propagate_forward_time: 935.6906127930, propagate_backward_time: 1416.9993896484, weight_update_time: 0.7408761978, other_time: 28.1243896484
epoch time: 195.8614501953s, input_fired_time: 3.0722019672, output_fired_time: 0.0000000000, propagate_forward_time: 187.2725372314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5167083740
validation[          , genome  6237] predictions:    6271/  10000 (62.71%), best:    6288/10000 (62.88%), error:     10778.79297, best error:     10631.43848 on epoch:    41, epoch:   45/100, mu: 0.9449548125, learning_rate: 0.0000510047, weight_decay: 0.0000480157

epoch time: 2419.9404296875s, input_fired_time: 24.4960899353, output_fired_time: 14.9007310867, propagate_forward_time: 946.6610717773, propagate_backward_time: 1405.7381591797, weight_update_time: 0.7400596738, other_time: 28.1444091797
epoch time: 193.3856658936s, input_fired_time: 2.0128738880, output_fired_time: 0.0000000000, propagate_forward_time: 185.7807922363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5919952393
validation[          , genome  6237] predictions:    6269/  10000 (62.69%), best:    6288/10000 (62.88%), error:     10738.36719, best error:     10631.43848 on epoch:    41, epoch:   46/100, mu: 0.9472727180, learning_rate: 0.0000476448, weight_decay: 0.0000455290

epoch time: 2416.0776367188s, input_fired_time: 27.4524230957, output_fired_time: 14.6477422714, propagate_forward_time: 936.4926147461, propagate_backward_time: 1408.4769287109, weight_update_time: 0.7515850067, other_time: 29.0079345703
epoch time: 195.9474639893s, input_fired_time: 1.9918391705, output_fired_time: 0.0000000000, propagate_forward_time: 189.4124450684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5431823730
validation[          , genome  6237] predictions:    6268/  10000 (62.68%), best:    6288/10000 (62.88%), error:     10709.76074, best error:     10631.43848 on epoch:    41, epoch:   47/100, mu: 0.9494713545, learning_rate: 0.0000445062, weight_decay: 0.0000431711

epoch time: 2412.0517578125s, input_fired_time: 26.3651313782, output_fired_time: 16.6557636261, propagate_forward_time: 925.8138427734, propagate_backward_time: 1415.7424316406, weight_update_time: 0.7563709021, other_time: 27.4744873047
epoch time: 196.3274383545s, input_fired_time: 1.9778015614, output_fired_time: 0.0000000000, propagate_forward_time: 188.8454437256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5041961670
validation[          , genome  6237] predictions:    6250/  10000 (62.50%), best:    6288/10000 (62.88%), error:     10715.53125, best error:     10631.43848 on epoch:    41, epoch:   48/100, mu: 0.9515568614, learning_rate: 0.0000415744, weight_decay: 0.0000409353

epoch time: 2435.9221191406s, input_fired_time: 25.5080051422, output_fired_time: 16.6177482605, propagate_forward_time: 938.9923706055, propagate_backward_time: 1427.4146728516, weight_update_time: 0.7491472960, other_time: 27.3892822266
epoch time: 195.9153442383s, input_fired_time: 2.9560070038, output_fired_time: 0.0000000000, propagate_forward_time: 188.5076751709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4516601563
validation[          , genome  6237] predictions:    6256/  10000 (62.56%), best:    6288/10000 (62.88%), error:     10800.28516, best error:     10631.43848 on epoch:    41, epoch:   49/100, mu: 0.9535350204, learning_rate: 0.0000388357, weight_decay: 0.0000388153

epoch time: 2424.7858886719s, input_fired_time: 27.5081462860, output_fired_time: 15.7101945877, propagate_forward_time: 931.5029907227, propagate_backward_time: 1421.7293701172, weight_update_time: 0.7482312918, other_time: 28.3353271484
epoch time: 196.9870910645s, input_fired_time: 2.0243172646, output_fired_time: 0.0000000000, propagate_forward_time: 190.3879547119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5748138428
validation[          , genome  6237] predictions:    6358/  10000 (63.58%), best:    6358/10000 (63.58%), error:     10528.46289, best error:     10528.46289 on epoch:    50, epoch:   50/100, mu: 0.9554114342, learning_rate: 0.0000362774, weight_decay: 0.0000368051

epoch time: 2417.1423339844s, input_fired_time: 28.4468250275, output_fired_time: 15.6865482330, propagate_forward_time: 939.3614501953, propagate_backward_time: 1406.5303955078, weight_update_time: 0.7367320061, other_time: 27.1171875000
epoch time: 195.2937927246s, input_fired_time: 2.9638087749, output_fired_time: 0.0000000000, propagate_forward_time: 187.7504730225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5795135498
validation[          , genome  6237] predictions:    6181/  10000 (61.81%), best:    6358/10000 (63.58%), error:     10884.48340, best error:     10528.46289 on epoch:    50, epoch:   51/100, mu: 0.9571912885, learning_rate: 0.0000338876, weight_decay: 0.0000348990

epoch time: 2420.7028808594s, input_fired_time: 24.5195465088, output_fired_time: 15.5733356476, propagate_forward_time: 931.2744750977, propagate_backward_time: 1420.7572021484, weight_update_time: 0.7626870275, other_time: 28.5784912109
epoch time: 194.3792572021s, input_fired_time: 1.9797344208, output_fired_time: 0.0000000000, propagate_forward_time: 187.8737792969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5257415771
validation[          , genome  6237] predictions:    6305/  10000 (63.05%), best:    6358/10000 (63.58%), error:     10695.25293, best error:     10528.46289 on epoch:    50, epoch:   52/100, mu: 0.9588795304, learning_rate: 0.0000316553, weight_decay: 0.0000330916

epoch time: 2423.7983398438s, input_fired_time: 26.5283889771, output_fired_time: 15.7419805527, propagate_forward_time: 928.3757324219, propagate_backward_time: 1423.3898925781, weight_update_time: 0.7649593353, other_time: 29.7624511719
epoch time: 194.4720458984s, input_fired_time: 1.9788597822, output_fired_time: 0.0000000000, propagate_forward_time: 186.9639739990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5292053223
validation[          , genome  6237] predictions:    6401/  10000 (64.01%), best:    6401/10000 (64.01%), error:     10461.35449, best error:     10461.35449 on epoch:    53, epoch:   53/100, mu: 0.9604809284, learning_rate: 0.0000295700, weight_decay: 0.0000313778

epoch time: 2421.9885253906s, input_fired_time: 26.7960948944, output_fired_time: 15.6538724899, propagate_forward_time: 938.2012329102, propagate_backward_time: 1409.2841796875, weight_update_time: 0.7480196357, other_time: 32.0532226563
epoch time: 195.4902191162s, input_fired_time: 1.9765809774, output_fired_time: 0.0000000000, propagate_forward_time: 189.0795288086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4341125488
validation[          , genome  6237] predictions:    6299/  10000 (62.99%), best:    6401/10000 (64.01%), error:     10717.21680, best error:     10461.35449 on epoch:    53, epoch:   54/100, mu: 0.9619998932, learning_rate: 0.0000276221, weight_decay: 0.0000297528

epoch time: 2522.9411621094s, input_fired_time: 26.0539016724, output_fired_time: 14.0142326355, propagate_forward_time: 966.6876831055, propagate_backward_time: 1489.1778564453, weight_update_time: 0.7643953562, other_time: 27.0074462891
epoch time: 198.0297698975s, input_fired_time: 2.0143296719, output_fired_time: 0.0000000000, propagate_forward_time: 191.1723327637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8431091309
validation[          , genome  6237] predictions:    6373/  10000 (63.73%), best:    6373/10000 (63.73%), error:     10432.29590, best error:     10432.29590 on epoch:    55, epoch:   55/100, mu: 0.9634407163, learning_rate: 0.0000258025, weight_decay: 0.0000282119

epoch time: 2430.6027832031s, input_fired_time: 28.6114482880, output_fired_time: 14.5280475616, propagate_forward_time: 934.6370849609, propagate_backward_time: 1424.3330078125, weight_update_time: 0.7529360056, other_time: 28.4932861328
epoch time: 196.0021209717s, input_fired_time: 2.0043785572, output_fired_time: 0.0000000000, propagate_forward_time: 189.5539855957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4437561035
validation[          , genome  6237] predictions:    6350/  10000 (63.50%), best:    6373/10000 (63.73%), error:     10546.18359, best error:     10432.29590 on epoch:    55, epoch:   56/100, mu: 0.9648073912, learning_rate: 0.0000241027, weight_decay: 0.0000267508

epoch time: 2432.5275878906s, input_fired_time: 31.8182392120, output_fired_time: 13.7950115204, propagate_forward_time: 939.0106811523, propagate_backward_time: 1420.4119873047, weight_update_time: 0.7577064037, other_time: 27.4915771484
epoch time: 198.3252258301s, input_fired_time: 3.0353543758, output_fired_time: 0.0000000000, propagate_forward_time: 189.7082061768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5816650391
validation[          , genome  6237] predictions:    6395/  10000 (63.95%), best:    6373/10000 (63.73%), error:     10483.62891, best error:     10432.29590 on epoch:    55, epoch:   57/100, mu: 0.9661037326, learning_rate: 0.0000225150, weight_decay: 0.0000253654

epoch time: 2439.3454589844s, input_fired_time: 26.7270183563, output_fired_time: 13.8268461227, propagate_forward_time: 940.8652954102, propagate_backward_time: 1428.2498779297, weight_update_time: 0.7481564879, other_time: 29.6763916016
epoch time: 196.7791900635s, input_fired_time: 3.0153441429, output_fired_time: 0.0000000000, propagate_forward_time: 189.1961517334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5676879883
validation[          , genome  6237] predictions:    6325/  10000 (63.25%), best:    6373/10000 (63.73%), error:     10607.50977, best error:     10432.29590 on epoch:    55, epoch:   58/100, mu: 0.9673333764, learning_rate: 0.0000210318, weight_decay: 0.0000240518

epoch time: 2422.6936035156s, input_fired_time: 27.6883792877, output_fired_time: 14.7187213898, propagate_forward_time: 936.9244384766, propagate_backward_time: 1413.8884277344, weight_update_time: 0.7472325563, other_time: 29.4735107422
epoch time: 193.9178009033s, input_fired_time: 1.9632732868, output_fired_time: 0.0000000000, propagate_forward_time: 186.5052185059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4493103027
validation[          , genome  6237] predictions:    6343/  10000 (63.43%), best:    6373/10000 (63.73%), error:     10511.54492, best error:     10432.29590 on epoch:    55, epoch:   59/100, mu: 0.9684997201, learning_rate: 0.0000196463, weight_decay: 0.0000228061

epoch time: 2442.8471679688s, input_fired_time: 25.7648372650, output_fired_time: 15.9563217163, propagate_forward_time: 948.8847045898, propagate_backward_time: 1421.7976074219, weight_update_time: 0.7556181550, other_time: 30.4436035156
epoch time: 196.6501159668s, input_fired_time: 1.9905017614, output_fired_time: 0.0000000000, propagate_forward_time: 189.1488647461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5107421875
validation[          , genome  6237] predictions:    6413/  10000 (64.13%), best:    6413/10000 (64.13%), error:     10384.05664, best error:     10384.05664 on epoch:    60, epoch:   60/100, mu: 0.9696060419, learning_rate: 0.0000183521, weight_decay: 0.0000216250

epoch time: 2429.8618164063s, input_fired_time: 29.6114788055, output_fired_time: 15.8266201019, propagate_forward_time: 935.1501464844, propagate_backward_time: 1415.7794189453, weight_update_time: 0.7450044751, other_time: 33.4940185547
epoch time: 196.5883789063s, input_fired_time: 2.0139398575, output_fired_time: 0.0000000000, propagate_forward_time: 189.1131896973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4612426758
validation[          , genome  6237] predictions:    6398/  10000 (63.98%), best:    6413/10000 (64.13%), error:     10438.91406, best error:     10384.05664 on epoch:    60, epoch:   61/100, mu: 0.9706554413, learning_rate: 0.0000171432, weight_decay: 0.0000205051

epoch time: 2431.0837402344s, input_fired_time: 28.8048076630, output_fired_time: 17.6465454102, propagate_forward_time: 933.8952636719, propagate_backward_time: 1423.4923095703, weight_update_time: 0.7467202544, other_time: 27.2449951172
epoch time: 197.6577606201s, input_fired_time: 1.9950014353, output_fired_time: 0.0000000000, propagate_forward_time: 190.1943664551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4683990479
validation[          , genome  6237] predictions:    6396/  10000 (63.96%), best:    6396/10000 (63.96%), error:     10331.77344, best error:     10331.77344 on epoch:    62, epoch:   62/100, mu: 0.9716508389, learning_rate: 0.0000160139, weight_decay: 0.0000194431

epoch time: 2437.3842773438s, input_fired_time: 25.8170719147, output_fired_time: 14.7951860428, propagate_forward_time: 943.9794921875, propagate_backward_time: 1423.0751953125, weight_update_time: 0.7579753399, other_time: 29.7172851563
epoch time: 195.5917510986s, input_fired_time: 3.0056803226, output_fired_time: 0.0000000000, propagate_forward_time: 188.0949249268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4911499023
validation[          , genome  6237] predictions:    6385/  10000 (63.85%), best:    6396/10000 (63.96%), error:     10420.59082, best error:     10331.77344 on epoch:    62, epoch:   63/100, mu: 0.9725950360, learning_rate: 0.0000149590, weight_decay: 0.0000184362

epoch time: 2431.1984863281s, input_fired_time: 27.8301906586, output_fired_time: 13.7761306763, propagate_forward_time: 935.9468383789, propagate_backward_time: 1424.8448486328, weight_update_time: 0.7555696964, other_time: 28.8006591797
epoch time: 195.8628997803s, input_fired_time: 2.0125582218, output_fired_time: 0.0000000000, propagate_forward_time: 187.0880126953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.7623291016
validation[          , genome  6237] predictions:    6466/  10000 (64.66%), best:    6466/10000 (64.66%), error:     10313.86914, best error:     10313.86914 on epoch:    64, epoch:   64/100, mu: 0.9734906554, learning_rate: 0.0000139736, weight_decay: 0.0000174814

epoch time: 2430.8100585938s, input_fired_time: 28.6498584747, output_fired_time: 14.5838184357, propagate_forward_time: 939.0579223633, propagate_backward_time: 1421.3212890625, weight_update_time: 0.7473853827, other_time: 27.1972656250
epoch time: 197.4504089355s, input_fired_time: 2.0113284588, output_fired_time: 0.0000000000, propagate_forward_time: 189.9104003906, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5286865234
validation[          , genome  6237] predictions:    6431/  10000 (64.31%), best:    6466/10000 (64.66%), error:     10349.88672, best error:     10313.86914 on epoch:    64, epoch:   65/100, mu: 0.9743402004, learning_rate: 0.0000130531, weight_decay: 0.0000165761

epoch time: 2431.4787597656s, input_fired_time: 25.7165946960, output_fired_time: 14.7973260880, propagate_forward_time: 945.1168212891, propagate_backward_time: 1414.7397460938, weight_update_time: 0.7382891178, other_time: 31.1082763672
epoch time: 196.4396820068s, input_fired_time: 2.0441448689, output_fired_time: 0.0000000000, propagate_forward_time: 189.8245697021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5709686279
validation[          , genome  6237] predictions:    6404/  10000 (64.04%), best:    6466/10000 (64.66%), error:     10449.69531, best error:     10313.86914 on epoch:    64, epoch:   66/100, mu: 0.9751459956, learning_rate: 0.0000121932, weight_decay: 0.0000157176

epoch time: 2437.3183593750s, input_fired_time: 26.9859142303, output_fired_time: 13.8876504898, propagate_forward_time: 944.8830566406, propagate_backward_time: 1424.8258056641, weight_update_time: 0.7721585035, other_time: 26.7359619141
epoch time: 194.1640777588s, input_fired_time: 2.0162196159, output_fired_time: 0.0000000000, propagate_forward_time: 187.6453247070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5025329590
validation[          , genome  6237] predictions:    6407/  10000 (64.07%), best:    6466/10000 (64.66%), error:     10430.92773, best error:     10313.86914 on epoch:    64, epoch:   67/100, mu: 0.9759103656, learning_rate: 0.0000113900, weight_decay: 0.0000149036

epoch time: 2427.0935058594s, input_fired_time: 30.6212959290, output_fired_time: 20.7368144989, propagate_forward_time: 932.6174316406, propagate_backward_time: 1413.8092041016, weight_update_time: 0.7534887791, other_time: 29.3087158203
epoch time: 195.4669799805s, input_fired_time: 1.9972548485, output_fired_time: 0.0000000000, propagate_forward_time: 188.8958740234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5738525391
validation[          , genome  6237] predictions:    6430/  10000 (64.30%), best:    6466/10000 (64.66%), error:     10346.30566, best error:     10313.86914 on epoch:    64, epoch:   68/100, mu: 0.9766353965, learning_rate: 0.0000106397, weight_decay: 0.0000141318

epoch time: 2435.9528808594s, input_fired_time: 30.7023029327, output_fired_time: 18.6298217773, propagate_forward_time: 932.3282470703, propagate_backward_time: 1426.6656494141, weight_update_time: 0.7578282952, other_time: 27.6267089844
epoch time: 196.0472259521s, input_fired_time: 3.0156817436, output_fired_time: 0.0000000000, propagate_forward_time: 188.5416564941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4898834229
validation[          , genome  6237] predictions:    6385/  10000 (63.85%), best:    6466/10000 (64.66%), error:     10427.97168, best error:     10313.86914 on epoch:    64, epoch:   69/100, mu: 0.9773231149, learning_rate: 0.0000099388, weight_decay: 0.0000133999

epoch time: 2427.6018066406s, input_fired_time: 25.6474857330, output_fired_time: 13.4691820145, propagate_forward_time: 933.7854614258, propagate_backward_time: 1427.9661865234, weight_update_time: 1.7769422531, other_time: 26.7335205078
epoch time: 197.0987701416s, input_fired_time: 2.9283485413, output_fired_time: 0.0000000000, propagate_forward_time: 189.6594085693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5110168457
validation[          , genome  6237] predictions:    6413/  10000 (64.13%), best:    6466/10000 (64.66%), error:     10390.17969, best error:     10313.86914 on epoch:    64, epoch:   70/100, mu: 0.9779754281, learning_rate: 0.0000092841, weight_decay: 0.0000127059

epoch time: 2415.8032226563s, input_fired_time: 27.4416522980, output_fired_time: 14.5670881271, propagate_forward_time: 927.9283447266, propagate_backward_time: 1419.2362060547, weight_update_time: 0.7562984228, other_time: 26.6298828125
epoch time: 192.7487030029s, input_fired_time: 1.9918379784, output_fired_time: 0.0000000000, propagate_forward_time: 185.2087097168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5481567383
validation[          , genome  6237] predictions:    6423/  10000 (64.23%), best:    6423/10000 (64.23%), error:     10292.81934, best error:     10292.81934 on epoch:    71, epoch:   71/100, mu: 0.9785941839, learning_rate: 0.0000086725, weight_decay: 0.0000120479

epoch time: 2424.7817382813s, input_fired_time: 29.8096599579, output_fired_time: 15.6121902466, propagate_forward_time: 933.2733154297, propagate_backward_time: 1414.4869384766, weight_update_time: 0.7614749074, other_time: 31.5996093750
epoch time: 193.8114471436s, input_fired_time: 1.9959604740, output_fired_time: 0.0000000000, propagate_forward_time: 186.2338104248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5816802979
validation[          , genome  6237] predictions:    6442/  10000 (64.42%), best:    6442/10000 (64.42%), error:     10281.14844, best error:     10281.14844 on epoch:    72, epoch:   72/100, mu: 0.9791811109, learning_rate: 0.0000081012, weight_decay: 0.0000114239

epoch time: 2418.5451660156s, input_fired_time: 29.6624145508, output_fired_time: 17.5950546265, propagate_forward_time: 921.8620605469, propagate_backward_time: 1421.7435302734, weight_update_time: 0.7626962662, other_time: 27.6822509766
epoch time: 196.1258697510s, input_fired_time: 2.0217857361, output_fired_time: 0.0000000000, propagate_forward_time: 189.6216888428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4823913574
validation[          , genome  6237] predictions:    6422/  10000 (64.22%), best:    6422/10000 (64.22%), error:     10262.05664, best error:     10262.05664 on epoch:    73, epoch:   73/100, mu: 0.9797378182, learning_rate: 0.0000075675, weight_decay: 0.0000108323

epoch time: 2441.2854003906s, input_fired_time: 28.8585090637, output_fired_time: 14.7385959625, propagate_forward_time: 944.7562255859, propagate_backward_time: 1423.5354003906, weight_update_time: 0.7548925877, other_time: 29.3968505859
epoch time: 217.7668609619s, input_fired_time: 2.1263792515, output_fired_time: 0.0000000000, propagate_forward_time: 211.0706787109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5698089600
validation[          , genome  6237] predictions:    6391/  10000 (63.91%), best:    6422/10000 (64.22%), error:     10391.23047, best error:     10262.05664 on epoch:    73, epoch:   74/100, mu: 0.9802658558, learning_rate: 0.0000070690, weight_decay: 0.0000102713

epoch time: 2431.7939453125s, input_fired_time: 30.4374446869, output_fired_time: 14.6695594788, propagate_forward_time: 935.6893310547, propagate_backward_time: 1423.6796875000, weight_update_time: 0.7584921718, other_time: 27.3177490234
epoch time: 195.6714019775s, input_fired_time: 2.0043406487, output_fired_time: 0.0000000000, propagate_forward_time: 188.1860198975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4810485840
validation[          , genome  6237] predictions:    6442/  10000 (64.42%), best:    6422/10000 (64.22%), error:     10356.56934, best error:     10262.05664 on epoch:    73, epoch:   75/100, mu: 0.9807667732, learning_rate: 0.0000066033, weight_decay: 0.0000097394

epoch time: 2418.7255859375s, input_fired_time: 29.4045619965, output_fired_time: 16.8116722107, propagate_forward_time: 935.6296997070, propagate_backward_time: 1406.2784423828, weight_update_time: 1.7704511881, other_time: 30.6011962891
epoch time: 191.3569488525s, input_fired_time: 1.9662855864, output_fired_time: 0.0000000000, propagate_forward_time: 184.9160614014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4746093750
validation[          , genome  6237] predictions:    6489/  10000 (64.89%), best:    6489/10000 (64.89%), error:     10222.60352, best error:     10222.60352 on epoch:    76, epoch:   76/100, mu: 0.9812418818, learning_rate: 0.0000061683, weight_decay: 0.0000092350

epoch time: 2408.7766113281s, input_fired_time: 27.7774219513, output_fired_time: 14.5585231781, propagate_forward_time: 927.3355102539, propagate_backward_time: 1409.3814697266, weight_update_time: 0.7584454417, other_time: 29.7237548828
epoch time: 190.7821350098s, input_fired_time: 1.9641346931, output_fired_time: 0.0000000000, propagate_forward_time: 183.3245849609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4934082031
validation[          , genome  6237] predictions:    6495/  10000 (64.95%), best:    6495/10000 (64.95%), error:     10208.26660, best error:     10208.26660 on epoch:    77, epoch:   77/100, mu: 0.9816925526, learning_rate: 0.0000057620, weight_decay: 0.0000087567

epoch time: 2363.4841308594s, input_fired_time: 28.5562248230, output_fired_time: 15.5367927551, propagate_forward_time: 912.0643920898, propagate_backward_time: 1374.7078857422, weight_update_time: 0.7550828457, other_time: 32.6187744141
epoch time: 192.6746520996s, input_fired_time: 1.9828746319, output_fired_time: 0.0000000000, propagate_forward_time: 186.1877899170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5039825439
validation[          , genome  6237] predictions:    6482/  10000 (64.82%), best:    6495/10000 (64.95%), error:     10261.06543, best error:     10208.26660 on epoch:    77, epoch:   78/100, mu: 0.9821200371, learning_rate: 0.0000053824, weight_decay: 0.0000083032

epoch time: 2400.1005859375s, input_fired_time: 25.7792339325, output_fired_time: 14.6780128479, propagate_forward_time: 919.0620727539, propagate_backward_time: 1413.3574218750, weight_update_time: 0.7708328962, other_time: 27.2238769531
epoch time: 211.7351684570s, input_fired_time: 2.0679328442, output_fired_time: 0.0000000000, propagate_forward_time: 204.9073333740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7599029541
validation[          , genome  6237] predictions:    6479/  10000 (64.79%), best:    6495/10000 (64.95%), error:     10243.41797, best error:     10208.26660 on epoch:    77, epoch:   79/100, mu: 0.9825255275, learning_rate: 0.0000050279, weight_decay: 0.0000078732

epoch time: 2581.8652343750s, input_fired_time: 37.3889350891, output_fired_time: 14.0376758575, propagate_forward_time: 982.0762939453, propagate_backward_time: 1519.4687500000, weight_update_time: 0.7807153463, other_time: 28.8936767578
epoch time: 193.8964233398s, input_fired_time: 2.0025460720, output_fired_time: 0.0000000000, propagate_forward_time: 186.2387847900, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6550903320
validation[          , genome  6237] predictions:    6498/  10000 (64.98%), best:    6498/10000 (64.98%), error:     10198.96680, best error:     10198.96680 on epoch:    80, epoch:   80/100, mu: 0.9829101563, learning_rate: 0.0000046967, weight_decay: 0.0000074654

epoch time: 2412.2272949219s, input_fired_time: 28.9043617249, output_fired_time: 14.7647171021, propagate_forward_time: 930.0733032227, propagate_backward_time: 1410.6665039063, weight_update_time: 0.7634164691, other_time: 27.8186035156
epoch time: 191.1567077637s, input_fired_time: 1.9760528803, output_fired_time: 0.0000000000, propagate_forward_time: 184.6691894531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5114593506
validation[          , genome  6237] predictions:    6464/  10000 (64.64%), best:    6498/10000 (64.98%), error:     10269.12500, best error:     10198.96680 on epoch:    80, epoch:   81/100, mu: 0.9832749963, learning_rate: 0.0000043873, weight_decay: 0.0000070788

epoch time: 2393.5483398438s, input_fired_time: 29.8284988403, output_fired_time: 14.6322994232, propagate_forward_time: 910.6573486328, propagate_backward_time: 1408.1420898438, weight_update_time: 0.7735623717, other_time: 30.2879638672
epoch time: 192.6425170898s, input_fired_time: 3.0110766888, output_fired_time: 0.0000000000, propagate_forward_time: 184.9875030518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6439361572
validation[          , genome  6237] predictions:    6500/  10000 (65.00%), best:    6500/10000 (65.00%), error:     10169.52930, best error:     10169.52930 on epoch:    82, epoch:   82/100, mu: 0.9836210608, learning_rate: 0.0000040983, weight_decay: 0.0000067122

epoch time: 2410.6166992188s, input_fired_time: 27.5610694885, output_fired_time: 15.7279024124, propagate_forward_time: 929.2949218750, propagate_backward_time: 1406.1423339844, weight_update_time: 0.7843728065, other_time: 31.8906250000
epoch time: 194.0698852539s, input_fired_time: 1.9925191402, output_fired_time: 0.0000000000, propagate_forward_time: 185.5991668701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4781951904
validation[          , genome  6237] predictions:    6509/  10000 (65.09%), best:    6500/10000 (65.00%), error:     10221.58887, best error:     10169.52930 on epoch:    82, epoch:   83/100, mu: 0.9839493036, learning_rate: 0.0000038283, weight_decay: 0.0000063646

epoch time: 2413.6899414063s, input_fired_time: 26.8736228943, output_fired_time: 16.6439437866, propagate_forward_time: 924.9274902344, propagate_backward_time: 1418.0262451172, weight_update_time: 0.7790185809, other_time: 27.2186279297
epoch time: 196.7168273926s, input_fired_time: 2.0216403008, output_fired_time: 0.0000000000, propagate_forward_time: 188.0830230713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6121673584
validation[          , genome  6237] predictions:    6459/  10000 (64.59%), best:    6500/10000 (65.00%), error:     10201.66504, best error:     10169.52930 on epoch:    82, epoch:   84/100, mu: 0.9842606783, learning_rate: 0.0000035761, weight_decay: 0.0000060350

epoch time: 2388.3193359375s, input_fired_time: 25.7749176025, output_fired_time: 13.5628137589, propagate_forward_time: 917.9567871094, propagate_backward_time: 1403.2141113281, weight_update_time: 0.7717243433, other_time: 27.8107910156
epoch time: 189.9134826660s, input_fired_time: 1.9607166052, output_fired_time: 0.0000000000, propagate_forward_time: 182.5442657471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4084930420
validation[          , genome  6237] predictions:    6475/  10000 (64.75%), best:    6500/10000 (65.00%), error:     10203.83594, best error:     10169.52930 on epoch:    82, epoch:   85/100, mu: 0.9845560193, learning_rate: 0.0000033405, weight_decay: 0.0000057224

epoch time: 2386.4431152344s, input_fired_time: 26.6431560516, output_fired_time: 13.6263647079, propagate_forward_time: 917.9982299805, propagate_backward_time: 1402.2386474609, weight_update_time: 0.7875620127, other_time: 25.9366455078
epoch time: 183.3907012939s, input_fired_time: 1.9365313053, output_fired_time: 0.0000000000, propagate_forward_time: 176.9208679199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5332946777
validation[          , genome  6237] predictions:    6494/  10000 (64.94%), best:    6494/10000 (64.94%), error:     10168.74902, best error:     10168.74902 on epoch:    86, epoch:   86/100, mu: 0.9848361611, learning_rate: 0.0000031205, weight_decay: 0.0000054261

epoch time: 2358.9702148438s, input_fired_time: 28.7110118866, output_fired_time: 15.6826667786, propagate_forward_time: 908.8388061523, propagate_backward_time: 1377.9071044922, weight_update_time: 0.7681531906, other_time: 27.8306884766
epoch time: 188.2349853516s, input_fired_time: 1.9106916189, output_fired_time: 0.0000000000, propagate_forward_time: 182.1359710693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1883239746
validation[          , genome  6237] predictions:    6509/  10000 (65.09%), best:    6494/10000 (64.94%), error:     10169.35254, best error:     10168.74902 on epoch:    86, epoch:   87/100, mu: 0.9851018786, learning_rate: 0.0000029149, weight_decay: 0.0000051450

epoch time: 2364.2922363281s, input_fired_time: 26.6296977997, output_fired_time: 15.3796586990, propagate_forward_time: 907.0728759766, propagate_backward_time: 1388.4494628906, weight_update_time: 0.7695197463, other_time: 26.7606201172
epoch time: 189.4800415039s, input_fired_time: 1.9432400465, output_fired_time: 0.0000000000, propagate_forward_time: 183.0004425049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5363616943
validation[          , genome  6237] predictions:    6441/  10000 (64.41%), best:    6494/10000 (64.94%), error:     10246.52246, best error:     10168.74902 on epoch:    86, epoch:   88/100, mu: 0.9853539467, learning_rate: 0.0000027229, weight_decay: 0.0000048786

epoch time: 2356.1630859375s, input_fired_time: 28.4169692993, output_fired_time: 13.4031629562, propagate_forward_time: 902.8496093750, propagate_backward_time: 1380.0466308594, weight_update_time: 0.7565050721, other_time: 31.4467773438
epoch time: 193.9256286621s, input_fired_time: 1.9758259058, output_fired_time: 0.0000000000, propagate_forward_time: 184.4684600830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4813385010
validation[          , genome  6237] predictions:    6519/  10000 (65.19%), best:    6519/10000 (65.19%), error:     10157.21777, best error:     10157.21777 on epoch:    89, epoch:   89/100, mu: 0.9855930209, learning_rate: 0.0000025435, weight_decay: 0.0000046259

epoch time: 2358.5556640625s, input_fired_time: 28.6638240814, output_fired_time: 14.3957471848, propagate_forward_time: 905.6041870117, propagate_backward_time: 1382.3746337891, weight_update_time: 0.7592568994, other_time: 27.5172119141
epoch time: 194.3181915283s, input_fired_time: 2.0227758884, output_fired_time: 0.0000000000, propagate_forward_time: 187.6134948730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6819152832
validation[          , genome  6237] predictions:    6489/  10000 (64.89%), best:    6519/10000 (65.19%), error:     10170.04492, best error:     10157.21777 on epoch:    89, epoch:   90/100, mu: 0.9858198166, learning_rate: 0.0000023760, weight_decay: 0.0000043864

epoch time: 2382.8842773438s, input_fired_time: 26.6588668823, output_fired_time: 13.5685825348, propagate_forward_time: 911.6882934570, propagate_backward_time: 1400.2722167969, weight_update_time: 0.7641893029, other_time: 30.6962890625
epoch time: 194.2097015381s, input_fired_time: 2.0070238113, output_fired_time: 0.0000000000, propagate_forward_time: 186.5944976807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6081848145
validation[          , genome  6237] predictions:    6527/  10000 (65.27%), best:    6519/10000 (65.19%), error:     10183.95703, best error:     10157.21777 on epoch:    89, epoch:   91/100, mu: 0.9860349298, learning_rate: 0.0000022195, weight_decay: 0.0000041592

epoch time: 2352.9196777344s, input_fired_time: 26.2476425171, output_fired_time: 15.4084281921, propagate_forward_time: 889.3480834961, propagate_backward_time: 1390.4437255859, weight_update_time: 0.7635416985, other_time: 31.4718017578
epoch time: 177.5144653320s, input_fired_time: 1.8046220541, output_fired_time: 0.0000000000, propagate_forward_time: 171.5123138428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1975250244
validation[          , genome  6237] predictions:    6487/  10000 (64.87%), best:    6519/10000 (65.19%), error:     10161.41699, best error:     10157.21777 on epoch:    89, epoch:   92/100, mu: 0.9862389565, learning_rate: 0.0000020732, weight_decay: 0.0000039438

epoch time: 2298.7553710938s, input_fired_time: 28.0132007599, output_fired_time: 14.1637172699, propagate_forward_time: 876.4498901367, propagate_backward_time: 1351.9477539063, weight_update_time: 0.7621011734, other_time: 28.1806640625
epoch time: 188.5845947266s, input_fired_time: 1.9530762434, output_fired_time: 0.0000000000, propagate_forward_time: 178.8275299072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.8039855957
validation[          , genome  6237] predictions:    6493/  10000 (64.93%), best:    6519/10000 (65.19%), error:     10182.38086, best error:     10157.21777 on epoch:    89, epoch:   93/100, mu: 0.9864324927, learning_rate: 0.0000019367, weight_decay: 0.0000037395

epoch time: 2312.0976562500s, input_fired_time: 27.1640300751, output_fired_time: 13.1662940979, propagate_forward_time: 883.5828857422, propagate_backward_time: 1361.6650390625, weight_update_time: 0.7714330554, other_time: 26.5194091797
epoch time: 187.6812286377s, input_fired_time: 2.9538376331, output_fired_time: 0.0000000000, propagate_forward_time: 176.7974700928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.9299163818
validation[          , genome  6237] predictions:    6450/  10000 (64.50%), best:    6519/10000 (65.19%), error:     10205.00391, best error:     10157.21777 on epoch:    89, epoch:   94/100, mu: 0.9866160750, learning_rate: 0.0000018091, weight_decay: 0.0000035459

epoch time: 2343.7580566406s, input_fired_time: 25.4742622375, output_fired_time: 16.1981182098, propagate_forward_time: 897.5469360352, propagate_backward_time: 1375.5638427734, weight_update_time: 0.7731229067, other_time: 28.9749755859
epoch time: 188.9356842041s, input_fired_time: 1.9311680794, output_fired_time: 0.0000000000, propagate_forward_time: 180.5189208984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4855957031
validation[          , genome  6237] predictions:    6519/  10000 (65.19%), best:    6519/10000 (65.19%), error:     10124.82227, best error:     10124.82227 on epoch:    95, epoch:   95/100, mu: 0.9867901802, learning_rate: 0.0000016899, weight_decay: 0.0000033622

epoch time: 2316.8713378906s, input_fired_time: 26.3335704803, output_fired_time: 14.1359357834, propagate_forward_time: 883.9307861328, propagate_backward_time: 1359.7155761719, weight_update_time: 1.7871593237, other_time: 32.7554931641
epoch time: 189.8774566650s, input_fired_time: 1.9519926310, output_fired_time: 0.0000000000, propagate_forward_time: 182.4350585938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4904022217
validation[          , genome  6237] predictions:    6509/  10000 (65.09%), best:    6519/10000 (65.19%), error:     10143.66113, best error:     10124.82227 on epoch:    95, epoch:   96/100, mu: 0.9869553447, learning_rate: 0.0000015786, weight_decay: 0.0000031881

epoch time: 2325.2260742188s, input_fired_time: 28.2921390533, output_fired_time: 15.1715116501, propagate_forward_time: 885.9968872070, propagate_backward_time: 1369.0361328125, weight_update_time: 0.7802848816, other_time: 26.7292480469
epoch time: 188.2484283447s, input_fired_time: 1.9325516224, output_fired_time: 0.0000000000, propagate_forward_time: 179.7772827148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5385894775
validation[          , genome  6237] predictions:    6520/  10000 (65.20%), best:    6520/10000 (65.20%), error:     10115.05176, best error:     10115.05176 on epoch:    97, epoch:   97/100, mu: 0.9871119857, learning_rate: 0.0000014746, weight_decay: 0.0000030230

epoch time: 2312.5292968750s, input_fired_time: 26.2542400360, output_fired_time: 14.1912298203, propagate_forward_time: 886.7008056641, propagate_backward_time: 1357.7823486328, weight_update_time: 1.7783883810, other_time: 27.6008300781
epoch time: 180.3501129150s, input_fired_time: 1.9220175743, output_fired_time: 0.0000000000, propagate_forward_time: 173.9012603760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5268402100
validation[          , genome  6237] predictions:    6507/  10000 (65.07%), best:    6520/10000 (65.20%), error:     10144.51953, best error:     10115.05176 on epoch:    97, epoch:   98/100, mu: 0.9872605801, learning_rate: 0.0000013775, weight_decay: 0.0000028664

epoch time: 2276.0463867188s, input_fired_time: 28.9869003296, output_fired_time: 13.0190486908, propagate_forward_time: 868.3630371094, propagate_backward_time: 1337.3682861328, weight_update_time: 0.7644566298, other_time: 28.3092041016
epoch time: 184.8996582031s, input_fired_time: 1.9167951345, output_fired_time: 0.0000000000, propagate_forward_time: 178.4061431885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5767211914
validation[          , genome  6237] predictions:    6470/  10000 (64.70%), best:    6520/10000 (65.20%), error:     10176.27344, best error:     10115.05176 on epoch:    97, epoch:   99/100, mu: 0.9874015450, learning_rate: 0.0000012867, weight_decay: 0.0000027180

epoch time: 2293.0842285156s, input_fired_time: 26.9394798279, output_fired_time: 15.1553268433, propagate_forward_time: 872.2445678711, propagate_backward_time: 1352.1705322266, weight_update_time: 0.7731986046, other_time: 26.5743408203
epoch time: 184.1413879395s, input_fired_time: 1.9411994219, output_fired_time: 0.0000000000, propagate_forward_time: 176.6825714111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5176239014
validation[          , genome  6237] predictions:    6508/  10000 (65.08%), best:    6520/10000 (65.20%), error:     10138.39063, best error:     10115.05176 on epoch:    97, epoch:  100/100, mu: 0.9875352383, learning_rate: 0.0000012020, weight_decay: 0.0000025772

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 909.7109985352s, input_fired_time: 11.5085420609, output_fired_time: 0.0000000000, propagate_forward_time: 873.5775146484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 24.6249389648
best training[          , genome  6237] predictions:   35497/  50000 (70.99%), best:    6520/10000 (65.20%), error:     44604.90234, best error:     10115.05176 on epoch:    97, epoch:  101/100, mu: 0.9876620770, learning_rate: 0.0000011228, weight_decay: 0.0000024438
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 186.8815002441s, input_fired_time: 2.8806929588, output_fired_time: 0.0000000000, propagate_forward_time: 172.9483489990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.0524597168
   testing[          , genome  6237] predictions:    6520/  10000 (65.20%), best:    6520/10000 (65.20%), error:     10115.05176, best error:     10115.05176 on epoch:    97, epoch:  101/100, mu: 0.9876620770, learning_rate: 0.0000011228, weight_decay: 0.0000024438
backpropagation finished successfully!
07:10:53 (7876): called boinc_finish(0)

</stderr_txt>
]]>