Nameexact_genome_1542531604_182_6264_2
Workunit4097409
Created23 Nov 2018, 16:45:02 UTC
Sent23 Nov 2018, 16:45:18 UTC
Report deadline1 Feb 2019, 12:33:24 UTC
Received26 Nov 2018, 5:00:36 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID54382
Run time23 hours 28 min 28 sec
CPU time23 hours 27 min 13 sec
Validate stateValid
Credit17,456.27
Device peak FLOPS4.25 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size512.95 MB
Peak swap size515.58 MB
Peak disk usage4.91 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
te_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7774620056
validation[          , genome  6264] predictions:    5204/  10000 (52.04%), best:    5527/10000 (55.27%), error:     15014.80273, best error:     14237.86133 on epoch:    13, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 795.2343750000s, input_fired_time: 6.7746052742, output_fired_time: 5.1180500984, propagate_forward_time: 303.8782043457, propagate_backward_time: 469.4726257324, weight_update_time: 0.8660248518, other_time: 9.9909057617
epoch time: 65.2402801514s, input_fired_time: 0.7876124978, output_fired_time: 0.0000000000, propagate_forward_time: 62.6872520447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7654151917
validation[          , genome  6264] predictions:    5340/  10000 (53.40%), best:    5527/10000 (55.27%), error:     14794.67969, best error:     14237.86133 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 813.7990722656s, input_fired_time: 6.8381581306, output_fired_time: 5.1525740623, propagate_forward_time: 312.5033264160, propagate_backward_time: 479.2943115234, weight_update_time: 0.8792897463, other_time: 10.0107116699
epoch time: 70.7152709961s, input_fired_time: 0.8025681973, output_fired_time: 0.0000000000, propagate_forward_time: 68.0120391846, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9006652832
validation[          , genome  6264] predictions:    5386/  10000 (53.86%), best:    5386/10000 (53.86%), error:     13948.65332, best error:     13948.65332 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 746.3639526367s, input_fired_time: 6.4996576309, output_fired_time: 4.7996058464, propagate_forward_time: 283.9176025391, propagate_backward_time: 441.5959167480, weight_update_time: 0.8362838030, other_time: 9.5511779785
epoch time: 64.9418411255s, input_fired_time: 0.7404895425, output_fired_time: 0.0000000000, propagate_forward_time: 62.4144058228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7869491577
validation[          , genome  6264] predictions:    5207/  10000 (52.07%), best:    5386/10000 (53.86%), error:     15069.05957, best error:     13948.65332 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 745.6833496094s, input_fired_time: 6.5159897804, output_fired_time: 4.7523179054, propagate_forward_time: 285.6248168945, propagate_backward_time: 439.3019104004, weight_update_time: 0.8292087913, other_time: 9.4883117676
epoch time: 48.6084976196s, input_fired_time: 0.6809195876, output_fired_time: 0.0000000000, propagate_forward_time: 46.4130554199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5145225525
validation[          , genome  6264] predictions:    5511/  10000 (55.11%), best:    5511/10000 (55.11%), error:     13816.68066, best error:     13816.68066 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 783.5659179688s, input_fired_time: 6.6894569397, output_fired_time: 4.9894127846, propagate_forward_time: 299.0650024414, propagate_backward_time: 463.0221252441, weight_update_time: 0.8588315845, other_time: 9.7998962402
epoch time: 66.8200836182s, input_fired_time: 0.7947453260, output_fired_time: 0.0000000000, propagate_forward_time: 64.2716903687, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7536468506
validation[          , genome  6264] predictions:    5333/  10000 (53.33%), best:    5511/10000 (55.11%), error:     14628.08203, best error:     13816.68066 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 786.7919921875s, input_fired_time: 6.7310466766, output_fired_time: 4.9522166252, propagate_forward_time: 302.8705139160, propagate_backward_time: 462.5196838379, weight_update_time: 0.8547992706, other_time: 9.7185668945
epoch time: 69.2108612061s, input_fired_time: 0.7910113335, output_fired_time: 0.0000000000, propagate_forward_time: 66.6433258057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7765274048
validation[          , genome  6264] predictions:    5440/  10000 (54.40%), best:    5511/10000 (55.11%), error:     14179.23730, best error:     13816.68066 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 703.3064575195s, input_fired_time: 6.3218688965, output_fired_time: 4.5427231789, propagate_forward_time: 267.5968933105, propagate_backward_time: 415.6637878418, weight_update_time: 0.7996891141, other_time: 9.1812133789
epoch time: 46.9322280884s, input_fired_time: 0.6757755280, output_fired_time: 0.0000000000, propagate_forward_time: 44.7687377930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4877166748
validation[          , genome  6264] predictions:    5343/  10000 (53.43%), best:    5511/10000 (55.11%), error:     14557.48633, best error:     13816.68066 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 721.4520263672s, input_fired_time: 6.4253344536, output_fired_time: 4.6370105743, propagate_forward_time: 274.7585754395, propagate_backward_time: 426.3203430176, weight_update_time: 0.8123538494, other_time: 9.3107299805
epoch time: 75.3956909180s, input_fired_time: 0.8417078257, output_fired_time: 0.0000000000, propagate_forward_time: 72.6666488647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8873367310
validation[          , genome  6264] predictions:    5393/  10000 (53.93%), best:    5511/10000 (55.11%), error:     14234.03613, best error:     13816.68066 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 748.8134765625s, input_fired_time: 6.5687155724, output_fired_time: 4.7736234665, propagate_forward_time: 286.5143432617, propagate_backward_time: 441.4594421387, weight_update_time: 0.8290076256, other_time: 9.4973449707
epoch time: 47.4538002014s, input_fired_time: 0.6831797957, output_fired_time: 0.0000000000, propagate_forward_time: 45.2687072754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5019149780
validation[          , genome  6264] predictions:    5485/  10000 (54.85%), best:    5511/10000 (55.11%), error:     13818.51758, best error:     13816.68066 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 814.3236083984s, input_fired_time: 6.8963699341, output_fired_time: 5.0932922363, propagate_forward_time: 312.9515380859, propagate_backward_time: 479.4627380371, weight_update_time: 0.8771520853, other_time: 9.9197082520
epoch time: 71.0908966064s, input_fired_time: 0.8167867064, output_fired_time: 0.0000000000, propagate_forward_time: 68.3930511475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8810577393
validation[          , genome  6264] predictions:    5609/  10000 (56.09%), best:    5609/10000 (56.09%), error:     13371.65137, best error:     13371.65137 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 763.2898559570s, input_fired_time: 6.6499304771, output_fired_time: 4.8754472733, propagate_forward_time: 290.5288696289, propagate_backward_time: 451.6082763672, weight_update_time: 0.8437514305, other_time: 9.6273803711
epoch time: 64.2955932617s, input_fired_time: 0.8010916114, output_fired_time: 0.0000000000, propagate_forward_time: 61.7698860168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7246170044
validation[          , genome  6264] predictions:    5663/  10000 (56.63%), best:    5609/10000 (56.09%), error:     13761.83203, best error:     13371.65137 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 753.0071411133s, input_fired_time: 6.6161527634, output_fired_time: 4.8026633263, propagate_forward_time: 287.6079711914, propagate_backward_time: 444.4513244629, weight_update_time: 0.8328620195, other_time: 9.5290222168
epoch time: 59.4898109436s, input_fired_time: 0.7353166342, output_fired_time: 0.0000000000, propagate_forward_time: 57.0649986267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6894950867
validation[          , genome  6264] predictions:    5587/  10000 (55.87%), best:    5609/10000 (56.09%), error:     13475.26953, best error:     13371.65137 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 837.0960083008s, input_fired_time: 7.0565519333, output_fired_time: 5.2606306076, propagate_forward_time: 322.6204833984, propagate_backward_time: 492.0598449707, weight_update_time: 0.8907781839, other_time: 10.0984802246
epoch time: 60.9022560120s, input_fired_time: 0.7481164932, output_fired_time: 0.0000000000, propagate_forward_time: 58.4411582947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7129821777
validation[          , genome  6264] predictions:    5521/  10000 (55.21%), best:    5609/10000 (56.09%), error:     13925.90234, best error:     13371.65137 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 735.7949829102s, input_fired_time: 6.5485205650, output_fired_time: 4.7050290108, propagate_forward_time: 281.2094421387, propagate_backward_time: 433.9382934570, weight_update_time: 0.8214014173, other_time: 9.3937072754
epoch time: 57.6399078369s, input_fired_time: 0.7447316051, output_fired_time: 0.0000000000, propagate_forward_time: 55.2336463928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6615295410
validation[          , genome  6264] predictions:    5468/  10000 (54.68%), best:    5609/10000 (56.09%), error:     14187.99316, best error:     13371.65137 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 837.4863891602s, input_fired_time: 7.0659646988, output_fired_time: 5.3055009842, propagate_forward_time: 319.9066162109, propagate_backward_time: 495.0052490234, weight_update_time: 0.8941504359, other_time: 10.2030639648
epoch time: 50.4281082153s, input_fired_time: 0.7022827864, output_fired_time: 0.0000000000, propagate_forward_time: 48.1817207336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5441055298
validation[          , genome  6264] predictions:    5663/  10000 (56.63%), best:    5663/10000 (56.63%), error:     13180.60840, best error:     13180.60840 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 779.1766357422s, input_fired_time: 6.7788276672, output_fired_time: 4.9636678696, propagate_forward_time: 297.9733276367, propagate_backward_time: 459.7270202637, weight_update_time: 0.8521649837, other_time: 9.7337951660
epoch time: 53.0771636963s, input_fired_time: 0.7237136960, output_fired_time: 0.0000000000, propagate_forward_time: 50.7686614990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5847892761
validation[          , genome  6264] predictions:    5468/  10000 (54.68%), best:    5663/10000 (56.63%), error:     14114.25977, best error:     13180.60840 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 850.9363403320s, input_fired_time: 7.1679148674, output_fired_time: 5.3546247482, propagate_forward_time: 326.5313110352, propagate_backward_time: 501.6751098633, weight_update_time: 0.9026455879, other_time: 10.2073974609
epoch time: 60.3125953674s, input_fired_time: 0.7352531552, output_fired_time: 0.0000000000, propagate_forward_time: 57.8561439514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7211990356
validation[          , genome  6264] predictions:    5494/  10000 (54.94%), best:    5663/10000 (56.63%), error:     13658.90527, best error:     13180.60840 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 750.0072631836s, input_fired_time: 6.6275734901, output_fired_time: 4.7833714485, propagate_forward_time: 287.3787536621, propagate_backward_time: 441.7262573242, weight_update_time: 0.8325980306, other_time: 9.4913024902
epoch time: 55.3476104736s, input_fired_time: 0.7460495234, output_fired_time: 0.0000000000, propagate_forward_time: 53.0059661865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5955963135
validation[          , genome  6264] predictions:    5735/  10000 (57.35%), best:    5735/10000 (57.35%), error:     12781.36328, best error:     12781.36328 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 828.6976318359s, input_fired_time: 7.0634999275, output_fired_time: 5.2246623039, propagate_forward_time: 318.1570739746, propagate_backward_time: 488.2065734863, weight_update_time: 0.8861755729, other_time: 10.0458374023
epoch time: 47.0373764038s, input_fired_time: 0.6877905130, output_fired_time: 0.0000000000, propagate_forward_time: 44.8566703796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4929161072
validation[          , genome  6264] predictions:    5698/  10000 (56.98%), best:    5735/10000 (57.35%), error:     13344.30273, best error:     12781.36328 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 824.2454833984s, input_fired_time: 7.0393018723, output_fired_time: 5.1688828468, propagate_forward_time: 316.6572875977, propagate_backward_time: 485.3747558594, weight_update_time: 0.8825192451, other_time: 10.0052490234
epoch time: 60.7357215881s, input_fired_time: 0.7525081038, output_fired_time: 0.0000000000, propagate_forward_time: 58.2557640076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7274513245
validation[          , genome  6264] predictions:    5614/  10000 (56.14%), best:    5735/10000 (57.35%), error:     13306.28027, best error:     12781.36328 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 776.0245361328s, input_fired_time: 6.8052449226, output_fired_time: 4.9325151443, propagate_forward_time: 297.3324890137, propagate_backward_time: 457.2880859375, weight_update_time: 0.8499950767, other_time: 9.6662292480
epoch time: 55.3551902771s, input_fired_time: 0.7272570133, output_fired_time: 0.0000000000, propagate_forward_time: 53.0306091309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5973243713
validation[          , genome  6264] predictions:    5324/  10000 (53.24%), best:    5735/10000 (57.35%), error:     14424.03320, best error:     12781.36328 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 785.5770263672s, input_fired_time: 6.8320827484, output_fired_time: 5.0002627373, propagate_forward_time: 299.9787597656, propagate_backward_time: 463.9924926758, weight_update_time: 0.8590154648, other_time: 9.7734375000
epoch time: 57.9853973389s, input_fired_time: 0.7571644783, output_fired_time: 0.0000000000, propagate_forward_time: 55.5567588806, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6714744568
validation[          , genome  6264] predictions:    5668/  10000 (56.68%), best:    5735/10000 (57.35%), error:     13163.68945, best error:     12781.36328 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 879.9812011719s, input_fired_time: 7.3259282112, output_fired_time: 5.5445427895, propagate_forward_time: 335.7088317871, propagate_backward_time: 520.9263305664, weight_update_time: 0.9252696037, other_time: 10.4755249023
epoch time: 72.3285903931s, input_fired_time: 0.8282805681, output_fired_time: 0.0000000000, propagate_forward_time: 69.6068572998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8934555054
validation[          , genome  6264] predictions:    5701/  10000 (57.01%), best:    5735/10000 (57.35%), error:     13241.39941, best error:     12781.36328 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 704.9545288086s, input_fired_time: 6.4777774811, output_fired_time: 4.5609788895, propagate_forward_time: 268.0476989746, propagate_backward_time: 416.6630859375, weight_update_time: 0.8028053045, other_time: 9.2049865723
epoch time: 46.7343635559s, input_fired_time: 0.6975350976, output_fired_time: 0.0000000000, propagate_forward_time: 44.5512886047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4855384827
validation[          , genome  6264] predictions:    5716/  10000 (57.16%), best:    5735/10000 (57.35%), error:     13061.55566, best error:     12781.36328 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 864.6760864258s, input_fired_time: 7.2454357147, output_fired_time: 5.4384102821, propagate_forward_time: 329.9678649902, propagate_backward_time: 511.6619567871, weight_update_time: 0.9140554070, other_time: 10.3624572754
epoch time: 50.3684883118s, input_fired_time: 0.7147365212, output_fired_time: 0.0000000000, propagate_forward_time: 48.1131973267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5405540466
validation[          , genome  6264] predictions:    5716/  10000 (57.16%), best:    5735/10000 (57.35%), error:     12868.42285, best error:     12781.36328 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 756.7692871094s, input_fired_time: 6.7202024460, output_fired_time: 4.8223557472, propagate_forward_time: 287.6805419922, propagate_backward_time: 447.9487609863, weight_update_time: 0.8391075730, other_time: 9.5974426270
epoch time: 55.9186439514s, input_fired_time: 0.7493548989, output_fired_time: 0.0000000000, propagate_forward_time: 53.5477485657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6215400696
validation[          , genome  6264] predictions:    5872/  10000 (58.72%), best:    5872/10000 (58.72%), error:     12438.04785, best error:     12438.04785 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 778.2500610352s, input_fired_time: 6.8372325897, output_fired_time: 4.9436697960, propagate_forward_time: 296.0515441895, propagate_backward_time: 460.6950988770, weight_update_time: 0.8531730771, other_time: 9.7225341797
epoch time: 46.9187812805s, input_fired_time: 0.7067264915, output_fired_time: 0.0000000000, propagate_forward_time: 44.7180557251, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4939994812
validation[          , genome  6264] predictions:    5821/  10000 (58.21%), best:    5872/10000 (58.72%), error:     12733.45703, best error:     12438.04785 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 710.0170898438s, input_fired_time: 6.5276145935, output_fired_time: 4.5738019943, propagate_forward_time: 269.6180419922, propagate_backward_time: 420.0754089355, weight_update_time: 0.8061649203, other_time: 9.2222595215
epoch time: 71.7534027100s, input_fired_time: 0.8165720701, output_fired_time: 0.0000000000, propagate_forward_time: 69.0517501831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8850784302
validation[          , genome  6264] predictions:    5650/  10000 (56.50%), best:    5872/10000 (58.72%), error:     13183.39453, best error:     12438.04785 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 802.9659423828s, input_fired_time: 6.9773936272, output_fired_time: 5.0901398659, propagate_forward_time: 305.9208984375, propagate_backward_time: 475.0841064453, weight_update_time: 0.8698027134, other_time: 9.8933715820
epoch time: 71.8248062134s, input_fired_time: 0.8417373300, output_fired_time: 0.0000000000, propagate_forward_time: 69.0983276367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8847427368
validation[          , genome  6264] predictions:    5875/  10000 (58.75%), best:    5875/10000 (58.75%), error:     12375.05469, best error:     12375.05469 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 777.6403808594s, input_fired_time: 6.8848147392, output_fired_time: 4.9408540726, propagate_forward_time: 295.9441833496, propagate_backward_time: 460.1525573730, weight_update_time: 0.8535028696, other_time: 9.7179565430
epoch time: 72.0644149780s, input_fired_time: 0.8482605815, output_fired_time: 0.0000000000, propagate_forward_time: 69.3295135498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8866424561
validation[          , genome  6264] predictions:    5746/  10000 (57.46%), best:    5875/10000 (58.75%), error:     13122.23340, best error:     12375.05469 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 784.5380249023s, input_fired_time: 6.8823866844, output_fired_time: 4.9946360588, propagate_forward_time: 298.6176147461, propagate_backward_time: 464.2572631836, weight_update_time: 0.8562802672, other_time: 9.7861328125
epoch time: 71.7515106201s, input_fired_time: 0.8449290395, output_fired_time: 0.0000000000, propagate_forward_time: 69.0220260620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8845520020
validation[          , genome  6264] predictions:    5932/  10000 (59.32%), best:    5875/10000 (58.75%), error:     12430.15625, best error:     12375.05469 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 819.3381347656s, input_fired_time: 7.0762739182, output_fired_time: 5.1641516685, propagate_forward_time: 312.0805358887, propagate_backward_time: 485.0072021484, weight_update_time: 0.8830008507, other_time: 10.0099792480
epoch time: 64.8929290771s, input_fired_time: 0.7986071706, output_fired_time: 0.0000000000, propagate_forward_time: 62.3236351013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7706871033
validation[          , genome  6264] predictions:    5862/  10000 (58.62%), best:    5875/10000 (58.75%), error:     12643.75391, best error:     12375.05469 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 704.0255126953s, input_fired_time: 6.5304703712, output_fired_time: 4.5426125526, propagate_forward_time: 267.2978820801, propagate_backward_time: 416.4565124512, weight_update_time: 0.8010014296, other_time: 9.1980590820
epoch time: 50.0387840271s, input_fired_time: 0.7232165933, output_fired_time: 0.0000000000, propagate_forward_time: 47.7830009460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5325660706
validation[          , genome  6264] predictions:    5888/  10000 (58.88%), best:    5875/10000 (58.75%), error:     12403.05859, best error:     12375.05469 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 746.4273681641s, input_fired_time: 6.7499470711, output_fired_time: 4.7791600227, propagate_forward_time: 283.6810302734, propagate_backward_time: 441.7096862793, weight_update_time: 0.8287581205, other_time: 9.5075378418
epoch time: 53.4509582520s, input_fired_time: 0.7424765825, output_fired_time: 0.0000000000, propagate_forward_time: 51.1109886169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5974922180
validation[          , genome  6264] predictions:    5873/  10000 (58.73%), best:    5875/10000 (58.75%), error:     12703.83984, best error:     12375.05469 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 821.6171264648s, input_fired_time: 7.1110072136, output_fired_time: 5.1847171783, propagate_forward_time: 312.8343505859, propagate_backward_time: 486.4618225098, weight_update_time: 0.8823846579, other_time: 10.0252380371
epoch time: 71.1227798462s, input_fired_time: 0.8446235657, output_fired_time: 0.0000000000, propagate_forward_time: 68.4106216431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8675308228
validation[          , genome  6264] predictions:    5886/  10000 (58.86%), best:    5875/10000 (58.75%), error:     12459.22266, best error:     12375.05469 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 802.0776367188s, input_fired_time: 7.0242652893, output_fired_time: 5.0762176514, propagate_forward_time: 305.4024353027, propagate_backward_time: 474.6766052246, weight_update_time: 0.8721639514, other_time: 9.8980712891
epoch time: 66.5453338623s, input_fired_time: 0.8004290462, output_fired_time: 0.0000000000, propagate_forward_time: 63.9473495483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7975540161
validation[          , genome  6264] predictions:    5850/  10000 (58.50%), best:    5875/10000 (58.75%), error:     12689.88184, best error:     12375.05469 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 748.9209594727s, input_fired_time: 6.7791519165, output_fired_time: 4.7874865532, propagate_forward_time: 284.8491210938, propagate_backward_time: 442.9947814941, weight_update_time: 0.8329138756, other_time: 9.5104064941
epoch time: 65.3143768311s, input_fired_time: 0.8156288266, output_fired_time: 0.0000000000, propagate_forward_time: 62.7217521667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7769966125
validation[          , genome  6264] predictions:    5969/  10000 (59.69%), best:    5969/10000 (59.69%), error:     12263.17871, best error:     12263.17871 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 734.6175537109s, input_fired_time: 6.6785087585, output_fired_time: 4.6932992935, propagate_forward_time: 278.9996948242, propagate_backward_time: 434.8482360840, weight_update_time: 0.8232635260, other_time: 9.3977966309
epoch time: 53.2559165955s, input_fired_time: 0.7432785630, output_fired_time: 0.0000000000, propagate_forward_time: 50.9206962585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5919418335
validation[          , genome  6264] predictions:    5895/  10000 (58.95%), best:    5895/10000 (58.95%), error:     12170.56641, best error:     12170.56641 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 754.5184326172s, input_fired_time: 6.8122434616, output_fired_time: 4.7853941917, propagate_forward_time: 286.8797607422, propagate_backward_time: 446.5103759766, weight_update_time: 0.8348544836, other_time: 9.5306396484
epoch time: 68.9842224121s, input_fired_time: 0.8352717161, output_fired_time: 0.0000000000, propagate_forward_time: 66.3057174683, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8432312012
validation[          , genome  6264] predictions:    5921/  10000 (59.21%), best:    5895/10000 (58.95%), error:     12494.34277, best error:     12170.56641 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 809.3217773438s, input_fired_time: 7.0906386375, output_fired_time: 5.1081509590, propagate_forward_time: 308.2124328613, propagate_backward_time: 478.9643859863, weight_update_time: 0.8774887323, other_time: 9.9461669922
epoch time: 58.8348655701s, input_fired_time: 0.7778558731, output_fired_time: 0.0000000000, propagate_forward_time: 56.3787345886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6782760620
validation[          , genome  6264] predictions:    6017/  10000 (60.17%), best:    5895/10000 (58.95%), error:     12198.02441, best error:     12170.56641 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 125639.9531250000s, input_fired_time: 6.7630887032, output_fired_time: 4.7125010490, propagate_forward_time: 1032.1320800781, propagate_backward_time: 124587.3984375000, weight_update_time: 0.8249368072, other_time: 8.9453125000
epoch time: 47.4301605225s, input_fired_time: 0.7279608250, output_fired_time: 0.0000000000, propagate_forward_time: 45.1965827942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5056152344
validation[          , genome  6264] predictions:    5950/  10000 (59.50%), best:    5895/10000 (58.95%), error:     12466.29102, best error:     12170.56641 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 603.2717895508s, input_fired_time: 6.1491036415, output_fired_time: 3.9883658886, propagate_forward_time: 228.5820465088, propagate_backward_time: 356.0352783203, weight_update_time: 0.7372639179, other_time: 8.5170288086
epoch time: 46.5723304749s, input_fired_time: 0.7177371979, output_fired_time: 0.0000000000, propagate_forward_time: 44.3819465637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4726448059
validation[          , genome  6264] predictions:    6033/  10000 (60.33%), best:    6033/10000 (60.33%), error:     11859.48730, best error:     11859.48730 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 595.5462646484s, input_fired_time: 6.0834999084, output_fired_time: 3.9217312336, propagate_forward_time: 225.0985107422, propagate_backward_time: 352.0426025391, weight_update_time: 0.7287606597, other_time: 8.3999023438
epoch time: 46.4143295288s, input_fired_time: 0.7146115303, output_fired_time: 0.0000000000, propagate_forward_time: 44.2277832031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4719352722
validation[          , genome  6264] predictions:    6121/  10000 (61.21%), best:    6121/10000 (61.21%), error:     11749.45117, best error:     11749.45117 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 584.7041625977s, input_fired_time: 5.9973511696, output_fired_time: 3.8269019127, propagate_forward_time: 220.8954010010, propagate_backward_time: 345.6970520020, weight_update_time: 0.7220687270, other_time: 8.2874450684
epoch time: 45.2566337585s, input_fired_time: 0.6997066736, output_fired_time: 0.0000000000, propagate_forward_time: 43.1319999695, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4249267578
validation[          , genome  6264] predictions:    6018/  10000 (60.18%), best:    6121/10000 (61.21%), error:     12003.71777, best error:     11749.45117 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 574.0528564453s, input_fired_time: 5.9000973701, output_fired_time: 3.7444396019, propagate_forward_time: 216.9065246582, propagate_backward_time: 339.4075622559, weight_update_time: 0.7108806968, other_time: 8.0942382812
epoch time: 46.2372894287s, input_fired_time: 0.6890137196, output_fired_time: 0.0000000000, propagate_forward_time: 44.0913810730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4568939209
validation[          , genome  6264] predictions:    5837/  10000 (58.37%), best:    6121/10000 (61.21%), error:     12646.85449, best error:     11749.45117 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 742.3150634766s, input_fired_time: 6.7994918823, output_fired_time: 4.7329902649, propagate_forward_time: 282.5213012695, propagate_backward_time: 438.8136291504, weight_update_time: 0.8283256292, other_time: 9.4476623535
epoch time: 65.2104110718s, input_fired_time: 0.8249415755, output_fired_time: 0.0000000000, propagate_forward_time: 62.5903472900, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7951202393
validation[          , genome  6264] predictions:    5998/  10000 (59.98%), best:    6121/10000 (61.21%), error:     12189.29102, best error:     11749.45117 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 828.5656127930s, input_fired_time: 7.3304286003, output_fired_time: 5.2634525299, propagate_forward_time: 316.7596435547, propagate_backward_time: 488.9654235840, weight_update_time: 0.8978914022, other_time: 10.2466735840
epoch time: 71.5894088745s, input_fired_time: 0.8571617603, output_fired_time: 0.0000000000, propagate_forward_time: 68.8667678833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8654785156
validation[          , genome  6264] predictions:    5926/  10000 (59.26%), best:    6121/10000 (61.21%), error:     12423.20996, best error:     11749.45117 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 718.6217651367s, input_fired_time: 6.7182788849, output_fired_time: 4.6525893211, propagate_forward_time: 272.8641662598, propagate_backward_time: 425.1227416992, weight_update_time: 0.8096010685, other_time: 9.2640075684
epoch time: 71.5754089355s, input_fired_time: 0.8585745692, output_fired_time: 0.0000000000, propagate_forward_time: 68.8511505127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8656845093
validation[          , genome  6264] predictions:    5924/  10000 (59.24%), best:    6121/10000 (61.21%), error:     12416.06543, best error:     11749.45117 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 795.6753540039s, input_fired_time: 7.0999698639, output_fired_time: 5.0751104355, propagate_forward_time: 303.6914062500, propagate_backward_time: 469.9371337891, weight_update_time: 0.8675079346, other_time: 9.8717041016
epoch time: 71.6972732544s, input_fired_time: 0.8649002314, output_fired_time: 0.0000000000, propagate_forward_time: 68.9576644897, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8747100830
validation[          , genome  6264] predictions:    6028/  10000 (60.28%), best:    6121/10000 (61.21%), error:     12034.22070, best error:     11749.45117 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 768.1057128906s, input_fired_time: 6.9727849960, output_fired_time: 4.9430623055, propagate_forward_time: 292.5395202637, propagate_backward_time: 454.0006408691, weight_update_time: 0.8499102592, other_time: 9.6497192383
epoch time: 55.6197662354s, input_fired_time: 0.7764122486, output_fired_time: 0.0000000000, propagate_forward_time: 53.2228088379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6205444336
validation[          , genome  6264] predictions:    5981/  10000 (59.81%), best:    6121/10000 (61.21%), error:     12327.06738, best error:     11749.45117 on epoch:    57, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 745.8342895508s, input_fired_time: 6.8689908981, output_fired_time: 4.8060598373, propagate_forward_time: 284.1907043457, propagate_backward_time: 440.4827575684, weight_update_time: 0.8318392038, other_time: 9.4857788086
epoch time: 58.0921058655s, input_fired_time: 0.7868642807, output_fired_time: 0.0000000000, propagate_forward_time: 55.6552238464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6500167847
validation[          , genome  6264] predictions:    6111/  10000 (61.11%), best:    6121/10000 (61.21%), error:     11843.57910, best error:     11749.45117 on epoch:    57, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 701.2596435547s, input_fired_time: 6.6424636841, output_fired_time: 4.5411744118, propagate_forward_time: 266.4018554688, propagate_backward_time: 414.5611267090, weight_update_time: 0.7971582413, other_time: 9.1130065918
epoch time: 48.9686393738s, input_fired_time: 0.7386564016, output_fired_time: 0.0000000000, propagate_forward_time: 46.7303428650, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4996414185
validation[          , genome  6264] predictions:    6117/  10000 (61.17%), best:    6121/10000 (61.21%), error:     11767.12109, best error:     11749.45117 on epoch:    57, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 789.5498657227s, input_fired_time: 7.0848512650, output_fired_time: 5.0333142281, propagate_forward_time: 300.7933959961, propagate_backward_time: 466.8493957520, weight_update_time: 0.8583753109, other_time: 9.7889099121
epoch time: 71.9255523682s, input_fired_time: 0.8748852015, output_fired_time: 0.0000000000, propagate_forward_time: 69.1691131592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8815536499
validation[          , genome  6264] predictions:    6045/  10000 (60.45%), best:    6121/10000 (61.21%), error:     12036.76855, best error:     11749.45117 on epoch:    57, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 759.6049804688s, input_fired_time: 6.9398880005, output_fired_time: 4.8743753433, propagate_forward_time: 289.1453857422, propagate_backward_time: 449.0708312988, weight_update_time: 0.8408473730, other_time: 9.5744934082
epoch time: 47.8732185364s, input_fired_time: 0.7342330813, output_fired_time: 0.0000000000, propagate_forward_time: 45.6555404663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4834442139
validation[          , genome  6264] predictions:    6085/  10000 (60.85%), best:    6121/10000 (61.21%), error:     11951.65918, best error:     11749.45117 on epoch:    57, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 707.2454833984s, input_fired_time: 6.6696224213, output_fired_time: 4.5720419884, propagate_forward_time: 268.4923095703, propagate_backward_time: 418.3318176270, weight_update_time: 0.8026538491, other_time: 9.1797180176
epoch time: 70.6528778076s, input_fired_time: 0.8534368873, output_fired_time: 0.0000000000, propagate_forward_time: 67.9438552856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8555831909
validation[          , genome  6264] predictions:    6076/  10000 (60.76%), best:    6121/10000 (61.21%), error:     11887.34570, best error:     11749.45117 on epoch:    57, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 867.6044311523s, input_fired_time: 7.4724354744, output_fired_time: 5.4709067345, propagate_forward_time: 330.9198303223, propagate_backward_time: 513.4077148438, weight_update_time: 0.9150614142, other_time: 10.3336181641
epoch time: 70.4198989868s, input_fired_time: 0.8725173473, output_fired_time: 0.0000000000, propagate_forward_time: 67.6911163330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8562622070
validation[          , genome  6264] predictions:    5995/  10000 (59.95%), best:    6121/10000 (61.21%), error:     12014.70020, best error:     11749.45117 on epoch:    57, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 750.0844116211s, input_fired_time: 6.9012732506, output_fired_time: 4.8286147118, propagate_forward_time: 285.3404846191, propagate_backward_time: 443.5144348145, weight_update_time: 0.8327882886, other_time: 9.4996337891
epoch time: 71.3256530762s, input_fired_time: 0.8653134108, output_fired_time: 0.0000000000, propagate_forward_time: 68.5855102539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8748321533
validation[          , genome  6264] predictions:    6078/  10000 (60.78%), best:    6121/10000 (61.21%), error:     11850.73047, best error:     11749.45117 on epoch:    57, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 799.7775268555s, input_fired_time: 7.1546773911, output_fired_time: 5.1163482666, propagate_forward_time: 304.0711975098, propagate_backward_time: 473.5735473633, weight_update_time: 0.8665490150, other_time: 9.8617858887
epoch time: 70.4024658203s, input_fired_time: 0.8706722856, output_fired_time: 0.0000000000, propagate_forward_time: 67.6816329956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8501586914
validation[          , genome  6264] predictions:    6092/  10000 (60.92%), best:    6121/10000 (61.21%), error:     11911.35840, best error:     11749.45117 on epoch:    57, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 778.8598022461s, input_fired_time: 7.0264520645, output_fired_time: 4.9570274353, propagate_forward_time: 296.5154418945, propagate_backward_time: 460.6571960449, weight_update_time: 0.8541711569, other_time: 9.7037048340
epoch time: 70.8397674561s, input_fired_time: 0.8712326884, output_fired_time: 0.0000000000, propagate_forward_time: 68.1103668213, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8581695557
validation[          , genome  6264] predictions:    6073/  10000 (60.73%), best:    6121/10000 (61.21%), error:     11917.47949, best error:     11749.45117 on epoch:    57, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 701.4224243164s, input_fired_time: 6.6483793259, output_fired_time: 4.5264387131, propagate_forward_time: 265.9066772461, propagate_backward_time: 415.2307128906, weight_update_time: 0.7970794439, other_time: 9.1102294922
epoch time: 67.0735626221s, input_fired_time: 0.8540563583, output_fired_time: 0.0000000000, propagate_forward_time: 64.4164276123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8030776978
validation[          , genome  6264] predictions:    6099/  10000 (60.99%), best:    6121/10000 (61.21%), error:     11817.37109, best error:     11749.45117 on epoch:    57, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 767.9447631836s, input_fired_time: 6.9725522995, output_fired_time: 4.8916049004, propagate_forward_time: 292.0648193359, propagate_backward_time: 454.3863830566, weight_update_time: 0.8470951915, other_time: 9.6294250488
epoch time: 56.0643348694s, input_fired_time: 0.7956858277, output_fired_time: 0.0000000000, propagate_forward_time: 53.6306495667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6380004883
validation[          , genome  6264] predictions:    6039/  10000 (60.39%), best:    6121/10000 (61.21%), error:     12026.90918, best error:     11749.45117 on epoch:    57, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 801.0643920898s, input_fired_time: 7.1708774567, output_fired_time: 5.0693917274, propagate_forward_time: 304.6127624512, propagate_backward_time: 474.3390197754, weight_update_time: 0.8689991832, other_time: 9.8723144531
epoch time: 71.5173873901s, input_fired_time: 0.8744114637, output_fired_time: 0.0000000000, propagate_forward_time: 68.7695541382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8734207153
validation[          , genome  6264] predictions:    6141/  10000 (61.41%), best:    6121/10000 (61.21%), error:     11788.49219, best error:     11749.45117 on epoch:    57, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 776.3551635742s, input_fired_time: 7.0378112793, output_fired_time: 4.9392561913, propagate_forward_time: 295.5776977539, propagate_backward_time: 459.1335754395, weight_update_time: 0.8492031097, other_time: 9.6668395996
epoch time: 55.1210861206s, input_fired_time: 0.7815363407, output_fired_time: 0.0000000000, propagate_forward_time: 52.7033233643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6362266541
validation[          , genome  6264] predictions:    6098/  10000 (60.98%), best:    6121/10000 (61.21%), error:     11906.32617, best error:     11749.45117 on epoch:    57, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 791.5588989258s, input_fired_time: 7.1519131660, output_fired_time: 5.0562925339, propagate_forward_time: 301.4561767578, propagate_backward_time: 467.9487304688, weight_update_time: 0.8673515320, other_time: 9.9458007812
epoch time: 67.3005218506s, input_fired_time: 0.8553937078, output_fired_time: 0.0000000000, propagate_forward_time: 64.6302947998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8148345947
validation[          , genome  6264] predictions:    6072/  10000 (60.72%), best:    6121/10000 (61.21%), error:     11859.04590, best error:     11749.45117 on epoch:    57, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 846.4739379883s, input_fired_time: 7.3914103508, output_fired_time: 5.3905763626, propagate_forward_time: 322.1044311523, propagate_backward_time: 501.3402709961, weight_update_time: 0.9014364481, other_time: 10.2472534180
epoch time: 70.8405609131s, input_fired_time: 0.8822195530, output_fired_time: 0.0000000000, propagate_forward_time: 68.0804672241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8778762817
validation[          , genome  6264] predictions:    6119/  10000 (61.19%), best:    6121/10000 (61.21%), error:     11844.49902, best error:     11749.45117 on epoch:    57, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 897.6920776367s, input_fired_time: 7.6369652748, output_fired_time: 5.6536841393, propagate_forward_time: 342.5445251465, propagate_backward_time: 531.2770385742, weight_update_time: 0.9354202151, other_time: 10.5798950195
epoch time: 69.3033752441s, input_fired_time: 0.8683682084, output_fired_time: 0.0000000000, propagate_forward_time: 66.5737380981, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8612670898
validation[          , genome  6264] predictions:    6105/  10000 (61.05%), best:    6121/10000 (61.21%), error:     11917.20117, best error:     11749.45117 on epoch:    57, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 692.4097900391s, input_fired_time: 6.6192321777, output_fired_time: 4.4832983017, propagate_forward_time: 262.9080200195, propagate_backward_time: 409.3810119629, weight_update_time: 0.7889239192, other_time: 9.0182189941
epoch time: 45.9925613403s, input_fired_time: 0.7224071622, output_fired_time: 0.0000000000, propagate_forward_time: 43.8205299377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4496231079
validation[          , genome  6264] predictions:    6106/  10000 (61.06%), best:    6121/10000 (61.21%), error:     11787.35742, best error:     11749.45117 on epoch:    57, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 715.1449584961s, input_fired_time: 6.7341470718, output_fired_time: 4.6276125908, propagate_forward_time: 271.5426940918, propagate_backward_time: 423.0348815918, weight_update_time: 0.8069082499, other_time: 9.2056274414
epoch time: 71.6854782104s, input_fired_time: 0.8805178404, output_fired_time: 0.0000000000, propagate_forward_time: 68.9377593994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8672027588
validation[          , genome  6264] predictions:    6125/  10000 (61.25%), best:    6121/10000 (61.21%), error:     11817.03906, best error:     11749.45117 on epoch:    57, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 720.7509765625s, input_fired_time: 6.7547502518, output_fired_time: 4.6389932632, propagate_forward_time: 273.8724670410, propagate_backward_time: 426.2733764648, weight_update_time: 0.8103061914, other_time: 9.2113952637
epoch time: 64.1949234009s, input_fired_time: 0.8274839520, output_fired_time: 0.0000000000, propagate_forward_time: 61.6263122559, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7411270142
validation[          , genome  6264] predictions:    6120/  10000 (61.20%), best:    6120/10000 (61.20%), error:     11724.05664, best error:     11724.05664 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 877.6569213867s, input_fired_time: 7.5265717506, output_fired_time: 5.5085849762, propagate_forward_time: 334.6936340332, propagate_backward_time: 519.5852050781, weight_update_time: 0.9213533401, other_time: 10.3428955078
epoch time: 71.5077972412s, input_fired_time: 0.8780546784, output_fired_time: 0.0000000000, propagate_forward_time: 68.7658920288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8638534546
validation[          , genome  6264] predictions:    6141/  10000 (61.41%), best:    6141/10000 (61.41%), error:     11665.90918, best error:     11665.90918 on epoch:    84, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 900.4062500000s, input_fired_time: 7.6461434364, output_fired_time: 5.6667070389, propagate_forward_time: 343.8743286133, propagate_backward_time: 532.6797485352, weight_update_time: 0.9367277026, other_time: 10.5393676758
epoch time: 72.1239395142s, input_fired_time: 0.8831773996, output_fired_time: 0.0000000000, propagate_forward_time: 69.3724899292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8682708740
validation[          , genome  6264] predictions:    6086/  10000 (60.86%), best:    6141/10000 (61.41%), error:     11874.77832, best error:     11665.90918 on epoch:    84, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 870.8843383789s, input_fired_time: 7.5120787621, output_fired_time: 5.4918622971, propagate_forward_time: 332.3143920898, propagate_backward_time: 515.2059936523, weight_update_time: 0.9162048697, other_time: 10.3599853516
epoch time: 45.9639091492s, input_fired_time: 0.7193736434, output_fired_time: 0.0000000000, propagate_forward_time: 43.8047142029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4398231506
validation[          , genome  6264] predictions:    6160/  10000 (61.60%), best:    6141/10000 (61.41%), error:     11805.38672, best error:     11665.90918 on epoch:    84, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 697.9931640625s, input_fired_time: 6.6366176605, output_fired_time: 4.4763827324, propagate_forward_time: 264.9462280273, propagate_backward_time: 412.8847656250, weight_update_time: 0.7918610573, other_time: 9.0491943359
epoch time: 71.2869415283s, input_fired_time: 0.8786285520, output_fired_time: 0.0000000000, propagate_forward_time: 68.5416717529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8666381836
validation[          , genome  6264] predictions:    6146/  10000 (61.46%), best:    6141/10000 (61.41%), error:     11869.37598, best error:     11665.90918 on epoch:    84, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 900.8713378906s, input_fired_time: 7.6573681831, output_fired_time: 5.6647005081, propagate_forward_time: 343.8723144531, propagate_backward_time: 533.1192626953, weight_update_time: 0.9367375374, other_time: 10.5577392578
epoch time: 71.8090744019s, input_fired_time: 0.8782594204, output_fired_time: 0.0000000000, propagate_forward_time: 69.0609283447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8698883057
validation[          , genome  6264] predictions:    6081/  10000 (60.81%), best:    6141/10000 (61.41%), error:     11881.30273, best error:     11665.90918 on epoch:    84, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 732.7895507812s, input_fired_time: 6.8312931061, output_fired_time: 4.7197918892, propagate_forward_time: 278.5984802246, propagate_backward_time: 433.3532104492, weight_update_time: 0.8171209693, other_time: 9.2867736816
epoch time: 71.4690856934s, input_fired_time: 0.8788600564, output_fired_time: 0.0000000000, propagate_forward_time: 68.7290496826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8611755371
validation[          , genome  6264] predictions:    6139/  10000 (61.39%), best:    6141/10000 (61.41%), error:     11800.71484, best error:     11665.90918 on epoch:    84, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 898.7781982422s, input_fired_time: 7.6579084396, output_fired_time: 5.6430463791, propagate_forward_time: 343.2868652344, propagate_backward_time: 531.6774902344, weight_update_time: 0.9363040924, other_time: 10.5128784180
epoch time: 71.8269958496s, input_fired_time: 0.8817197680, output_fired_time: 0.0000000000, propagate_forward_time: 69.0772171021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8680572510
validation[          , genome  6264] predictions:    6120/  10000 (61.20%), best:    6141/10000 (61.41%), error:     11827.09180, best error:     11665.90918 on epoch:    84, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 780.0851440430s, input_fired_time: 7.0633258820, output_fired_time: 4.9649829865, propagate_forward_time: 296.9128723145, propagate_backward_time: 461.5116577148, weight_update_time: 0.8520741463, other_time: 9.6322937012
epoch time: 71.7033386230s, input_fired_time: 0.8816653490, output_fired_time: 0.0000000000, propagate_forward_time: 68.9503784180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8712921143
validation[          , genome  6264] predictions:    6146/  10000 (61.46%), best:    6141/10000 (61.41%), error:     11751.85059, best error:     11665.90918 on epoch:    84, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 839.0005493164s, input_fired_time: 7.3623452187, output_fired_time: 5.3066587448, propagate_forward_time: 319.9013977051, propagate_backward_time: 496.3579101562, weight_update_time: 0.8933210969, other_time: 10.0722351074
epoch time: 46.2243080139s, input_fired_time: 0.7338038087, output_fired_time: 0.0000000000, propagate_forward_time: 44.0343322754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4561729431
validation[          , genome  6264] predictions:    6200/  10000 (62.00%), best:    6141/10000 (61.41%), error:     11668.66992, best error:     11665.90918 on epoch:    84, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 717.2107543945s, input_fired_time: 6.7539806366, output_fired_time: 4.6079139709, propagate_forward_time: 272.2401733398, propagate_backward_time: 424.4834289551, weight_update_time: 0.8066991568, other_time: 9.1252746582
epoch time: 69.3970642090s, input_fired_time: 0.8723660111, output_fired_time: 0.0000000000, propagate_forward_time: 66.6975402832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8271560669
validation[          , genome  6264] predictions:    6157/  10000 (61.57%), best:    6141/10000 (61.41%), error:     11785.86621, best error:     11665.90918 on epoch:    84, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 793.2880249023s, input_fired_time: 7.1427593231, output_fired_time: 5.0451211929, propagate_forward_time: 301.9383850098, propagate_backward_time: 469.4346923828, weight_update_time: 0.8622230887, other_time: 9.7270812988
epoch time: 71.7887268066s, input_fired_time: 0.8793428540, output_fired_time: 0.0000000000, propagate_forward_time: 69.0416564941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8677291870
validation[          , genome  6264] predictions:    6145/  10000 (61.45%), best:    6141/10000 (61.41%), error:     11788.16895, best error:     11665.90918 on epoch:    84, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 776.3201904297s, input_fired_time: 7.0504899025, output_fired_time: 4.9491062164, propagate_forward_time: 295.3627319336, propagate_backward_time: 459.3743286133, weight_update_time: 0.8472099304, other_time: 9.5835571289
epoch time: 54.6496887207s, input_fired_time: 0.7824619412, output_fired_time: 0.0000000000, propagate_forward_time: 52.2778205872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5894050598
validation[          , genome  6264] predictions:    6206/  10000 (62.06%), best:    6141/10000 (61.41%), error:     11724.32617, best error:     11665.90918 on epoch:    84, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 858.4317016602s, input_fired_time: 7.4686231613, output_fired_time: 5.4189219475, propagate_forward_time: 327.3979187012, propagate_backward_time: 507.9151000977, weight_update_time: 0.9082738757, other_time: 10.2311401367
epoch time: 71.9115447998s, input_fired_time: 0.8824564815, output_fired_time: 0.0000000000, propagate_forward_time: 69.1597366333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8693542480
validation[          , genome  6264] predictions:    6158/  10000 (61.58%), best:    6141/10000 (61.41%), error:     11728.88379, best error:     11665.90918 on epoch:    84, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 643.6910400391s, input_fired_time: 6.3964376450, output_fired_time: 4.1959509850, propagate_forward_time: 243.7950134277, propagate_backward_time: 380.6757507324, weight_update_time: 0.7531767488, other_time: 8.6279296875
epoch time: 45.8954849243s, input_fired_time: 0.7279980779, output_fired_time: 0.0000000000, propagate_forward_time: 43.7293052673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4381828308
validation[          , genome  6264] predictions:    6214/  10000 (62.14%), best:    6141/10000 (61.41%), error:     11669.64453, best error:     11665.90918 on epoch:    84, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 643.2954711914s, input_fired_time: 6.3977813721, output_fired_time: 4.1950001717, propagate_forward_time: 243.6136932373, propagate_backward_time: 380.4676208496, weight_update_time: 0.7565375566, other_time: 8.6213684082
epoch time: 45.8416023254s, input_fired_time: 0.7304489613, output_fired_time: 0.0000000000, propagate_forward_time: 43.6710319519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4401206970
validation[          , genome  6264] predictions:    6163/  10000 (61.63%), best:    6163/10000 (61.63%), error:     11650.83008, best error:     11650.83008 on epoch:    98, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 677.6250610352s, input_fired_time: 6.5750041008, output_fired_time: 4.3919606209, propagate_forward_time: 256.9558410645, propagate_backward_time: 400.8305664062, weight_update_time: 0.7793931961, other_time: 8.8716735840
epoch time: 45.9887275696s, input_fired_time: 0.7320061326, output_fired_time: 0.0000000000, propagate_forward_time: 43.8192138672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4375076294
validation[          , genome  6264] predictions:    6194/  10000 (61.94%), best:    6194/10000 (61.94%), error:     11603.88770, best error:     11603.88770 on epoch:    99, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 831.5285644531s, input_fired_time: 7.3415932655, output_fired_time: 5.2595868111, propagate_forward_time: 316.6266174316, propagate_backward_time: 492.2755126953, weight_update_time: 0.8889439702, other_time: 10.0252380371
epoch time: 71.4132537842s, input_fired_time: 0.8802326918, output_fired_time: 0.0000000000, propagate_forward_time: 68.6651458740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8678741455
validation[          , genome  6264] predictions:    6200/  10000 (62.00%), best:    6194/10000 (61.94%), error:     11784.60840, best error:     11603.88770 on epoch:    99, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 288.0574340820s, input_fired_time: 4.0031762123, output_fired_time: 0.0000000000, propagate_forward_time: 275.8408203125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.2134399414
best training[          , genome  6264] predictions:   39965/  50000 (79.93%), best:    6194/10000 (61.94%), error:     30696.51562, best error:     11603.88770 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 45.8973960876s, input_fired_time: 0.7288246751, output_fired_time: 0.0000000000, propagate_forward_time: 43.7259597778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4426116943
   testing[          , genome  6264] predictions:    6194/  10000 (61.94%), best:    6194/10000 (61.94%), error:     11603.88770, best error:     11603.88770 on epoch:    99, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:44:02 (3106): called boinc_finish(0)

</stderr_txt>
]]>