Nameexact_genome_1542692703_186_6408_2
Workunit4100812
Created1 Mar 2019, 17:54:34 UTC
Sent1 Mar 2019, 17:55:52 UTC
Report deadline24 May 2019, 10:37:40 UTC
Received4 Mar 2019, 0:50:51 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID95291
Run time2 days 5 hours 27 min 38 sec
CPU time2 days 2 hours 7 min 30 sec
Validate stateValid
Credit20,923.93
Device peak FLOPS3.18 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size537.60 MB
Peak swap size557.14 MB
Peak disk usage9.99 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
me  6408] predictions:    5995/  10000 (59.95%), best:    6079/10000 (60.79%), error:     11505.59180, best error:     11263.48926 on epoch:    11, epoch:   15/100, mu: 0.8278725147, learning_rate: 0.0011653296, weight_decay: 0.0001953269

epoch time: 1750.8115234375s, input_fired_time: 19.3295726776, output_fired_time: 9.9327259064, propagate_forward_time: 695.8599853516, propagate_backward_time: 1010.0797119141, weight_update_time: 1.0272878408, other_time: 15.6094970703
epoch time: 143.4770965576s, input_fired_time: 1.5597872734, output_fired_time: 0.0000000000, propagate_forward_time: 139.3542175293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5630950928
validation[          , genome  6408] predictions:    5867/  10000 (58.67%), best:    6079/10000 (60.79%), error:     11660.53711, best error:     11263.48926 on epoch:    11, epoch:   16/100, mu: 0.8384576440, learning_rate: 0.0010920140, weight_decay: 0.0001867837

epoch time: 1760.2932128906s, input_fired_time: 19.2411804199, output_fired_time: 9.9414730072, propagate_forward_time: 702.8472290039, propagate_backward_time: 1012.4176025391, weight_update_time: 1.0481318235, other_time: 15.8455810547
epoch time: 145.9150085449s, input_fired_time: 1.5302717686, output_fired_time: 0.0000000000, propagate_forward_time: 141.8765563965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5081787109
validation[          , genome  6408] predictions:    5778/  10000 (57.78%), best:    6079/10000 (60.79%), error:     12287.44629, best error:     11263.48926 on epoch:    11, epoch:   17/100, mu: 0.8483517170, learning_rate: 0.0010233111, weight_decay: 0.0001786141

epoch time: 1960.3168945313s, input_fired_time: 19.3191204071, output_fired_time: 10.0142631531, propagate_forward_time: 739.5169677734, propagate_backward_time: 1176.1003417969, weight_update_time: 1.0031812191, other_time: 15.3662109375
epoch time: 146.5456390381s, input_fired_time: 1.5123167038, output_fired_time: 0.0000000000, propagate_forward_time: 142.5474700928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4858551025
validation[          , genome  6408] predictions:    6048/  10000 (60.48%), best:    6079/10000 (60.79%), error:     11327.29492, best error:     11263.48926 on epoch:    11, epoch:   18/100, mu: 0.8575997949, learning_rate: 0.0009589305, weight_decay: 0.0001708018

epoch time: 1794.5643310547s, input_fired_time: 19.2270641327, output_fired_time: 10.2744235992, propagate_forward_time: 715.4072265625, propagate_backward_time: 1034.3284912109, weight_update_time: 1.1133219004, other_time: 15.3271484375
epoch time: 147.2108764648s, input_fired_time: 1.6212316751, output_fired_time: 0.0000000000, propagate_forward_time: 143.1360473633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4535980225
validation[          , genome  6408] predictions:    6011/  10000 (60.11%), best:    6079/10000 (60.79%), error:     11504.85156, best error:     11263.48926 on epoch:    11, epoch:   19/100, mu: 0.8662440777, learning_rate: 0.0008986003, weight_decay: 0.0001633313

epoch time: 1782.2115478516s, input_fired_time: 19.0650901794, output_fired_time: 10.0601272583, propagate_forward_time: 711.9801025391, propagate_backward_time: 1025.8443603516, weight_update_time: 1.0064269304, other_time: 15.2618408203
epoch time: 148.3992309570s, input_fired_time: 1.5661408901, output_fired_time: 0.0000000000, propagate_forward_time: 144.3016662598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5314178467
validation[          , genome  6408] predictions:    6155/  10000 (61.55%), best:    6155/10000 (61.55%), error:     11188.93652, best error:     11188.93652 on epoch:    20, epoch:   20/100, mu: 0.8743239641, learning_rate: 0.0008420658, weight_decay: 0.0001561875

epoch time: 1794.0841064453s, input_fired_time: 19.0911769867, output_fired_time: 9.9773683548, propagate_forward_time: 724.5099487305, propagate_backward_time: 1024.8731689453, weight_update_time: 1.0944401026, other_time: 15.6324462891
epoch time: 146.2753448486s, input_fired_time: 1.5325047970, output_fired_time: 0.0000000000, propagate_forward_time: 142.2797851563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4630584717
validation[          , genome  6408] predictions:    6033/  10000 (60.33%), best:    6155/10000 (61.55%), error:     11491.14453, best error:     11188.93652 on epoch:    20, epoch:   21/100, mu: 0.8818763494, learning_rate: 0.0007890880, weight_decay: 0.0001493561

epoch time: 1798.1806640625s, input_fired_time: 19.4622211456, output_fired_time: 10.0218038559, propagate_forward_time: 719.3497924805, propagate_backward_time: 1033.7570800781, weight_update_time: 1.1495438814, other_time: 15.5895996094
epoch time: 143.6405181885s, input_fired_time: 1.6147766113, output_fired_time: 0.0000000000, propagate_forward_time: 139.5648040771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4609375000
validation[          , genome  6408] predictions:    6110/  10000 (61.10%), best:    6155/10000 (61.55%), error:     11246.40527, best error:     11188.93652 on epoch:    20, epoch:   22/100, mu: 0.8889356256, learning_rate: 0.0007394433, weight_decay: 0.0001428235

epoch time: 1754.1032714844s, input_fired_time: 19.0838432312, output_fired_time: 9.9954881668, propagate_forward_time: 693.8991699219, propagate_backward_time: 1015.5638427734, weight_update_time: 1.0942143202, other_time: 15.5609130859
epoch time: 143.0464477539s, input_fired_time: 1.5115544796, output_fired_time: 0.0000000000, propagate_forward_time: 139.0068511963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5280456543
validation[          , genome  6408] predictions:    6002/  10000 (60.02%), best:    6155/10000 (61.55%), error:     11549.37793, best error:     11188.93652 on epoch:    20, epoch:   23/100, mu: 0.8955340385, learning_rate: 0.0006929220, weight_decay: 0.0001365767

epoch time: 1747.8218994141s, input_fired_time: 19.0796070099, output_fired_time: 10.0063009262, propagate_forward_time: 693.7245483398, propagate_backward_time: 1009.3466796875, weight_update_time: 0.9808799028, other_time: 15.6647949219
epoch time: 141.5109405518s, input_fired_time: 1.5516562462, output_fired_time: 0.0000000000, propagate_forward_time: 137.4452056885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5140838623
validation[          , genome  6408] predictions:    6215/  10000 (62.15%), best:    6215/10000 (62.15%), error:     10920.07031, best error:     10920.07031 on epoch:    24, epoch:   24/100, mu: 0.9017016292, learning_rate: 0.0006493275, weight_decay: 0.0001306031

epoch time: 1728.5194091797s, input_fired_time: 18.8464126587, output_fired_time: 9.9705743790, propagate_forward_time: 684.3057250977, propagate_backward_time: 999.8309936523, weight_update_time: 1.0033338070, other_time: 15.5656738281
epoch time: 142.0951843262s, input_fired_time: 1.5810211897, output_fired_time: 0.0000000000, propagate_forward_time: 137.9675598145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5466003418
validation[          , genome  6408] predictions:    6206/  10000 (62.06%), best:    6215/10000 (62.15%), error:     10980.27734, best error:     10920.07031 on epoch:    24, epoch:   25/100, mu: 0.9074665308, learning_rate: 0.0006084756, weight_decay: 0.0001248907

epoch time: 1831.6987304688s, input_fired_time: 19.3333206177, output_fired_time: 10.1550645828, propagate_forward_time: 724.7698974609, propagate_backward_time: 1061.7531738281, weight_update_time: 1.0150610209, other_time: 15.6872558594
epoch time: 140.9906158447s, input_fired_time: 1.5542041063, output_fired_time: 0.0000000000, propagate_forward_time: 137.0181732178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4182434082
validation[          , genome  6408] predictions:    5996/  10000 (59.96%), best:    6215/10000 (62.15%), error:     11487.19629, best error:     10920.07031 on epoch:    24, epoch:   26/100, mu: 0.9128550887, learning_rate: 0.0005701940, weight_decay: 0.0001194282

epoch time: 1743.9730224609s, input_fired_time: 19.1415233612, output_fired_time: 9.7939434052, propagate_forward_time: 689.1856689453, propagate_backward_time: 1010.1383666992, weight_update_time: 0.9846448302, other_time: 15.7135620117
epoch time: 141.0402832031s, input_fired_time: 1.5870465040, output_fired_time: 0.0000000000, propagate_forward_time: 136.8618011475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5914306641
validation[          , genome  6408] predictions:    6109/  10000 (61.09%), best:    6215/10000 (62.15%), error:     11287.13965, best error:     10920.07031 on epoch:    24, epoch:   27/100, mu: 0.9178918004, learning_rate: 0.0005343208, weight_decay: 0.0001142047

epoch time: 1733.5045166016s, input_fired_time: 19.0349082947, output_fired_time: 9.8745775223, propagate_forward_time: 683.4526367188, propagate_backward_time: 1005.6178588867, weight_update_time: 0.9880347252, other_time: 15.5244750977
epoch time: 141.9573364258s, input_fired_time: 1.5447328091, output_fired_time: 0.0000000000, propagate_forward_time: 137.8377532959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5748443604
validation[          , genome  6408] predictions:    6131/  10000 (61.31%), best:    6215/10000 (62.15%), error:     11095.20117, best error:     10920.07031 on epoch:    24, epoch:   28/100, mu: 0.9225996733, learning_rate: 0.0005007045, weight_decay: 0.0001092096

epoch time: 1728.9523925781s, input_fired_time: 19.5860900879, output_fired_time: 9.9331884384, propagate_forward_time: 686.2158203125, propagate_backward_time: 997.5800170898, weight_update_time: 1.0135204792, other_time: 15.6372680664
epoch time: 142.7006378174s, input_fired_time: 1.5341019630, output_fired_time: 0.0000000000, propagate_forward_time: 138.2415313721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9250030518
validation[          , genome  6408] predictions:    6172/  10000 (61.72%), best:    6215/10000 (62.15%), error:     11045.01953, best error:     10920.07031 on epoch:    24, epoch:   29/100, mu: 0.9270001650, learning_rate: 0.0004692032, weight_decay: 0.0001044329

epoch time: 1717.1856689453s, input_fired_time: 18.8963241577, output_fired_time: 9.8298482895, propagate_forward_time: 680.9197387695, propagate_backward_time: 991.8280029297, weight_update_time: 1.0460050106, other_time: 15.7117309570
epoch time: 145.1694335938s, input_fired_time: 1.6154404879, output_fired_time: 0.0000000000, propagate_forward_time: 140.9793090820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5746765137
validation[          , genome  6408] predictions:    6130/  10000 (61.30%), best:    6215/10000 (62.15%), error:     11189.14551, best error:     10920.07031 on epoch:    24, epoch:   30/100, mu: 0.9311133623, learning_rate: 0.0004396837, weight_decay: 0.0000998652

epoch time: 1719.6301269531s, input_fired_time: 18.8102436066, output_fired_time: 9.8267717361, propagate_forward_time: 683.3289184570, propagate_backward_time: 992.4586181641, weight_update_time: 0.9696424603, other_time: 15.2055053711
epoch time: 141.2515563965s, input_fired_time: 1.5575007200, output_fired_time: 0.0000000000, propagate_forward_time: 136.9772796631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7167816162
validation[          , genome  6408] predictions:    6137/  10000 (61.37%), best:    6215/10000 (62.15%), error:     11130.58496, best error:     10920.07031 on epoch:    24, epoch:   31/100, mu: 0.9349580407, learning_rate: 0.0004120215, weight_decay: 0.0000954973

epoch time: 1740.3171386719s, input_fired_time: 19.0594768524, output_fired_time: 9.7443923950, propagate_forward_time: 697.7266235352, propagate_backward_time: 998.3234863281, weight_update_time: 1.0238265991, other_time: 15.4631958008
epoch time: 141.1286468506s, input_fired_time: 1.5431810617, output_fired_time: 0.0000000000, propagate_forward_time: 137.0493011475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5361633301
validation[          , genome  6408] predictions:    6154/  10000 (61.54%), best:    6215/10000 (62.15%), error:     10936.86523, best error:     10920.07031 on epoch:    24, epoch:   32/100, mu: 0.9385516644, learning_rate: 0.0003860995, weight_decay: 0.0000913204

epoch time: 1722.4130859375s, input_fired_time: 18.9507884979, output_fired_time: 9.9101810455, propagate_forward_time: 683.4441528320, propagate_backward_time: 994.7792358398, weight_update_time: 1.0252779722, other_time: 15.3287353516
epoch time: 140.1011810303s, input_fired_time: 1.5230203867, output_fired_time: 0.0000000000, propagate_forward_time: 136.1128692627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4652862549
validation[          , genome  6408] predictions:    6052/  10000 (60.52%), best:    6215/10000 (62.15%), error:     11206.06543, best error:     10920.07031 on epoch:    24, epoch:   33/100, mu: 0.9419106841, learning_rate: 0.0003618085, weight_decay: 0.0000873262

epoch time: 1727.6385498047s, input_fired_time: 19.1544418335, output_fired_time: 10.0829467773, propagate_forward_time: 686.6148071289, propagate_backward_time: 996.2928466797, weight_update_time: 1.0124541521, other_time: 15.4934692383
epoch time: 139.8190917969s, input_fired_time: 1.5724858046, output_fired_time: 0.0000000000, propagate_forward_time: 135.7629547119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4836578369
validation[          , genome  6408] predictions:    6253/  10000 (62.53%), best:    6253/10000 (62.53%), error:     10877.75293, best error:     10877.75293 on epoch:    34, epoch:   34/100, mu: 0.9450504184, learning_rate: 0.0003390456, weight_decay: 0.0000835067

epoch time: 1723.4348144531s, input_fired_time: 18.9551887512, output_fired_time: 9.8854742050, propagate_forward_time: 682.2998657227, propagate_backward_time: 996.8152465820, weight_update_time: 0.9935430884, other_time: 15.4790039063
epoch time: 143.9743957520s, input_fired_time: 1.5740988255, output_fired_time: 0.0000000000, propagate_forward_time: 139.7417602539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6585388184
validation[          , genome  6408] predictions:    6243/  10000 (62.43%), best:    6243/10000 (62.43%), error:     10734.83008, best error:     10734.83008 on epoch:    35, epoch:   35/100, mu: 0.9479851127, learning_rate: 0.0003177149, weight_decay: 0.0000798543

epoch time: 1742.1286621094s, input_fired_time: 19.3793716431, output_fired_time: 9.8493108749, propagate_forward_time: 687.5327148438, propagate_backward_time: 1009.7726440430, weight_update_time: 0.9873422980, other_time: 15.5945434570
epoch time: 144.2435760498s, input_fired_time: 1.6882675886, output_fired_time: 0.0000000000, propagate_forward_time: 140.0090637207, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5462493896
validation[          , genome  6408] predictions:    6193/  10000 (61.93%), best:    6243/10000 (62.43%), error:     11022.07227, best error:     10734.83008 on epoch:    35, epoch:   36/100, mu: 0.9507282376, learning_rate: 0.0002977262, weight_decay: 0.0000763616

epoch time: 1750.1662597656s, input_fired_time: 19.3287429810, output_fired_time: 10.1910533905, propagate_forward_time: 690.7734985352, propagate_backward_time: 1014.3963012695, weight_update_time: 1.0607062578, other_time: 15.4767456055
epoch time: 142.1259155273s, input_fired_time: 1.5482265949, output_fired_time: 0.0000000000, propagate_forward_time: 138.0689849854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5086975098
validation[          , genome  6408] predictions:    6249/  10000 (62.49%), best:    6243/10000 (62.43%), error:     10823.73438, best error:     10734.83008 on epoch:    35, epoch:   37/100, mu: 0.9532922506, learning_rate: 0.0002789951, weight_decay: 0.0000730217

epoch time: 1738.6574707031s, input_fired_time: 19.3953704834, output_fired_time: 9.8912105560, propagate_forward_time: 691.4632568359, propagate_backward_time: 1002.2407226563, weight_update_time: 0.9880716801, other_time: 15.6668701172
epoch time: 141.2640228271s, input_fired_time: 1.5289462805, output_fired_time: 0.0000000000, propagate_forward_time: 137.2412414551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4938354492
validation[          , genome  6408] predictions:    6088/  10000 (60.88%), best:    6243/10000 (62.43%), error:     11288.81445, best error:     10734.83008 on epoch:    35, epoch:   38/100, mu: 0.9556888938, learning_rate: 0.0002614424, weight_decay: 0.0000698279

epoch time: 1730.9017333984s, input_fired_time: 19.2965030670, output_fired_time: 9.8505306244, propagate_forward_time: 688.6526489258, propagate_backward_time: 997.5238037109, weight_update_time: 0.9948516488, other_time: 15.5781860352
epoch time: 141.4342498779s, input_fired_time: 1.5563771725, output_fired_time: 0.0000000000, propagate_forward_time: 137.2729187012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6049499512
validation[          , genome  6408] predictions:    6033/  10000 (60.33%), best:    6243/10000 (62.43%), error:     11356.32520, best error:     10734.83008 on epoch:    35, epoch:   39/100, mu: 0.9579290152, learning_rate: 0.0002449940, weight_decay: 0.0000667737

epoch time: 1723.2224121094s, input_fired_time: 19.1406860352, output_fired_time: 9.7764482498, propagate_forward_time: 685.7863159180, propagate_backward_time: 993.1771240234, weight_update_time: 0.9910525084, other_time: 15.3418579102
epoch time: 143.4278717041s, input_fired_time: 1.6357206106, output_fired_time: 0.0000000000, propagate_forward_time: 139.0362854004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7558593750
validation[          , genome  6408] predictions:    6175/  10000 (61.75%), best:    6243/10000 (62.43%), error:     10861.64453, best error:     10734.83008 on epoch:    35, epoch:   40/100, mu: 0.9600229263, learning_rate: 0.0002295804, weight_decay: 0.0000638532

epoch time: 1743.8170166016s, input_fired_time: 19.1865501404, output_fired_time: 9.8961057663, propagate_forward_time: 690.7337646484, propagate_backward_time: 1008.6817016602, weight_update_time: 1.0308597088, other_time: 15.3189086914
epoch time: 141.3501129150s, input_fired_time: 1.5545266867, output_fired_time: 0.0000000000, propagate_forward_time: 137.3101348877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4854583740
validation[          , genome  6408] predictions:    6232/  10000 (62.32%), best:    6243/10000 (62.43%), error:     10831.15820, best error:     10734.83008 on epoch:    35, epoch:   41/100, mu: 0.9619801044, learning_rate: 0.0002151366, weight_decay: 0.0000610603

epoch time: 1699.7781982422s, input_fired_time: 19.0810909271, output_fired_time: 9.9546346664, propagate_forward_time: 672.2999267578, propagate_backward_time: 982.9990844727, weight_update_time: 1.0237879753, other_time: 15.4435424805
epoch time: 136.6654357910s, input_fired_time: 1.5296002626, output_fired_time: 0.0000000000, propagate_forward_time: 132.5555877686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5802459717
validation[          , genome  6408] predictions:    6305/  10000 (63.05%), best:    6305/10000 (63.05%), error:     10630.92188, best error:     10630.92188 on epoch:    42, epoch:   42/100, mu: 0.9638094902, learning_rate: 0.0002016015, weight_decay: 0.0000583897

epoch time: 1690.0892333984s, input_fired_time: 19.0159835815, output_fired_time: 9.8580265045, propagate_forward_time: 666.7466430664, propagate_backward_time: 978.9358520508, weight_update_time: 1.0086331367, other_time: 15.5327148438
epoch time: 138.0243377686s, input_fired_time: 1.5098986626, output_fired_time: 0.0000000000, propagate_forward_time: 133.8999633789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6144714355
validation[          , genome  6408] predictions:    6226/  10000 (62.26%), best:    6305/10000 (63.05%), error:     10809.13477, best error:     10630.92188 on epoch:    42, epoch:   43/100, mu: 0.9655194283, learning_rate: 0.0001889179, weight_decay: 0.0000558358

epoch time: 1688.1708984375s, input_fired_time: 19.2367744446, output_fired_time: 9.8914079666, propagate_forward_time: 667.3411254883, propagate_backward_time: 976.2446289063, weight_update_time: 0.9897694588, other_time: 15.4569702148
epoch time: 138.4612426758s, input_fired_time: 1.5130939484, output_fired_time: 0.0000000000, propagate_forward_time: 134.3878479004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5603027344
validation[          , genome  6408] predictions:    6234/  10000 (62.34%), best:    6305/10000 (63.05%), error:     10873.21582, best error:     10630.92188 on epoch:    42, epoch:   44/100, mu: 0.9671177268, learning_rate: 0.0001770324, weight_decay: 0.0000533937

epoch time: 2256.3796386719s, input_fired_time: 19.5184173584, output_fired_time: 9.7905273438, propagate_forward_time: 1216.4775390625, propagate_backward_time: 994.9829711914, weight_update_time: 1.0107122660, other_time: 15.6102905273
epoch time: 137.8427429199s, input_fired_time: 1.5374633074, output_fired_time: 0.0000000000, propagate_forward_time: 133.7153778076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5899047852
validation[          , genome  6408] predictions:    6308/  10000 (63.08%), best:    6305/10000 (63.05%), error:     10655.03418, best error:     10630.92188 on epoch:    42, epoch:   45/100, mu: 0.9686117172, learning_rate: 0.0001658945, weight_decay: 0.0000510583

epoch time: 1709.8833007813s, input_fired_time: 19.2224273682, output_fired_time: 9.6166553497, propagate_forward_time: 675.7935791016, propagate_backward_time: 989.4353027344, weight_update_time: 0.9972196817, other_time: 15.8153076172
epoch time: 138.4092712402s, input_fired_time: 1.5215318203, output_fired_time: 0.0000000000, propagate_forward_time: 134.3344421387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5532989502
validation[          , genome  6408] predictions:    6322/  10000 (63.22%), best:    6322/10000 (63.22%), error:     10588.61035, best error:     10588.61035 on epoch:    46, epoch:   46/100, mu: 0.9700081348, learning_rate: 0.0001554575, weight_decay: 0.0000488251

epoch time: 1699.2381591797s, input_fired_time: 19.0606594086, output_fired_time: 9.8405752182, propagate_forward_time: 665.0399169922, propagate_backward_time: 989.7431030273, weight_update_time: 1.0145783424, other_time: 15.5538940430
epoch time: 139.0295562744s, input_fired_time: 1.5590229034, output_fired_time: 0.0000000000, propagate_forward_time: 134.8177337646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6528015137
validation[          , genome  6408] predictions:    6314/  10000 (63.14%), best:    6322/10000 (63.22%), error:     10629.65527, best error:     10588.61035 on epoch:    46, epoch:   47/100, mu: 0.9713133574, learning_rate: 0.0001456770, weight_decay: 0.0000466896

epoch time: 1693.7207031250s, input_fired_time: 19.1693477631, output_fired_time: 9.6829776764, propagate_forward_time: 671.1044311523, propagate_backward_time: 977.9284057617, weight_update_time: 1.0968984365, other_time: 15.8355712891
epoch time: 137.3103332520s, input_fired_time: 1.5221848488, output_fired_time: 0.0000000000, propagate_forward_time: 133.2465515137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5415954590
validation[          , genome  6408] predictions:    6309/  10000 (63.09%), best:    6322/10000 (63.22%), error:     10712.18652, best error:     10588.61035 on epoch:    46, epoch:   48/100, mu: 0.9725334048, learning_rate: 0.0001365119, weight_decay: 0.0000446475

epoch time: 1713.5614013672s, input_fired_time: 19.2921504974, output_fired_time: 9.9024486542, propagate_forward_time: 676.4840698242, propagate_backward_time: 992.1083984375, weight_update_time: 1.0422759056, other_time: 15.7743530273
epoch time: 139.0635223389s, input_fired_time: 1.4940297604, output_fired_time: 0.0000000000, propagate_forward_time: 134.9522247314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6172637939
validation[          , genome  6408] predictions:    6312/  10000 (63.12%), best:    6322/10000 (63.22%), error:     10639.82031, best error:     10588.61035 on epoch:    46, epoch:   49/100, mu: 0.9736737609, learning_rate: 0.0001279234, weight_decay: 0.0000426947

epoch time: 1718.6933593750s, input_fired_time: 19.4390048981, output_fired_time: 10.0193138123, propagate_forward_time: 677.1041870117, propagate_backward_time: 996.1476440430, weight_update_time: 1.0644493103, other_time: 15.9832763672
epoch time: 141.9241180420s, input_fired_time: 1.5367494822, output_fired_time: 0.0000000000, propagate_forward_time: 137.8552398682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5321350098
validation[          , genome  6408] predictions:    6256/  10000 (62.56%), best:    6322/10000 (63.22%), error:     10704.77637, best error:     10588.61035 on epoch:    46, epoch:   50/100, mu: 0.9747396708, learning_rate: 0.0001198752, weight_decay: 0.0000408273

epoch time: 1753.7886962891s, input_fired_time: 19.0309028625, output_fired_time: 10.1015901566, propagate_forward_time: 688.7062988281, propagate_backward_time: 1020.4467773438, weight_update_time: 0.9833466411, other_time: 15.5031738281
epoch time: 143.2272644043s, input_fired_time: 1.5488514900, output_fired_time: 0.0000000000, propagate_forward_time: 139.1019744873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5764312744
validation[          , genome  6408] predictions:    6304/  10000 (63.04%), best:    6304/10000 (63.04%), error:     10580.42285, best error:     10580.42285 on epoch:    51, epoch:   51/100, mu: 0.9757360220, learning_rate: 0.0001123334, weight_decay: 0.0000390416

epoch time: 1786.5783691406s, input_fired_time: 19.3646564484, output_fired_time: 9.9111604691, propagate_forward_time: 731.9545898438, propagate_backward_time: 1009.9758300781, weight_update_time: 1.0023030043, other_time: 15.3721923828
epoch time: 143.3859863281s, input_fired_time: 1.5823845863, output_fired_time: 0.0000000000, propagate_forward_time: 139.1806030273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6230010986
validation[          , genome  6408] predictions:    6426/  10000 (64.26%), best:    6426/10000 (64.26%), error:     10270.99121, best error:     10270.99121 on epoch:    52, epoch:   52/100, mu: 0.9766672850, learning_rate: 0.0001052660, weight_decay: 0.0000373340

epoch time: 1762.9809570313s, input_fired_time: 19.3030395508, output_fired_time: 10.0159072876, propagate_forward_time: 699.7397460938, propagate_backward_time: 1018.2441406250, weight_update_time: 0.9930012226, other_time: 15.6782226563
epoch time: 144.6896057129s, input_fired_time: 1.6039220095, output_fired_time: 0.0000000000, propagate_forward_time: 140.5733947754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5122833252
validation[          , genome  6408] predictions:    6364/  10000 (63.64%), best:    6426/10000 (64.26%), error:     10471.65430, best error:     10270.99121 on epoch:    52, epoch:   53/100, mu: 0.9775377512, learning_rate: 0.0000986433, weight_decay: 0.0000357010

epoch time: 1752.1420898438s, input_fired_time: 19.1231689453, output_fired_time: 9.9402427673, propagate_forward_time: 699.8635253906, propagate_backward_time: 1007.7169189453, weight_update_time: 1.0023505688, other_time: 15.4982910156
epoch time: 149.3126678467s, input_fired_time: 1.7021244764, output_fired_time: 0.0000000000, propagate_forward_time: 145.0109405518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5996093750
validation[          , genome  6408] predictions:    6327/  10000 (63.27%), best:    6426/10000 (64.26%), error:     10622.91309, best error:     10270.99121 on epoch:    52, epoch:   54/100, mu: 0.9783514142, learning_rate: 0.0000924373, weight_decay: 0.0000341395

epoch time: 1777.8076171875s, input_fired_time: 19.1151618958, output_fired_time: 10.0829181671, propagate_forward_time: 710.8843383789, propagate_backward_time: 1022.3994140625, weight_update_time: 1.0275477171, other_time: 15.3259277344
epoch time: 146.2845916748s, input_fired_time: 1.5709733963, output_fired_time: 0.0000000000, propagate_forward_time: 142.1350555420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5785675049
validation[          , genome  6408] predictions:    6403/  10000 (64.03%), best:    6426/10000 (64.26%), error:     10339.89551, best error:     10270.99121 on epoch:    52, epoch:   55/100, mu: 0.9791119099, learning_rate: 0.0000866217, weight_decay: 0.0000326463

epoch time: 1780.3450927734s, input_fired_time: 19.4460830688, output_fired_time: 10.3026609421, propagate_forward_time: 711.0615844727, propagate_backward_time: 1023.9036254883, weight_update_time: 1.0997617245, other_time: 15.6312866211
epoch time: 148.4810485840s, input_fired_time: 1.6233326197, output_fired_time: 0.0000000000, propagate_forward_time: 144.0813446045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7763671875
validation[          , genome  6408] predictions:    6305/  10000 (63.05%), best:    6426/10000 (64.26%), error:     10540.64941, best error:     10270.99121 on epoch:    52, epoch:   56/100, mu: 0.9798227549, learning_rate: 0.0000811719, weight_decay: 0.0000312184

epoch time: 1801.7399902344s, input_fired_time: 19.3843383789, output_fired_time: 10.1122207642, propagate_forward_time: 729.0497436523, propagate_backward_time: 1027.7637939453, weight_update_time: 1.0292528868, other_time: 15.4300537109
epoch time: 145.0987091064s, input_fired_time: 1.6037416458, output_fired_time: 0.0000000000, propagate_forward_time: 140.9590759277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5358886719
validation[          , genome  6408] predictions:    6412/  10000 (64.12%), best:    6426/10000 (64.26%), error:     10360.29785, best error:     10270.99121 on epoch:    52, epoch:   57/100, mu: 0.9804872274, learning_rate: 0.0000760651, weight_decay: 0.0000298530

epoch time: 1785.7790527344s, input_fired_time: 19.5896682739, output_fired_time: 10.0355300903, propagate_forward_time: 713.9619140625, propagate_backward_time: 1026.9113769531, weight_update_time: 1.0252419710, other_time: 15.2805175781
epoch time: 147.8947906494s, input_fired_time: 1.5661880970, output_fired_time: 0.0000000000, propagate_forward_time: 143.7168731689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6117248535
validation[          , genome  6408] predictions:    6320/  10000 (63.20%), best:    6426/10000 (64.26%), error:     10598.11035, best error:     10270.99121 on epoch:    52, epoch:   58/100, mu: 0.9811083078, learning_rate: 0.0000712795, weight_decay: 0.0000285473

epoch time: 1805.7556152344s, input_fired_time: 19.2114028931, output_fired_time: 10.0784215927, propagate_forward_time: 730.9376220703, propagate_backward_time: 1030.1831054688, weight_update_time: 1.0118724108, other_time: 15.3450927734
epoch time: 144.9790954590s, input_fired_time: 1.5960439444, output_fired_time: 0.0000000000, propagate_forward_time: 140.8582611084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5247955322
validation[          , genome  6408] predictions:    6376/  10000 (63.76%), best:    6426/10000 (64.26%), error:     10459.50781, best error:     10270.99121 on epoch:    52, epoch:   59/100, mu: 0.9816888571, learning_rate: 0.0000667951, weight_decay: 0.0000272987

epoch time: 1794.4377441406s, input_fired_time: 19.0171279907, output_fired_time: 10.2126789093, propagate_forward_time: 712.3284301758, propagate_backward_time: 1037.2464599609, weight_update_time: 0.9833886027, other_time: 15.6331787109
epoch time: 145.5051574707s, input_fired_time: 1.5947355032, output_fired_time: 0.0000000000, propagate_forward_time: 141.3519744873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5584411621
validation[          , genome  6408] predictions:    6375/  10000 (63.75%), best:    6426/10000 (64.26%), error:     10408.01074, best error:     10270.99121 on epoch:    52, epoch:   60/100, mu: 0.9822314978, learning_rate: 0.0000625927, weight_decay: 0.0000261047

epoch time: 1770.9841308594s, input_fired_time: 19.0784645081, output_fired_time: 9.9741258621, propagate_forward_time: 706.5023803711, propagate_backward_time: 1020.2423706055, weight_update_time: 0.9932332635, other_time: 15.1868286133
epoch time: 147.6461791992s, input_fired_time: 1.5931004286, output_fired_time: 0.0000000000, propagate_forward_time: 143.5453796387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5077056885
validation[          , genome  6408] predictions:    6394/  10000 (63.94%), best:    6426/10000 (64.26%), error:     10377.83691, best error:     10270.99121 on epoch:    52, epoch:   61/100, mu: 0.9827386737, learning_rate: 0.0000586547, weight_decay: 0.0000249629

epoch time: 1778.1724853516s, input_fired_time: 19.4855747223, output_fired_time: 10.1289815903, propagate_forward_time: 710.3958740234, propagate_backward_time: 1022.8222656250, weight_update_time: 0.9837257862, other_time: 15.3397216797
epoch time: 147.5970306396s, input_fired_time: 1.5992980003, output_fired_time: 0.0000000000, propagate_forward_time: 143.4550323486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5426940918
validation[          , genome  6408] predictions:    6429/  10000 (64.29%), best:    6426/10000 (64.26%), error:     10342.26465, best error:     10270.99121 on epoch:    52, epoch:   62/100, mu: 0.9832127690, learning_rate: 0.0000549645, weight_decay: 0.0000238711

epoch time: 1772.9832763672s, input_fired_time: 18.9796848297, output_fired_time: 9.9908065796, propagate_forward_time: 707.6695556641, propagate_backward_time: 1020.8699340820, weight_update_time: 1.0434499979, other_time: 15.4732055664
epoch time: 145.6932830811s, input_fired_time: 1.5732374191, output_fired_time: 0.0000000000, propagate_forward_time: 141.6072692871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5127716064
validation[          , genome  6408] predictions:    6399/  10000 (63.99%), best:    6426/10000 (64.26%), error:     10288.06348, best error:     10270.99121 on epoch:    52, epoch:   63/100, mu: 0.9836559296, learning_rate: 0.0000515065, weight_decay: 0.0000228270

epoch time: 1776.5319824219s, input_fired_time: 19.2908687592, output_fired_time: 10.0575771332, propagate_forward_time: 710.8723144531, propagate_backward_time: 1020.9857177734, weight_update_time: 0.9637053609, other_time: 15.3254394531
epoch time: 145.5591125488s, input_fired_time: 1.6078125238, output_fired_time: 0.0000000000, propagate_forward_time: 141.5007934570, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4505004883
validation[          , genome  6408] predictions:    6398/  10000 (63.98%), best:    6426/10000 (64.26%), error:     10340.46680, best error:     10270.99121 on epoch:    52, epoch:   64/100, mu: 0.9840701222, learning_rate: 0.0000482660, weight_decay: 0.0000218286

epoch time: 1769.0477294922s, input_fired_time: 19.0296802521, output_fired_time: 10.0408687592, propagate_forward_time: 706.3917236328, propagate_backward_time: 1018.1826782227, weight_update_time: 1.0160334110, other_time: 15.4027709961
epoch time: 144.8443450928s, input_fired_time: 1.5648832321, output_fired_time: 0.0000000000, propagate_forward_time: 140.7995910645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4798736572
validation[          , genome  6408] predictions:    6465/  10000 (64.65%), best:    6465/10000 (64.65%), error:     10223.68652, best error:     10223.68652 on epoch:    65, epoch:   65/100, mu: 0.9844572544, learning_rate: 0.0000452294, weight_decay: 0.0000208739

epoch time: 1772.2843017578s, input_fired_time: 19.3728389740, output_fired_time: 10.1444015503, propagate_forward_time: 708.6632080078, propagate_backward_time: 1018.6778564453, weight_update_time: 1.0011876822, other_time: 15.4260253906
epoch time: 144.5929870605s, input_fired_time: 1.5941884518, output_fired_time: 0.0000000000, propagate_forward_time: 140.5145568848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4842376709
validation[          , genome  6408] predictions:    6409/  10000 (64.09%), best:    6465/10000 (64.65%), error:     10393.31738, best error:     10223.68652 on epoch:    65, epoch:   66/100, mu: 0.9848191142, learning_rate: 0.0000423838, weight_decay: 0.0000199609

epoch time: 1920.8276367188s, input_fired_time: 19.3877162933, output_fired_time: 9.8738403320, propagate_forward_time: 703.1973876953, propagate_backward_time: 1173.1513671875, weight_update_time: 1.0223168135, other_time: 15.2174072266
epoch time: 149.4320220947s, input_fired_time: 1.6079187393, output_fired_time: 0.0000000000, propagate_forward_time: 145.1517791748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6723175049
validation[          , genome  6408] predictions:    6383/  10000 (63.83%), best:    6465/10000 (64.65%), error:     10319.48047, best error:     10223.68652 on epoch:    65, epoch:   67/100, mu: 0.9851573706, learning_rate: 0.0000397173, weight_decay: 0.0000190878

epoch time: 1757.8098144531s, input_fired_time: 19.2554664612, output_fired_time: 9.8172693253, propagate_forward_time: 702.6850585938, propagate_backward_time: 1010.9481201172, weight_update_time: 1.0356152058, other_time: 15.1038818359
epoch time: 144.0201568604s, input_fired_time: 1.5338696241, output_fired_time: 0.0000000000, propagate_forward_time: 140.0313110352, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4549713135
validation[          , genome  6408] predictions:    6429/  10000 (64.29%), best:    6465/10000 (64.65%), error:     10252.35254, best error:     10223.68652 on epoch:    65, epoch:   68/100, mu: 0.9854735136, learning_rate: 0.0000372185, weight_decay: 0.0000182529

epoch time: 1769.9327392578s, input_fired_time: 19.4005298615, output_fired_time: 9.9961175919, propagate_forward_time: 705.2715454102, propagate_backward_time: 1019.9063110352, weight_update_time: 1.0165455341, other_time: 15.3583374023
epoch time: 147.3933105469s, input_fired_time: 1.7087445259, output_fired_time: 0.0000000000, propagate_forward_time: 143.1620330811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5225372314
validation[          , genome  6408] predictions:    6423/  10000 (64.23%), best:    6465/10000 (64.65%), error:     10273.65332, best error:     10223.68652 on epoch:    65, epoch:   69/100, mu: 0.9857690334, learning_rate: 0.0000348770, weight_decay: 0.0000174546

epoch time: 1774.0914306641s, input_fired_time: 19.6316337585, output_fired_time: 9.8645830154, propagate_forward_time: 708.7276611328, propagate_backward_time: 1020.6852416992, weight_update_time: 0.9771052599, other_time: 15.1823120117
epoch time: 152.5061645508s, input_fired_time: 1.6472309828, output_fired_time: 0.0000000000, propagate_forward_time: 148.3256530762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5332794189
validation[          , genome  6408] predictions:    6444/  10000 (64.44%), best:    6444/10000 (64.44%), error:     10194.16602, best error:     10194.16602 on epoch:    70, epoch:   70/100, mu: 0.9860452414, learning_rate: 0.0000326827, weight_decay: 0.0000166912

epoch time: 1861.7747802734s, input_fired_time: 19.4706249237, output_fired_time: 10.1442041397, propagate_forward_time: 715.3560791016, propagate_backward_time: 1091.1829833984, weight_update_time: 1.0276389122, other_time: 25.6209716797
epoch time: 146.8931732178s, input_fired_time: 1.6139950752, output_fired_time: 0.0000000000, propagate_forward_time: 142.7930755615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4860992432
validation[          , genome  6408] predictions:    6435/  10000 (64.35%), best:    6444/10000 (64.44%), error:     10261.78613, best error:     10194.16602 on epoch:    70, epoch:   71/100, mu: 0.9863034487, learning_rate: 0.0000306265, weight_decay: 0.0000159611

epoch time: 1775.5939941406s, input_fired_time: 19.4173355103, output_fired_time: 10.1914424896, propagate_forward_time: 709.0207519531, propagate_backward_time: 1021.4545288086, weight_update_time: 1.0007451773, other_time: 15.5099487305
epoch time: 144.5250244141s, input_fired_time: 1.5797044039, output_fired_time: 0.0000000000, propagate_forward_time: 140.3763275146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5689849854
validation[          , genome  6408] predictions:    6401/  10000 (64.01%), best:    6444/10000 (64.44%), error:     10271.54980, best error:     10194.16602 on epoch:    70, epoch:   72/100, mu: 0.9865447879, learning_rate: 0.0000286997, weight_decay: 0.0000152630

epoch time: 1776.7624511719s, input_fired_time: 19.4550704956, output_fired_time: 9.9891490936, propagate_forward_time: 709.2913208008, propagate_backward_time: 1022.4880371094, weight_update_time: 0.9944099784, other_time: 15.5388183594
epoch time: 146.2139892578s, input_fired_time: 1.5502991676, output_fired_time: 0.0000000000, propagate_forward_time: 142.1951446533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4685516357
validation[          , genome  6408] predictions:    6474/  10000 (64.74%), best:    6474/10000 (64.74%), error:     10180.97266, best error:     10180.97266 on epoch:    73, epoch:   73/100, mu: 0.9867703915, learning_rate: 0.0000268941, weight_decay: 0.0000145954

epoch time: 1772.5659179688s, input_fired_time: 19.3386363983, output_fired_time: 9.9843788147, propagate_forward_time: 707.8458862305, propagate_backward_time: 1020.0778808594, weight_update_time: 1.0802960396, other_time: 15.3190917969
epoch time: 146.7287750244s, input_fired_time: 1.6359758377, output_fired_time: 0.0000000000, propagate_forward_time: 142.5713958740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5214080811
validation[          , genome  6408] predictions:    6463/  10000 (64.63%), best:    6463/10000 (64.63%), error:     10125.29492, best error:     10125.29492 on epoch:    74, epoch:   74/100, mu: 0.9869812727, learning_rate: 0.0000252021, weight_decay: 0.0000139571

epoch time: 1790.8146972656s, input_fired_time: 19.4548454285, output_fired_time: 10.0685977936, propagate_forward_time: 711.6093139648, propagate_backward_time: 1034.2878417969, weight_update_time: 1.0892097950, other_time: 15.3940429688
epoch time: 146.1870422363s, input_fired_time: 1.5620769262, output_fired_time: 0.0000000000, propagate_forward_time: 142.0693054199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5556640625
validation[          , genome  6408] predictions:    6507/  10000 (65.07%), best:    6507/10000 (65.07%), error:     10069.01563, best error:     10069.01563 on epoch:    75, epoch:   75/100, mu: 0.9871783853, learning_rate: 0.0000236165, weight_decay: 0.0000133466

epoch time: 1776.3288574219s, input_fired_time: 19.4718914032, output_fired_time: 10.0715208054, propagate_forward_time: 709.4963378906, propagate_backward_time: 1021.8640136719, weight_update_time: 1.0277658701, other_time: 15.4250488281
epoch time: 145.8409576416s, input_fired_time: 1.5735633373, output_fired_time: 0.0000000000, propagate_forward_time: 141.7178039551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5495910645
validation[          , genome  6408] predictions:    6446/  10000 (64.46%), best:    6507/10000 (65.07%), error:     10107.74121, best error:     10069.01563 on epoch:    75, epoch:   76/100, mu: 0.9873626232, learning_rate: 0.0000221307, weight_decay: 0.0000127628

epoch time: 1778.7342529297s, input_fired_time: 19.2761020660, output_fired_time: 10.0959062576, propagate_forward_time: 708.8326416016, propagate_backward_time: 1024.8538818359, weight_update_time: 1.0449539423, other_time: 15.6756591797
epoch time: 144.4886932373s, input_fired_time: 1.5275254250, output_fired_time: 0.0000000000, propagate_forward_time: 140.4521026611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5090637207
validation[          , genome  6408] predictions:    6422/  10000 (64.22%), best:    6507/10000 (65.07%), error:     10299.42480, best error:     10069.01563 on epoch:    75, epoch:   77/100, mu: 0.9875348210, learning_rate: 0.0000207384, weight_decay: 0.0000122046

epoch time: 1769.9257812500s, input_fired_time: 19.1068572998, output_fired_time: 9.8856830597, propagate_forward_time: 705.7971801758, propagate_backward_time: 1019.7009277344, weight_update_time: 1.0836843252, other_time: 15.4350585938
epoch time: 147.3291320801s, input_fired_time: 1.6301102638, output_fired_time: 0.0000000000, propagate_forward_time: 143.2524414063, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4465789795
validation[          , genome  6408] predictions:    6453/  10000 (64.53%), best:    6507/10000 (65.07%), error:     10105.42090, best error:     10069.01563 on epoch:    75, epoch:   78/100, mu: 0.9876957536, learning_rate: 0.0000194336, weight_decay: 0.0000116708

epoch time: 1785.1447753906s, input_fired_time: 19.2827014923, output_fired_time: 9.9663372040, propagate_forward_time: 708.7584228516, propagate_backward_time: 1031.6329345703, weight_update_time: 1.0324165821, other_time: 15.5043945313
epoch time: 146.5570678711s, input_fired_time: 1.5806040764, output_fired_time: 0.0000000000, propagate_forward_time: 142.4645996094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5118713379
validation[          , genome  6408] predictions:    6438/  10000 (64.38%), best:    6507/10000 (65.07%), error:     10171.92773, best error:     10069.01563 on epoch:    75, epoch:   79/100, mu: 0.9878461957, learning_rate: 0.0000182110, weight_decay: 0.0000111604

epoch time: 1771.7127685547s, input_fired_time: 19.2992382050, output_fired_time: 9.9360980988, propagate_forward_time: 708.4186401367, propagate_backward_time: 1018.7380981445, weight_update_time: 1.0109894276, other_time: 15.3207397461
epoch time: 145.5783691406s, input_fired_time: 1.6043289900, output_fired_time: 0.0000000000, propagate_forward_time: 141.4727935791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5012512207
validation[          , genome  6408] predictions:    6487/  10000 (64.87%), best:    6507/10000 (65.07%), error:     10082.58496, best error:     10069.01563 on epoch:    75, epoch:   80/100, mu: 0.9879868031, learning_rate: 0.0000170652, weight_decay: 0.0000106722

epoch time: 1804.6905517578s, input_fired_time: 19.7149429321, output_fired_time: 10.1365709305, propagate_forward_time: 725.1108398438, propagate_backward_time: 1034.3339843750, weight_update_time: 0.9759110212, other_time: 15.3941650391
epoch time: 148.8034362793s, input_fired_time: 1.6190069914, output_fired_time: 0.0000000000, propagate_forward_time: 144.6329956055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5514373779
validation[          , genome  6408] predictions:    6455/  10000 (64.55%), best:    6507/10000 (65.07%), error:     10125.92480, best error:     10069.01563 on epoch:    75, epoch:   81/100, mu: 0.9881182313, learning_rate: 0.0000159916, weight_decay: 0.0000102054

epoch time: 1779.6168212891s, input_fired_time: 19.2007350922, output_fired_time: 10.0081968307, propagate_forward_time: 710.2756347656, propagate_backward_time: 1024.8581542969, weight_update_time: 0.9784677029, other_time: 15.2741699219
epoch time: 144.0873870850s, input_fired_time: 1.5877999067, output_fired_time: 0.0000000000, propagate_forward_time: 139.9379730225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5616149902
validation[          , genome  6408] predictions:    6432/  10000 (64.32%), best:    6507/10000 (65.07%), error:     10108.71191, best error:     10069.01563 on epoch:    75, epoch:   82/100, mu: 0.9882410765, learning_rate: 0.0000149855, weight_decay: 0.0000097591

epoch time: 1775.1308593750s, input_fired_time: 19.6540946960, output_fired_time: 10.1731519699, propagate_forward_time: 712.2305908203, propagate_backward_time: 1017.6267700195, weight_update_time: 1.0276970863, other_time: 15.4463500977
epoch time: 145.1863250732s, input_fired_time: 1.6893393993, output_fired_time: 0.0000000000, propagate_forward_time: 140.9255371094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5714416504
validation[          , genome  6408] predictions:    6525/  10000 (65.25%), best:    6525/10000 (65.25%), error:      9986.39355, best error:      9986.39355 on epoch:    83, epoch:   83/100, mu: 0.9883559346, learning_rate: 0.0000140427, weight_decay: 0.0000093322

epoch time: 1756.4389648438s, input_fired_time: 19.1175727844, output_fired_time: 9.9656276703, propagate_forward_time: 699.2991943359, propagate_backward_time: 1013.0057373047, weight_update_time: 1.0192584991, other_time: 15.0509033203
epoch time: 142.9099426270s, input_fired_time: 1.5820673704, output_fired_time: 0.0000000000, propagate_forward_time: 138.8262634277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5016174316
validation[          , genome  6408] predictions:    6513/  10000 (65.13%), best:    6525/10000 (65.25%), error:     10067.74707, best error:      9986.39355 on epoch:    83, epoch:   84/100, mu: 0.9884632826, learning_rate: 0.0000131592, weight_decay: 0.0000089241

epoch time: 1763.7021484375s, input_fired_time: 19.1261959076, output_fired_time: 9.8765974045, propagate_forward_time: 707.8517456055, propagate_backward_time: 1011.5435180664, weight_update_time: 0.9787364602, other_time: 15.3041381836
epoch time: 143.9501647949s, input_fired_time: 1.6232844591, output_fired_time: 0.0000000000, propagate_forward_time: 139.8879394531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4389343262
validation[          , genome  6408] predictions:    6516/  10000 (65.16%), best:    6525/10000 (65.25%), error:     10028.45996, best error:      9986.39355 on epoch:    83, epoch:   85/100, mu: 0.9885635972, learning_rate: 0.0000123313, weight_decay: 0.0000085337

epoch time: 1774.1450195313s, input_fired_time: 19.3920211792, output_fired_time: 9.9314126968, propagate_forward_time: 704.7612915039, propagate_backward_time: 1024.8710937500, weight_update_time: 1.0862782001, other_time: 15.1892089844
epoch time: 144.4375610352s, input_fired_time: 1.6271431446, output_fired_time: 0.0000000000, propagate_forward_time: 140.3581237793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4523010254
validation[          , genome  6408] predictions:    6478/  10000 (64.78%), best:    6525/10000 (65.25%), error:     10043.46973, best error:      9986.39355 on epoch:    83, epoch:   86/100, mu: 0.9886573553, learning_rate: 0.0000115555, weight_decay: 0.0000081605

epoch time: 1753.2271728516s, input_fired_time: 19.2510452271, output_fired_time: 9.8538923264, propagate_forward_time: 699.9025878906, propagate_backward_time: 1008.9946899414, weight_update_time: 1.0209155083, other_time: 15.2249145508
epoch time: 143.9288635254s, input_fired_time: 1.6259063482, output_fired_time: 0.0000000000, propagate_forward_time: 139.7805023193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5224609375
validation[          , genome  6408] predictions:    6471/  10000 (64.71%), best:    6525/10000 (65.25%), error:     10099.88379, best error:      9986.39355 on epoch:    83, epoch:   87/100, mu: 0.9887450337, learning_rate: 0.0000108285, weight_decay: 0.0000078036

epoch time: 1747.4738769531s, input_fired_time: 19.0753784180, output_fired_time: 9.9195156097, propagate_forward_time: 696.5149536133, propagate_backward_time: 1006.8331298828, weight_update_time: 1.0090745687, other_time: 15.1307983398
epoch time: 144.3283843994s, input_fired_time: 1.6058979034, output_fired_time: 0.0000000000, propagate_forward_time: 140.2163085938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5061798096
validation[          , genome  6408] predictions:    6507/  10000 (65.07%), best:    6525/10000 (65.25%), error:     10063.10059, best error:      9986.39355 on epoch:    83, epoch:   88/100, mu: 0.9888269901, learning_rate: 0.0000101472, weight_decay: 0.0000074622

epoch time: 1758.2019042969s, input_fired_time: 19.2622241974, output_fired_time: 9.9009475708, propagate_forward_time: 698.6902465820, propagate_backward_time: 1014.8794555664, weight_update_time: 0.9726163149, other_time: 15.4689331055
epoch time: 144.3074951172s, input_fired_time: 1.6462464333, output_fired_time: 0.0000000000, propagate_forward_time: 140.2409667969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4202880859
validation[          , genome  6408] predictions:    6541/  10000 (65.41%), best:    6541/10000 (65.41%), error:      9961.73145, best error:      9961.73145 on epoch:    89, epoch:   89/100, mu: 0.9889035821, learning_rate: 0.0000095088, weight_decay: 0.0000071359

epoch time: 1758.7912597656s, input_fired_time: 19.2430000305, output_fired_time: 9.8674345016, propagate_forward_time: 701.9053955078, propagate_backward_time: 1012.8176269531, weight_update_time: 0.9944953918, other_time: 14.9577636719
epoch time: 154.8522796631s, input_fired_time: 1.5648187399, output_fired_time: 0.0000000000, propagate_forward_time: 140.8643646240, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.4230957031
validation[          , genome  6408] predictions:    6533/  10000 (65.33%), best:    6533/10000 (65.33%), error:      9939.35156, best error:      9939.35156 on epoch:    90, epoch:   90/100, mu: 0.9889751673, learning_rate: 0.0000089106, weight_decay: 0.0000068237

epoch time: 1761.4958496094s, input_fired_time: 19.3581085205, output_fired_time: 9.9587879181, propagate_forward_time: 708.6743774414, propagate_backward_time: 1008.0055541992, weight_update_time: 1.0173370838, other_time: 15.4990234375
epoch time: 143.5784759521s, input_fired_time: 1.5900131464, output_fired_time: 0.0000000000, propagate_forward_time: 139.4400177002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5484466553
validation[          , genome  6408] predictions:    6514/  10000 (65.14%), best:    6533/10000 (65.33%), error:      9967.21777, best error:      9939.35156 on epoch:    90, epoch:   91/100, mu: 0.9890421033, learning_rate: 0.0000083500, weight_decay: 0.0000065253

epoch time: 1762.7824707031s, input_fired_time: 19.2315044403, output_fired_time: 9.8231077194, propagate_forward_time: 709.1877441406, propagate_backward_time: 1009.3525390625, weight_update_time: 0.9988207221, other_time: 15.1876220703
epoch time: 144.7354278564s, input_fired_time: 1.5998400450, output_fired_time: 0.0000000000, propagate_forward_time: 140.6688537598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4667358398
validation[          , genome  6408] predictions:    6536/  10000 (65.36%), best:    6533/10000 (65.33%), error:     10014.18066, best error:      9939.35156 on epoch:    90, epoch:   92/100, mu: 0.9891046286, learning_rate: 0.0000078247, weight_decay: 0.0000062399

epoch time: 1747.2863769531s, input_fired_time: 19.0829296112, output_fired_time: 9.7972326279, propagate_forward_time: 697.0115966797, propagate_backward_time: 1006.3850708008, weight_update_time: 0.9876703620, other_time: 15.0095825195
epoch time: 162.1259307861s, input_fired_time: 1.9014947414, output_fired_time: 0.0000000000, propagate_forward_time: 157.3803253174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8441162109
validation[          , genome  6408] predictions:    6523/  10000 (65.23%), best:    6523/10000 (65.23%), error:      9933.63184, best error:      9933.63184 on epoch:    93, epoch:   93/100, mu: 0.9891631007, learning_rate: 0.0000073324, weight_decay: 0.0000059670

epoch time: 1757.2995605469s, input_fired_time: 19.2718238831, output_fired_time: 9.9675941467, propagate_forward_time: 693.3477172852, propagate_backward_time: 1019.3421020508, weight_update_time: 1.0020861626, other_time: 15.3703002930
epoch time: 143.3945159912s, input_fired_time: 1.7030750513, output_fired_time: 0.0000000000, propagate_forward_time: 139.1159210205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5755157471
validation[          , genome  6408] predictions:    6516/  10000 (65.16%), best:    6523/10000 (65.23%), error:      9967.35059, best error:      9933.63184 on epoch:    93, epoch:   94/100, mu: 0.9892177582, learning_rate: 0.0000068711, weight_decay: 0.0000057060

epoch time: 1752.9593505859s, input_fired_time: 19.2864341736, output_fired_time: 10.0059232712, propagate_forward_time: 691.8294677734, propagate_backward_time: 1016.4299316406, weight_update_time: 1.0847822428, other_time: 15.4075927734
epoch time: 143.7295837402s, input_fired_time: 1.6194608212, output_fired_time: 0.0000000000, propagate_forward_time: 139.4963073730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6138153076
validation[          , genome  6408] predictions:    6498/  10000 (64.98%), best:    6498/10000 (64.98%), error:      9926.83594, best error:      9926.83594 on epoch:    95, epoch:   95/100, mu: 0.9892688394, learning_rate: 0.0000064388, weight_decay: 0.0000054564

epoch time: 1749.4786376953s, input_fired_time: 19.4641551971, output_fired_time: 9.9055242538, propagate_forward_time: 690.8112792969, propagate_backward_time: 1013.7135620117, weight_update_time: 1.0085248947, other_time: 15.5841674805
epoch time: 142.6904449463s, input_fired_time: 1.5514010191, output_fired_time: 0.0000000000, propagate_forward_time: 138.6397094727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4993286133
validation[          , genome  6408] predictions:    6530/  10000 (65.30%), best:    6498/10000 (64.98%), error:      9993.67676, best error:      9926.83594 on epoch:    95, epoch:   96/100, mu: 0.9893165827, learning_rate: 0.0000060337, weight_decay: 0.0000052178

epoch time: 1748.8793945313s, input_fired_time: 19.2614822388, output_fired_time: 9.8720979691, propagate_forward_time: 689.4523315430, propagate_backward_time: 1014.6771850586, weight_update_time: 1.0171078444, other_time: 15.6162719727
epoch time: 147.1580657959s, input_fired_time: 1.6596339941, output_fired_time: 0.0000000000, propagate_forward_time: 142.8515167236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6469116211
validation[          , genome  6408] predictions:    6510/  10000 (65.10%), best:    6498/10000 (64.98%), error:      9988.35840, best error:      9926.83594 on epoch:    95, epoch:   97/100, mu: 0.9893612266, learning_rate: 0.0000056541, weight_decay: 0.0000049895

epoch time: 1740.0794677734s, input_fired_time: 19.5014305115, output_fired_time: 10.0204401016, propagate_forward_time: 685.0208129883, propagate_backward_time: 1009.6088256836, weight_update_time: 1.0715487003, other_time: 15.9280395508
epoch time: 141.3802490234s, input_fired_time: 1.6706773043, output_fired_time: 0.0000000000, propagate_forward_time: 137.0452880859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6642761230
validation[          , genome  6408] predictions:    6511/  10000 (65.11%), best:    6498/10000 (64.98%), error:     10013.89160, best error:      9926.83594 on epoch:    95, epoch:   98/100, mu: 0.9894029498, learning_rate: 0.0000052984, weight_decay: 0.0000047713

epoch time: 1724.7962646484s, input_fired_time: 19.4344387054, output_fired_time: 9.8796777725, propagate_forward_time: 680.3697509766, propagate_backward_time: 999.3388671875, weight_update_time: 0.9883762002, other_time: 15.7735595703
epoch time: 140.0859832764s, input_fired_time: 1.6322729588, output_fired_time: 0.0000000000, propagate_forward_time: 135.8440093994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6096954346
validation[          , genome  6408] predictions:    6496/  10000 (64.96%), best:    6498/10000 (64.98%), error:      9955.84180, best error:      9926.83594 on epoch:    95, epoch:   99/100, mu: 0.9894419312, learning_rate: 0.0000049650, weight_decay: 0.0000045626

epoch time: 1716.2991943359s, input_fired_time: 19.3982372284, output_fired_time: 9.9373655319, propagate_forward_time: 678.1334838867, propagate_backward_time: 993.1292724609, weight_update_time: 1.0380820036, other_time: 15.7008666992
epoch time: 140.3204040527s, input_fired_time: 1.5984936953, output_fired_time: 0.0000000000, propagate_forward_time: 136.1413116455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5805969238
validation[          , genome  6408] predictions:    6472/  10000 (64.72%), best:    6498/10000 (64.98%), error:     10030.47754, best error:      9926.83594 on epoch:    95, epoch:  100/100, mu: 0.9894783497, learning_rate: 0.0000046527, weight_decay: 0.0000043631

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 694.6253051758s, input_fired_time: 7.8675675392, output_fired_time: 0.0000000000, propagate_forward_time: 673.8555297852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.9022216797
best training[          , genome  6408] predictions:   37354/  50000 (74.71%), best:    6498/10000 (64.98%), error:     38979.35938, best error:      9926.83594 on epoch:    95, epoch:  101/100, mu: 0.9895123839, learning_rate: 0.0000043599, weight_decay: 0.0000041722
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 140.5221862793s, input_fired_time: 1.6156243086, output_fired_time: 0.0000000000, propagate_forward_time: 136.1895141602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7170410156
   testing[          , genome  6408] predictions:    6498/  10000 (64.98%), best:    6498/10000 (64.98%), error:      9926.83594, best error:      9926.83594 on epoch:    95, epoch:  101/100, mu: 0.9895123839, learning_rate: 0.0000043599, weight_decay: 0.0000041722
backpropagation finished successfully!
07:49:57 (18044): called boinc_finish(0)

</stderr_txt>
]]>