Nameexact_genome_1542727803_182_6427_1
Workunit4101344
Created20 Nov 2018, 20:18:16 UTC
Sent20 Nov 2018, 20:18:21 UTC
Report deadline9 Feb 2019, 7:24:16 UTC
Received24 Nov 2018, 7:12:45 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID88573
Run time1 days 12 hours 53 min 46 sec
CPU time1 days 12 hours 53 min 46 sec
Validate stateValid
Credit20,115.61
Device peak FLOPS3.35 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size523.36 MB
Peak swap size522.20 MB
Peak disk usage10.57 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
orward_time: 95.4329986572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6721649170
validation[          , genome  6427] predictions:    5326/  10000 (53.26%), best:    5398/10000 (53.98%), error:     14285.02051, best error:     14028.33984 on epoch:    13, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 1278.8635253906s, input_fired_time: 11.2377729416, output_fired_time: 10.5733795166, propagate_forward_time: 491.2072448730, propagate_backward_time: 750.1256713867, weight_update_time: 1.4477014542, other_time: 15.7194213867
epoch time: 125.8458862305s, input_fired_time: 1.6616547108, output_fired_time: 0.0000000000, propagate_forward_time: 121.1049652100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0792694092
validation[          , genome  6427] predictions:    5104/  10000 (51.04%), best:    5398/10000 (53.98%), error:     15518.41699, best error:     14028.33984 on epoch:    13, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 1216.7330322266s, input_fired_time: 10.7041282654, output_fired_time: 9.9845247269, propagate_forward_time: 466.7512512207, propagate_backward_time: 714.4124755859, weight_update_time: 1.3859800100, other_time: 14.8807373047
epoch time: 76.5289459229s, input_fired_time: 1.1607050896, output_fired_time: 0.0000000000, propagate_forward_time: 72.9210586548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4471817017
validation[          , genome  6427] predictions:    5368/  10000 (53.68%), best:    5398/10000 (53.98%), error:     14505.31641, best error:     14028.33984 on epoch:    13, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 1162.8326416016s, input_fired_time: 10.9149713516, output_fired_time: 9.6942605972, propagate_forward_time: 443.6517639160, propagate_backward_time: 682.8277587891, weight_update_time: 1.3806118965, other_time: 15.7440185547
epoch time: 125.7475051880s, input_fired_time: 1.6926507950, output_fired_time: 0.0000000000, propagate_forward_time: 120.9623260498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0925292969
validation[          , genome  6427] predictions:    5562/  10000 (55.62%), best:    5562/10000 (55.62%), error:     13754.12109, best error:     13754.12109 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 1120.7155761719s, input_fired_time: 10.6910219193, output_fired_time: 9.3390779495, propagate_forward_time: 425.6256103516, propagate_backward_time: 659.4439697266, weight_update_time: 1.3553383350, other_time: 15.6158447266
epoch time: 99.5034866333s, input_fired_time: 1.4452786446, output_fired_time: 0.0000000000, propagate_forward_time: 95.1909255981, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8672790527
validation[          , genome  6427] predictions:    5410/  10000 (54.10%), best:    5562/10000 (55.62%), error:     13989.62891, best error:     13754.12109 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 1292.6229248047s, input_fired_time: 11.2800693512, output_fired_time: 10.6627674103, propagate_forward_time: 497.1616210938, propagate_backward_time: 757.9371948242, weight_update_time: 1.4491199255, other_time: 15.5813598633
epoch time: 78.4580917358s, input_fired_time: 1.1772184372, output_fired_time: 0.0000000000, propagate_forward_time: 74.8184127808, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4624633789
validation[          , genome  6427] predictions:    5676/  10000 (56.76%), best:    5676/10000 (56.76%), error:     13115.83301, best error:     13115.83301 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 1119.8118896484s, input_fired_time: 10.2326021194, output_fired_time: 9.1886186600, propagate_forward_time: 426.4133605957, propagate_backward_time: 659.5371093750, weight_update_time: 1.3189561367, other_time: 14.4403076172
epoch time: 84.4699630737s, input_fired_time: 1.2142275572, output_fired_time: 0.0000000000, propagate_forward_time: 80.7223358154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5334014893
validation[          , genome  6427] predictions:    5393/  10000 (53.93%), best:    5676/10000 (56.76%), error:     14365.12500, best error:     13115.83301 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1269.1695556641s, input_fired_time: 11.0313453674, output_fired_time: 10.4185743332, propagate_forward_time: 488.6133728027, propagate_backward_time: 743.9376831055, weight_update_time: 1.4253664017, other_time: 15.1685180664
epoch time: 90.5083236694s, input_fired_time: 1.2951492071, output_fired_time: 0.0000000000, propagate_forward_time: 86.6318206787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5813522339
validation[          , genome  6427] predictions:    5496/  10000 (54.96%), best:    5676/10000 (56.76%), error:     13875.98633, best error:     13115.83301 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 1300.0013427734s, input_fired_time: 11.2394542694, output_fired_time: 10.6895046234, propagate_forward_time: 500.1921691895, propagate_backward_time: 762.4819946289, weight_update_time: 1.4470013380, other_time: 15.3982543945
epoch time: 127.2313156128s, input_fired_time: 1.6887290478, output_fired_time: 0.0000000000, propagate_forward_time: 122.4601287842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0824584961
validation[          , genome  6427] predictions:    5460/  10000 (54.60%), best:    5676/10000 (56.76%), error:     14176.25586, best error:     13115.83301 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 1338.1959228516s, input_fired_time: 11.8417282104, output_fired_time: 11.1116609573, propagate_forward_time: 514.9464111328, propagate_backward_time: 783.7094116211, weight_update_time: 1.5052595139, other_time: 16.5867309570
epoch time: 126.0990829468s, input_fired_time: 1.6511386633, output_fired_time: 0.0000000000, propagate_forward_time: 121.3474502563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1004943848
validation[          , genome  6427] predictions:    5278/  10000 (52.78%), best:    5676/10000 (56.76%), error:     15125.70996, best error:     13115.83301 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 1272.4842529297s, input_fired_time: 11.3005943298, output_fired_time: 10.5057802200, propagate_forward_time: 488.4151611328, propagate_backward_time: 746.6061401367, weight_update_time: 1.4402232170, other_time: 15.6566772461
epoch time: 66.4318084717s, input_fired_time: 1.0892399549, output_fired_time: 0.0000000000, propagate_forward_time: 62.9936370850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3489303589
validation[          , genome  6427] predictions:    5636/  10000 (56.36%), best:    5676/10000 (56.76%), error:     13495.57617, best error:     13115.83301 on epoch:    20, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 1151.7568359375s, input_fired_time: 10.4429178238, output_fired_time: 9.4902811050, propagate_forward_time: 439.6289367676, propagate_backward_time: 677.5680541992, weight_update_time: 1.3456006050, other_time: 14.6267700195
epoch time: 125.5192031860s, input_fired_time: 1.6401653290, output_fired_time: 0.0000000000, propagate_forward_time: 120.9197082520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9593276978
validation[          , genome  6427] predictions:    5777/  10000 (57.77%), best:    5777/10000 (57.77%), error:     12723.77441, best error:     12723.77441 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 1392.7910156250s, input_fired_time: 12.1317901611, output_fired_time: 11.5463066101, propagate_forward_time: 537.8043212891, propagate_backward_time: 814.3511962891, weight_update_time: 1.5406603813, other_time: 16.9573974609
epoch time: 116.2715682983s, input_fired_time: 1.5406429768, output_fired_time: 0.0000000000, propagate_forward_time: 111.8984069824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8325195313
validation[          , genome  6427] predictions:    5613/  10000 (56.13%), best:    5777/10000 (57.77%), error:     13276.05371, best error:     12723.77441 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 1151.6995849609s, input_fired_time: 10.4854660034, output_fired_time: 9.4638175964, propagate_forward_time: 439.7020568848, propagate_backward_time: 677.4664916992, weight_update_time: 1.3405748606, other_time: 14.5817260742
epoch time: 72.9656677246s, input_fired_time: 1.1323752403, output_fired_time: 0.0000000000, propagate_forward_time: 69.3482055664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4850845337
validation[          , genome  6427] predictions:    5393/  10000 (53.93%), best:    5777/10000 (57.77%), error:     13851.62891, best error:     12723.77441 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 1155.8408203125s, input_fired_time: 10.6929235458, output_fired_time: 9.5737934113, propagate_forward_time: 439.7619934082, propagate_backward_time: 680.4811401367, weight_update_time: 1.3587784767, other_time: 15.3309936523
epoch time: 72.5059661865s, input_fired_time: 1.1467064619, output_fired_time: 0.0000000000, propagate_forward_time: 68.8712615967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4879989624
validation[          , genome  6427] predictions:    5710/  10000 (57.10%), best:    5777/10000 (57.77%), error:     13109.04785, best error:     12723.77441 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 1284.5714111328s, input_fired_time: 11.3712863922, output_fired_time: 10.6325740814, propagate_forward_time: 493.5827941895, propagate_backward_time: 752.9907226563, weight_update_time: 1.4480035305, other_time: 15.9940185547
epoch time: 115.7305450439s, input_fired_time: 1.6104255915, output_fired_time: 0.0000000000, propagate_forward_time: 111.1211090088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9990081787
validation[          , genome  6427] predictions:    5745/  10000 (57.45%), best:    5777/10000 (57.77%), error:     12948.11035, best error:     12723.77441 on epoch:    26, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1307.2880859375s, input_fired_time: 11.3813314438, output_fired_time: 10.7751865387, propagate_forward_time: 503.7370300293, propagate_backward_time: 765.8342285156, weight_update_time: 1.4501432180, other_time: 15.5603027344
epoch time: 107.5106353760s, input_fired_time: 1.4564411640, output_fired_time: 0.0000000000, propagate_forward_time: 103.2542037964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7999877930
validation[          , genome  6427] predictions:    5519/  10000 (55.19%), best:    5777/10000 (57.77%), error:     13792.20020, best error:     12723.77441 on epoch:    26, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1267.4356689453s, input_fired_time: 11.5032558441, output_fired_time: 10.5304393768, propagate_forward_time: 486.3428955078, propagate_backward_time: 742.6479492188, weight_update_time: 1.4517807961, other_time: 16.4111328125
epoch time: 78.5853118896s, input_fired_time: 1.2704360485, output_fired_time: 0.0000000000, propagate_forward_time: 74.6956405640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6192321777
validation[          , genome  6427] predictions:    5863/  10000 (58.63%), best:    5863/10000 (58.63%), error:     12632.73438, best error:     12632.73438 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 1254.5649414063s, input_fired_time: 11.5154733658, output_fired_time: 10.4880084991, propagate_forward_time: 478.7064208984, propagate_backward_time: 736.8214111328, weight_update_time: 1.4435034990, other_time: 17.0335693359
epoch time: 104.5539627075s, input_fired_time: 1.4921489954, output_fired_time: 0.0000000000, propagate_forward_time: 100.1787872314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8830261230
validation[          , genome  6427] predictions:    5552/  10000 (55.52%), best:    5863/10000 (58.63%), error:     13910.30371, best error:     12632.73438 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1345.1003417969s, input_fired_time: 11.8463258743, output_fired_time: 11.2144451141, propagate_forward_time: 515.3950195313, propagate_backward_time: 789.3217773438, weight_update_time: 1.4995633364, other_time: 17.3227539063
epoch time: 125.7343368530s, input_fired_time: 1.6566902399, output_fired_time: 0.0000000000, propagate_forward_time: 121.1283493042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9492950439
validation[          , genome  6427] predictions:    5790/  10000 (57.90%), best:    5863/10000 (58.63%), error:     12878.44824, best error:     12632.73438 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1197.3782958984s, input_fired_time: 11.1686258316, output_fired_time: 9.9501113892, propagate_forward_time: 458.3565673828, propagate_backward_time: 702.0903930664, weight_update_time: 1.4083476067, other_time: 15.8126831055
epoch time: 97.9594345093s, input_fired_time: 1.4487035275, output_fired_time: 0.0000000000, propagate_forward_time: 93.6976089478, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8131256104
validation[          , genome  6427] predictions:    5861/  10000 (58.61%), best:    5863/10000 (58.63%), error:     12634.32813, best error:     12632.73438 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1253.7023925781s, input_fired_time: 11.2576541901, output_fired_time: 10.3711175919, propagate_forward_time: 479.6453552246, propagate_backward_time: 736.4603881836, weight_update_time: 1.4224098921, other_time: 15.9678344727
epoch time: 118.3313217163s, input_fired_time: 1.5914826393, output_fired_time: 0.0000000000, propagate_forward_time: 113.8734054565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8664321899
validation[          , genome  6427] predictions:    5840/  10000 (58.40%), best:    5863/10000 (58.63%), error:     12846.31934, best error:     12632.73438 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1237.9985351563s, input_fired_time: 11.5554218292, output_fired_time: 10.4443559647, propagate_forward_time: 468.8408508301, propagate_backward_time: 728.5795898438, weight_update_time: 1.4379258156, other_time: 18.5783691406
epoch time: 86.2369689941s, input_fired_time: 1.3527220488, output_fired_time: 0.0000000000, propagate_forward_time: 82.1863708496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6978759766
validation[          , genome  6427] predictions:    5819/  10000 (58.19%), best:    5863/10000 (58.63%), error:     12881.46191, best error:     12632.73438 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 1162.9276123047s, input_fired_time: 11.0251350403, output_fired_time: 9.6778726578, propagate_forward_time: 443.4737548828, propagate_backward_time: 683.1366577148, weight_update_time: 1.3865493536, other_time: 15.6141967773
epoch time: 81.1527328491s, input_fired_time: 1.2382447720, output_fired_time: 0.0000000000, propagate_forward_time: 76.9363555908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9781341553
validation[          , genome  6427] predictions:    5799/  10000 (57.99%), best:    5863/10000 (58.63%), error:     13236.55664, best error:     12632.73438 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 1156.3104248047s, input_fired_time: 10.7505779266, output_fired_time: 9.6787128448, propagate_forward_time: 436.3628234863, propagate_backward_time: 682.8227539063, weight_update_time: 1.3612176180, other_time: 16.6955566406
epoch time: 67.6579132080s, input_fired_time: 1.1287094355, output_fired_time: 0.0000000000, propagate_forward_time: 64.0197830200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5094223022
validation[          , genome  6427] predictions:    5890/  10000 (58.90%), best:    5890/10000 (58.90%), error:     12578.45410, best error:     12578.45410 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 1371.7811279297s, input_fired_time: 11.8879814148, output_fired_time: 11.5048694611, propagate_forward_time: 524.6703491211, propagate_backward_time: 806.0079956055, weight_update_time: 1.5163565874, other_time: 17.7099609375
epoch time: 95.7474517822s, input_fired_time: 1.4435367584, output_fired_time: 0.0000000000, propagate_forward_time: 91.5034179688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8004989624
validation[          , genome  6427] predictions:    5968/  10000 (59.68%), best:    5968/10000 (59.68%), error:     12541.58105, best error:     12541.58105 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 1067.4914550781s, input_fired_time: 10.2413024902, output_fired_time: 8.9565601349, propagate_forward_time: 399.8255920410, propagate_backward_time: 632.2879638672, weight_update_time: 1.3023761511, other_time: 16.1800537109
epoch time: 95.3496856689s, input_fired_time: 1.3912806511, output_fired_time: 0.0000000000, propagate_forward_time: 90.9552230835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0031814575
validation[          , genome  6427] predictions:    5920/  10000 (59.20%), best:    5920/10000 (59.20%), error:     12525.92285, best error:     12525.92285 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 1253.0965576172s, input_fired_time: 11.2697887421, output_fired_time: 10.3780097961, propagate_forward_time: 479.7324829102, propagate_backward_time: 735.7691040039, weight_update_time: 1.4215644598, other_time: 15.9471435547
epoch time: 120.8651809692s, input_fired_time: 1.6425895691, output_fired_time: 0.0000000000, propagate_forward_time: 115.8178634644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4047317505
validation[          , genome  6427] predictions:    5996/  10000 (59.96%), best:    5996/10000 (59.96%), error:     12150.10352, best error:     12150.10352 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 1199.1094970703s, input_fired_time: 11.0358505249, output_fired_time: 10.1243543625, propagate_forward_time: 450.8917236328, propagate_backward_time: 709.3427734375, weight_update_time: 1.4002325535, other_time: 17.7147216797
epoch time: 109.2510986328s, input_fired_time: 1.5010398626, output_fired_time: 0.0000000000, propagate_forward_time: 104.4618530273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2882080078
validation[          , genome  6427] predictions:    5827/  10000 (58.27%), best:    5996/10000 (59.96%), error:     12734.78027, best error:     12150.10352 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 1246.5057373047s, input_fired_time: 11.1824026108, output_fired_time: 10.4447250366, propagate_forward_time: 472.5310363770, propagate_backward_time: 735.0157470703, weight_update_time: 1.4276578426, other_time: 17.3319091797
epoch time: 80.6249923706s, input_fired_time: 1.2416129112, output_fired_time: 0.0000000000, propagate_forward_time: 76.7850799561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5982971191
validation[          , genome  6427] predictions:    5933/  10000 (59.33%), best:    5996/10000 (59.96%), error:     12204.59863, best error:     12150.10352 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 1112.9752197266s, input_fired_time: 10.4907712936, output_fired_time: 9.2089042664, propagate_forward_time: 420.9501342773, propagate_backward_time: 657.0551147461, weight_update_time: 1.3253231049, other_time: 15.2703857422
epoch time: 105.2778244019s, input_fired_time: 1.4889743328, output_fired_time: 0.0000000000, propagate_forward_time: 100.8830032349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9058456421
validation[          , genome  6427] predictions:    5953/  10000 (59.53%), best:    5996/10000 (59.96%), error:     12280.28320, best error:     12150.10352 on epoch:    42, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 1190.7277832031s, input_fired_time: 10.9871511459, output_fired_time: 9.8439521790, propagate_forward_time: 452.5180358887, propagate_backward_time: 701.2492675781, weight_update_time: 1.3819215298, other_time: 16.1292724609
epoch time: 116.7840118408s, input_fired_time: 1.6460487843, output_fired_time: 0.0000000000, propagate_forward_time: 110.5215682983, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6163940430
validation[          , genome  6427] predictions:    5993/  10000 (59.93%), best:    5996/10000 (59.96%), error:     12576.99316, best error:     12150.10352 on epoch:    42, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 1355.1958007813s, input_fired_time: 12.1889104843, output_fired_time: 11.4116544724, propagate_forward_time: 516.9780883789, propagate_backward_time: 794.8377075195, weight_update_time: 1.5311158895, other_time: 19.7794189453
epoch time: 110.3054351807s, input_fired_time: 1.5584852695, output_fired_time: 0.0000000000, propagate_forward_time: 104.8281936646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9187545776
validation[          , genome  6427] predictions:    5777/  10000 (57.77%), best:    5996/10000 (59.96%), error:     12853.02148, best error:     12150.10352 on epoch:    42, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1253.8369140625s, input_fired_time: 11.3517494202, output_fired_time: 10.4436283112, propagate_forward_time: 478.9434204102, propagate_backward_time: 736.5447998047, weight_update_time: 1.4360173941, other_time: 16.5532836914
epoch time: 77.2731094360s, input_fired_time: 1.2165753841, output_fired_time: 0.0000000000, propagate_forward_time: 73.5587615967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4977722168
validation[          , genome  6427] predictions:    5925/  10000 (59.25%), best:    5996/10000 (59.96%), error:     12469.62793, best error:     12150.10352 on epoch:    42, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1221.7193603516s, input_fired_time: 11.1464509964, output_fired_time: 10.1491918564, propagate_forward_time: 465.1022033691, propagate_backward_time: 718.8013916016, weight_update_time: 1.4049224854, other_time: 16.5201416016
epoch time: 99.6605682373s, input_fired_time: 1.4159597158, output_fired_time: 0.0000000000, propagate_forward_time: 94.6368560791, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6077499390
validation[          , genome  6427] predictions:    5829/  10000 (58.29%), best:    5996/10000 (59.96%), error:     13000.80957, best error:     12150.10352 on epoch:    42, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 1244.9711914063s, input_fired_time: 11.5985965729, output_fired_time: 10.5096731186, propagate_forward_time: 471.8251342773, propagate_backward_time: 732.1961669922, weight_update_time: 1.4472776651, other_time: 18.8416137695
epoch time: 109.0782699585s, input_fired_time: 1.6079790592, output_fired_time: 0.0000000000, propagate_forward_time: 104.4635391235, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0067520142
validation[          , genome  6427] predictions:    5800/  10000 (58.00%), best:    5996/10000 (59.96%), error:     12923.04297, best error:     12150.10352 on epoch:    42, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 1172.9388427734s, input_fired_time: 10.9138536453, output_fired_time: 9.7970790863, propagate_forward_time: 443.4739990234, propagate_backward_time: 692.5003051758, weight_update_time: 1.3744951487, other_time: 16.2536010742
epoch time: 79.8267593384s, input_fired_time: 1.2580230236, output_fired_time: 0.0000000000, propagate_forward_time: 76.0547943115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5139389038
validation[          , genome  6427] predictions:    5916/  10000 (59.16%), best:    5996/10000 (59.96%), error:     12503.50098, best error:     12150.10352 on epoch:    42, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 1169.7299804688s, input_fired_time: 10.8549375534, output_fired_time: 9.7480506897, propagate_forward_time: 442.4509887695, propagate_backward_time: 690.1399536133, weight_update_time: 1.3709928989, other_time: 16.5360107422
epoch time: 118.0577850342s, input_fired_time: 1.5886830091, output_fired_time: 0.0000000000, propagate_forward_time: 113.5865936279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8825073242
validation[          , genome  6427] predictions:    5979/  10000 (59.79%), best:    5996/10000 (59.96%), error:     12212.01563, best error:     12150.10352 on epoch:    42, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 1237.6124267578s, input_fired_time: 11.2259511948, output_fired_time: 10.3823661804, propagate_forward_time: 468.9448242188, propagate_backward_time: 729.4996948242, weight_update_time: 1.4253575802, other_time: 17.5596313477
epoch time: 85.5061645508s, input_fired_time: 1.3023954630, output_fired_time: 0.0000000000, propagate_forward_time: 81.5118637085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6919021606
validation[          , genome  6427] predictions:    5923/  10000 (59.23%), best:    5996/10000 (59.96%), error:     12361.02637, best error:     12150.10352 on epoch:    42, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 975.8839111328s, input_fired_time: 10.2627582550, output_fired_time: 8.1463527679, propagate_forward_time: 365.3385620117, propagate_backward_time: 577.0245361328, weight_update_time: 1.2518568039, other_time: 15.1116943359
epoch time: 100.4045639038s, input_fired_time: 1.5866830349, output_fired_time: 0.0000000000, propagate_forward_time: 94.5811462402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2367324829
validation[          , genome  6427] predictions:    6123/  10000 (61.23%), best:    6123/10000 (61.23%), error:     12044.55469, best error:     12044.55469 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 960.7589111328s, input_fired_time: 9.7819852829, output_fired_time: 7.9675955772, propagate_forward_time: 359.9226379395, propagate_backward_time: 568.7628784180, weight_update_time: 1.2204875946, other_time: 14.3237915039
epoch time: 102.9621047974s, input_fired_time: 1.4859207869, output_fired_time: 0.0000000000, propagate_forward_time: 98.2491683960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2270126343
validation[          , genome  6427] predictions:    5934/  10000 (59.34%), best:    6123/10000 (61.23%), error:     12615.33301, best error:     12044.55469 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 1249.8028564453s, input_fired_time: 11.9162712097, output_fired_time: 10.6310014725, propagate_forward_time: 471.2125549316, propagate_backward_time: 734.9727783203, weight_update_time: 1.4677591324, other_time: 21.0703125000
epoch time: 89.8998031616s, input_fired_time: 1.4839522839, output_fired_time: 0.0000000000, propagate_forward_time: 84.0970611572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3187866211
validation[          , genome  6427] predictions:    5992/  10000 (59.92%), best:    6123/10000 (61.23%), error:     12230.74609, best error:     12044.55469 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 1108.5324707031s, input_fired_time: 11.1909198761, output_fired_time: 9.3931417465, propagate_forward_time: 417.1527709961, propagate_backward_time: 652.3530273438, weight_update_time: 1.3651884794, other_time: 18.4425659180
epoch time: 81.5535964966s, input_fired_time: 1.3635349274, output_fired_time: 0.0000000000, propagate_forward_time: 77.2112350464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9788284302
validation[          , genome  6427] predictions:    6032/  10000 (60.32%), best:    6032/10000 (60.32%), error:     12015.51074, best error:     12015.51074 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 1094.0524902344s, input_fired_time: 11.0790014267, output_fired_time: 9.3113718033, propagate_forward_time: 409.5170898438, propagate_backward_time: 645.3018188477, weight_update_time: 1.3527776003, other_time: 18.8432006836
epoch time: 91.8761978149s, input_fired_time: 1.4716217518, output_fired_time: 0.0000000000, propagate_forward_time: 87.0615081787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3430709839
validation[          , genome  6427] predictions:    6037/  10000 (60.37%), best:    6037/10000 (60.37%), error:     11943.78027, best error:     11943.78027 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 1224.1665039063s, input_fired_time: 11.8379898071, output_fired_time: 10.3899984360, propagate_forward_time: 461.8975524902, propagate_backward_time: 719.6359252930, weight_update_time: 1.4502956867, other_time: 20.4049682617
epoch time: 76.8811111450s, input_fired_time: 1.3127624989, output_fired_time: 0.0000000000, propagate_forward_time: 72.7282562256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8400955200
validation[          , genome  6427] predictions:    6091/  10000 (60.91%), best:    6037/10000 (60.37%), error:     12097.63379, best error:     11943.78027 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 1150.1461181641s, input_fired_time: 11.1893196106, output_fired_time: 9.6935720444, propagate_forward_time: 433.0303344727, propagate_backward_time: 677.6185913086, weight_update_time: 1.3890918493, other_time: 18.6142578125
epoch time: 87.4076766968s, input_fired_time: 1.3748234510, output_fired_time: 0.0000000000, propagate_forward_time: 83.3041458130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7287063599
validation[          , genome  6427] predictions:    5931/  10000 (59.31%), best:    6037/10000 (60.37%), error:     12417.62109, best error:     11943.78027 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 1139.9053955078s, input_fired_time: 11.3109655380, output_fired_time: 9.7461843491, propagate_forward_time: 426.0286560059, propagate_backward_time: 673.0922851563, weight_update_time: 1.3928552866, other_time: 19.7272949219
epoch time: 110.6781845093s, input_fired_time: 1.6295180321, output_fired_time: 0.0000000000, propagate_forward_time: 104.3433990479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7052688599
validation[          , genome  6427] predictions:    5863/  10000 (58.63%), best:    6037/10000 (60.37%), error:     12562.98535, best error:     11943.78027 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 1072.5024414063s, input_fired_time: 10.4913921356, output_fired_time: 8.9858455658, propagate_forward_time: 402.5564270020, propagate_backward_time: 633.9000244141, weight_update_time: 1.3130192757, other_time: 16.5688476563
epoch time: 108.4813156128s, input_fired_time: 1.5557675362, output_fired_time: 0.0000000000, propagate_forward_time: 103.1592407227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7663040161
validation[          , genome  6427] predictions:    6088/  10000 (60.88%), best:    6088/10000 (60.88%), error:     11847.72852, best error:     11847.72852 on epoch:    62, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 1335.6890869141s, input_fired_time: 11.8919353485, output_fired_time: 11.2262697220, propagate_forward_time: 510.0316162109, propagate_backward_time: 784.3255615234, weight_update_time: 1.4874385595, other_time: 18.2136230469
epoch time: 80.6922912598s, input_fired_time: 1.2839033604, output_fired_time: 0.0000000000, propagate_forward_time: 76.8313827515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5770034790
validation[          , genome  6427] predictions:    6135/  10000 (61.35%), best:    6135/10000 (61.35%), error:     11783.86719, best error:     11783.86719 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 1152.4033203125s, input_fired_time: 10.9164266586, output_fired_time: 9.8191909790, propagate_forward_time: 430.1344604492, propagate_backward_time: 683.1575317383, weight_update_time: 1.3752537966, other_time: 18.3757324219
epoch time: 91.5540847778s, input_fired_time: 1.3996094465, output_fired_time: 0.0000000000, propagate_forward_time: 86.7177124023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4367599487
validation[          , genome  6427] predictions:    6137/  10000 (61.37%), best:    6137/10000 (61.37%), error:     11646.75391, best error:     11646.75391 on epoch:    64, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 1197.3602294922s, input_fired_time: 11.1815042496, output_fired_time: 9.9933586121, propagate_forward_time: 454.7771606445, propagate_backward_time: 704.8274536133, weight_update_time: 1.3913463354, other_time: 16.5806884766
epoch time: 67.5128631592s, input_fired_time: 1.2363445759, output_fired_time: 0.0000000000, propagate_forward_time: 63.6972885132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5792312622
validation[          , genome  6427] predictions:    6138/  10000 (61.38%), best:    6137/10000 (61.37%), error:     11764.00781, best error:     11646.75391 on epoch:    64, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 1290.1137695313s, input_fired_time: 11.9666557312, output_fired_time: 10.8842754364, propagate_forward_time: 489.1951904297, propagate_backward_time: 759.0830078125, weight_update_time: 1.4780151844, other_time: 18.9846191406
epoch time: 118.1723480225s, input_fired_time: 1.6339398623, output_fired_time: 0.0000000000, propagate_forward_time: 113.0000076294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5383987427
validation[          , genome  6427] predictions:    6192/  10000 (61.92%), best:    6192/10000 (61.92%), error:     11555.22070, best error:     11555.22070 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 1105.3975830078s, input_fired_time: 11.1079692841, output_fired_time: 9.3939323425, propagate_forward_time: 412.9409179688, propagate_backward_time: 652.5785522461, weight_update_time: 1.3649139404, other_time: 19.3762817383
epoch time: 67.7707672119s, input_fired_time: 1.1640448570, output_fired_time: 0.0000000000, propagate_forward_time: 64.1075134277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4992065430
validation[          , genome  6427] predictions:    6092/  10000 (60.92%), best:    6192/10000 (61.92%), error:     11979.91602, best error:     11555.22070 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 1221.3563232422s, input_fired_time: 11.2703018188, output_fired_time: 10.4101972580, propagate_forward_time: 458.5220947266, propagate_backward_time: 721.9977416992, weight_update_time: 1.4253798723, other_time: 19.1560668945
epoch time: 108.3991622925s, input_fired_time: 1.5356446505, output_fired_time: 0.0000000000, propagate_forward_time: 102.4441375732, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4193801880
validation[          , genome  6427] predictions:    6030/  10000 (60.30%), best:    6192/10000 (61.92%), error:     11945.98340, best error:     11555.22070 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 1319.2561035156s, input_fired_time: 12.2648725510, output_fired_time: 11.3180198669, propagate_forward_time: 494.5758056641, propagate_backward_time: 778.5709228516, weight_update_time: 1.5224620104, other_time: 22.5264892578
epoch time: 102.8133773804s, input_fired_time: 1.5477448702, output_fired_time: 0.0000000000, propagate_forward_time: 97.4260406494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8395919800
validation[          , genome  6427] predictions:    6059/  10000 (60.59%), best:    6192/10000 (61.92%), error:     11782.96191, best error:     11555.22070 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 1122.6346435547s, input_fired_time: 10.8225612640, output_fired_time: 9.5197248459, propagate_forward_time: 420.3718261719, propagate_backward_time: 664.3861083984, weight_update_time: 1.3507490158, other_time: 17.5344238281
epoch time: 102.9541091919s, input_fired_time: 1.4970306158, output_fired_time: 0.0000000000, propagate_forward_time: 97.3308792114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1261978149
validation[          , genome  6427] predictions:    6187/  10000 (61.87%), best:    6187/10000 (61.87%), error:     11533.01953, best error:     11533.01953 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 1236.4729003906s, input_fired_time: 11.4491405487, output_fired_time: 10.6105298996, propagate_forward_time: 463.3459777832, propagate_backward_time: 731.8270263672, weight_update_time: 1.4364558458, other_time: 19.2403564453
epoch time: 112.8628921509s, input_fired_time: 1.5978512764, output_fired_time: 0.0000000000, propagate_forward_time: 108.0231857300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2418518066
validation[          , genome  6427] predictions:    6191/  10000 (61.91%), best:    6187/10000 (61.87%), error:     11603.56348, best error:     11533.01953 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 1211.3878173828s, input_fired_time: 11.3182964325, output_fired_time: 10.2192192078, propagate_forward_time: 456.9254150391, propagate_backward_time: 715.3528442383, weight_update_time: 1.4089081287, other_time: 17.5720825195
epoch time: 77.1238021851s, input_fired_time: 1.2671071291, output_fired_time: 0.0000000000, propagate_forward_time: 73.1834335327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6732635498
validation[          , genome  6427] predictions:    6244/  10000 (62.44%), best:    6244/10000 (62.44%), error:     11429.76367, best error:     11429.76367 on epoch:    72, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 1260.3155517578s, input_fired_time: 11.5955915451, output_fired_time: 10.7527208328, propagate_forward_time: 474.2197875977, propagate_backward_time: 744.6257324219, weight_update_time: 1.4479923248, other_time: 19.1217651367
epoch time: 89.9293975830s, input_fired_time: 1.3848344088, output_fired_time: 0.0000000000, propagate_forward_time: 85.3195877075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2249755859
validation[          , genome  6427] predictions:    6134/  10000 (61.34%), best:    6244/10000 (62.44%), error:     11817.66797, best error:     11429.76367 on epoch:    72, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 1263.2561035156s, input_fired_time: 12.1569070816, output_fired_time: 10.8074369431, propagate_forward_time: 475.3951721191, propagate_backward_time: 742.8999633789, weight_update_time: 1.4878402948, other_time: 21.9966430664
epoch time: 110.6380004883s, input_fired_time: 1.6376118660, output_fired_time: 0.0000000000, propagate_forward_time: 104.4093933105, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5909957886
validation[          , genome  6427] predictions:    6211/  10000 (62.11%), best:    6244/10000 (62.44%), error:     11710.59668, best error:     11429.76367 on epoch:    72, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 1204.6163330078s, input_fired_time: 11.8359708786, output_fired_time: 10.3608942032, propagate_forward_time: 449.8143310547, propagate_backward_time: 710.7647705078, weight_update_time: 1.4478089809, other_time: 21.8404541016
epoch time: 72.1299057007s, input_fired_time: 1.2881451845, output_fired_time: 0.0000000000, propagate_forward_time: 68.0988922119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7428665161
validation[          , genome  6427] predictions:    6154/  10000 (61.54%), best:    6244/10000 (62.44%), error:     11617.23047, best error:     11429.76367 on epoch:    72, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 1203.7921142578s, input_fired_time: 11.7776727676, output_fired_time: 10.2303953171, propagate_forward_time: 453.3658142090, propagate_backward_time: 709.0352783203, weight_update_time: 1.4379907846, other_time: 19.3829345703
epoch time: 79.3563232422s, input_fired_time: 1.3549091816, output_fired_time: 0.0000000000, propagate_forward_time: 74.6626358032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3387756348
validation[          , genome  6427] predictions:    6167/  10000 (61.67%), best:    6244/10000 (62.44%), error:     11930.26172, best error:     11429.76367 on epoch:    72, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 1167.2933349609s, input_fired_time: 11.6076335907, output_fired_time: 9.9550676346, propagate_forward_time: 437.5233154297, propagate_backward_time: 688.1334838867, weight_update_time: 1.4123311043, other_time: 20.0737915039
epoch time: 88.6282806396s, input_fired_time: 1.4645208120, output_fired_time: 0.0000000000, propagate_forward_time: 84.0326080322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1311492920
validation[          , genome  6427] predictions:    6184/  10000 (61.84%), best:    6244/10000 (62.44%), error:     11678.09863, best error:     11429.76367 on epoch:    72, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 1300.3071289063s, input_fired_time: 11.8462619781, output_fired_time: 11.0496625900, propagate_forward_time: 490.7435302734, propagate_backward_time: 767.7467651367, weight_update_time: 1.4736725092, other_time: 18.9208374023
epoch time: 89.9041442871s, input_fired_time: 1.4755522013, output_fired_time: 0.0000000000, propagate_forward_time: 84.7132339478, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7153549194
validation[          , genome  6427] predictions:    6200/  10000 (62.00%), best:    6244/10000 (62.44%), error:     11751.26563, best error:     11429.76367 on epoch:    72, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 1293.4154052734s, input_fired_time: 12.3202190399, output_fired_time: 11.0106525421, propagate_forward_time: 489.1768188477, propagate_backward_time: 760.4044799805, weight_update_time: 1.4988712072, other_time: 20.5032958984
epoch time: 111.1142425537s, input_fired_time: 1.6322019100, output_fired_time: 0.0000000000, propagate_forward_time: 105.7870330811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6950073242
validation[          , genome  6427] predictions:    6216/  10000 (62.16%), best:    6244/10000 (62.44%), error:     11667.97070, best error:     11429.76367 on epoch:    72, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1207.8673095703s, input_fired_time: 11.3817453384, output_fired_time: 10.2890205383, propagate_forward_time: 453.8063659668, propagate_backward_time: 713.8521118164, weight_update_time: 1.4176195860, other_time: 18.5380249023
epoch time: 76.8048400879s, input_fired_time: 1.3566094637, output_fired_time: 0.0000000000, propagate_forward_time: 72.3623733521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0858535767
validation[          , genome  6427] predictions:    6175/  10000 (61.75%), best:    6244/10000 (62.44%), error:     11798.78027, best error:     11429.76367 on epoch:    72, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1126.8533935547s, input_fired_time: 11.3105373383, output_fired_time: 9.5640926361, propagate_forward_time: 421.9001464844, propagate_backward_time: 665.3383789063, weight_update_time: 1.3763918877, other_time: 18.7402343750
epoch time: 109.9124679565s, input_fired_time: 1.5897910595, output_fired_time: 0.0000000000, propagate_forward_time: 104.7948608398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5278167725
validation[          , genome  6427] predictions:    6157/  10000 (61.57%), best:    6244/10000 (62.44%), error:     11744.55078, best error:     11429.76367 on epoch:    72, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1361.3933105469s, input_fired_time: 12.3860998154, output_fired_time: 11.5162363052, propagate_forward_time: 517.6123046875, propagate_backward_time: 800.0484008789, weight_update_time: 1.5226247311, other_time: 19.8302612305
epoch time: 94.4077758789s, input_fired_time: 1.5175021887, output_fired_time: 0.0000000000, propagate_forward_time: 89.0377273560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8525466919
validation[          , genome  6427] predictions:    6107/  10000 (61.07%), best:    6244/10000 (62.44%), error:     12170.85840, best error:     11429.76367 on epoch:    72, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 1164.5948486328s, input_fired_time: 11.2341499329, output_fired_time: 9.8546733856, propagate_forward_time: 437.6478576660, propagate_backward_time: 688.1337890625, weight_update_time: 1.3818557262, other_time: 17.7244873047
epoch time: 106.9608230591s, input_fired_time: 1.6888856888, output_fired_time: 0.0000000000, propagate_forward_time: 99.8829345703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3889999390
validation[          , genome  6427] predictions:    6240/  10000 (62.40%), best:    6244/10000 (62.44%), error:     11590.59961, best error:     11429.76367 on epoch:    72, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 1207.7210693359s, input_fired_time: 11.8184900284, output_fired_time: 10.1846942902, propagate_forward_time: 457.6713256836, propagate_backward_time: 709.8583374023, weight_update_time: 1.4287457466, other_time: 18.1882324219
epoch time: 109.8741912842s, input_fired_time: 1.6448982954, output_fired_time: 0.0000000000, propagate_forward_time: 105.2009506226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0283432007
validation[          , genome  6427] predictions:    6296/  10000 (62.96%), best:    6244/10000 (62.44%), error:     11462.60547, best error:     11429.76367 on epoch:    72, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 1145.3687744141s, input_fired_time: 11.4642105103, output_fired_time: 9.7256956100, propagate_forward_time: 428.7386779785, propagate_backward_time: 675.8991699219, weight_update_time: 1.3922516108, other_time: 19.5410156250
epoch time: 77.5581588745s, input_fired_time: 1.3381271362, output_fired_time: 0.0000000000, propagate_forward_time: 73.1963882446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0236434937
validation[          , genome  6427] predictions:    6197/  10000 (61.97%), best:    6244/10000 (62.44%), error:     11673.99316, best error:     11429.76367 on epoch:    72, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 1155.9230957031s, input_fired_time: 11.0780849457, output_fired_time: 9.7586488724, propagate_forward_time: 434.1562500000, propagate_backward_time: 683.4640502930, weight_update_time: 1.3687292337, other_time: 17.4660034180
epoch time: 100.0326232910s, input_fired_time: 1.4901014566, output_fired_time: 0.0000000000, propagate_forward_time: 95.4491806030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0933380127
validation[          , genome  6427] predictions:    6265/  10000 (62.65%), best:    6244/10000 (62.44%), error:     11449.06641, best error:     11429.76367 on epoch:    72, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 1287.4149169922s, input_fired_time: 11.7466545105, output_fired_time: 10.7970609665, propagate_forward_time: 490.0915527344, propagate_backward_time: 757.5315551758, weight_update_time: 1.4561841488, other_time: 17.2479858398
epoch time: 114.2096328735s, input_fired_time: 1.6242189407, output_fired_time: 0.0000000000, propagate_forward_time: 108.9314651489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6539459229
validation[          , genome  6427] predictions:    6204/  10000 (62.04%), best:    6244/10000 (62.44%), error:     11688.59570, best error:     11429.76367 on epoch:    72, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 1138.4719238281s, input_fired_time: 10.9775228500, output_fired_time: 9.7352809906, propagate_forward_time: 424.2612304688, propagate_backward_time: 675.0399780273, weight_update_time: 1.3682961464, other_time: 18.4579467773
epoch time: 69.1333312988s, input_fired_time: 1.2714204788, output_fired_time: 0.0000000000, propagate_forward_time: 65.2338638306, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6280441284
validation[          , genome  6427] predictions:    6274/  10000 (62.74%), best:    6244/10000 (62.44%), error:     11538.26563, best error:     11429.76367 on epoch:    72, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1215.2517089844s, input_fired_time: 11.8529529572, output_fired_time: 10.4174976349, propagate_forward_time: 454.7756958008, propagate_backward_time: 716.3363037109, weight_update_time: 1.4518479109, other_time: 21.8693237305
epoch time: 103.1066131592s, input_fired_time: 1.5524744987, output_fired_time: 0.0000000000, propagate_forward_time: 97.0779037476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4762344360
validation[          , genome  6427] predictions:    6162/  10000 (61.62%), best:    6244/10000 (62.44%), error:     11888.04590, best error:     11429.76367 on epoch:    72, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1245.1368408203s, input_fired_time: 11.5168743134, output_fired_time: 10.5726766586, propagate_forward_time: 469.3600769043, propagate_backward_time: 735.0577392578, weight_update_time: 1.4409760237, other_time: 18.6295166016
epoch time: 85.3084030151s, input_fired_time: 1.3438882828, output_fired_time: 0.0000000000, propagate_forward_time: 81.1357879639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8287277222
validation[          , genome  6427] predictions:    6175/  10000 (61.75%), best:    6244/10000 (62.44%), error:     11696.14746, best error:     11429.76367 on epoch:    72, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 1063.6950683594s, input_fired_time: 10.5316247940, output_fired_time: 8.8611669540, propagate_forward_time: 401.0523681641, propagate_backward_time: 627.9627075195, weight_update_time: 1.2974265814, other_time: 15.2871704102
epoch time: 100.4672317505s, input_fired_time: 1.4929734468, output_fired_time: 0.0000000000, propagate_forward_time: 95.0429382324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9313201904
validation[          , genome  6427] predictions:    6218/  10000 (62.18%), best:    6244/10000 (62.44%), error:     11572.63281, best error:     11429.76367 on epoch:    72, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1253.6864013672s, input_fired_time: 11.5903511047, output_fired_time: 10.7160139084, propagate_forward_time: 469.9158325195, propagate_backward_time: 742.3440551758, weight_update_time: 1.4483220577, other_time: 19.1201171875
epoch time: 107.8314132690s, input_fired_time: 1.5901923180, output_fired_time: 0.0000000000, propagate_forward_time: 102.9260787964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3151397705
validation[          , genome  6427] predictions:    6261/  10000 (62.61%), best:    6244/10000 (62.44%), error:     11504.79199, best error:     11429.76367 on epoch:    72, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1217.4727783203s, input_fired_time: 11.4845819473, output_fired_time: 10.3790578842, propagate_forward_time: 456.0666198730, propagate_backward_time: 720.9016723633, weight_update_time: 1.4260596037, other_time: 18.6408081055
epoch time: 85.4937438965s, input_fired_time: 1.3633425236, output_fired_time: 0.0000000000, propagate_forward_time: 81.0261154175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1042861938
validation[          , genome  6427] predictions:    6270/  10000 (62.70%), best:    6244/10000 (62.44%), error:     11520.36719, best error:     11429.76367 on epoch:    72, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1076.4840087891s, input_fired_time: 10.6454725266, output_fired_time: 9.1396045685, propagate_forward_time: 400.6400451660, propagate_backward_time: 638.6000976563, weight_update_time: 1.3171608448, other_time: 17.4587402344
epoch time: 103.4412689209s, input_fired_time: 1.5363068581, output_fired_time: 0.0000000000, propagate_forward_time: 98.2333145142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6716461182
validation[          , genome  6427] predictions:    6155/  10000 (61.55%), best:    6244/10000 (62.44%), error:     11783.12402, best error:     11429.76367 on epoch:    72, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1251.9951171875s, input_fired_time: 11.6696395874, output_fired_time: 10.7430562973, propagate_forward_time: 468.7716369629, propagate_backward_time: 740.5881958008, weight_update_time: 1.4525992870, other_time: 20.2225952148
epoch time: 67.2564086914s, input_fired_time: 1.2427521944, output_fired_time: 0.0000000000, propagate_forward_time: 63.4981117249, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5155448914
validation[          , genome  6427] predictions:    6252/  10000 (62.52%), best:    6244/10000 (62.44%), error:     11625.88281, best error:     11429.76367 on epoch:    72, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1201.9875488281s, input_fired_time: 11.9902563095, output_fired_time: 10.2350454330, propagate_forward_time: 451.0485839844, propagate_backward_time: 708.0381469727, weight_update_time: 1.4370363951, other_time: 20.6755981445
epoch time: 83.8410110474s, input_fired_time: 1.4395052195, output_fired_time: 0.0000000000, propagate_forward_time: 78.9156875610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4858169556
validation[          , genome  6427] predictions:    6257/  10000 (62.57%), best:    6244/10000 (62.44%), error:     11509.54004, best error:     11429.76367 on epoch:    72, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1135.4290771484s, input_fired_time: 11.3161888123, output_fired_time: 9.6733331680, propagate_forward_time: 423.5307922363, propagate_backward_time: 671.3931884766, weight_update_time: 1.3843395710, other_time: 19.5156250000
epoch time: 69.1339721680s, input_fired_time: 1.2105941772, output_fired_time: 0.0000000000, propagate_forward_time: 65.4069671631, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5164108276
validation[          , genome  6427] predictions:    6274/  10000 (62.74%), best:    6244/10000 (62.44%), error:     11507.51270, best error:     11429.76367 on epoch:    72, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1219.4150390625s, input_fired_time: 11.9060802460, output_fired_time: 10.4954471588, propagate_forward_time: 455.8769226074, propagate_backward_time: 719.3752441406, weight_update_time: 1.4611248970, other_time: 21.7612304688
epoch time: 76.4621429443s, input_fired_time: 1.3569997549, output_fired_time: 0.0000000000, propagate_forward_time: 72.0182800293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0868606567
validation[          , genome  6427] predictions:    6276/  10000 (62.76%), best:    6244/10000 (62.44%), error:     11493.96777, best error:     11429.76367 on epoch:    72, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1244.5958251953s, input_fired_time: 11.8302812576, output_fired_time: 10.6281309128, propagate_forward_time: 467.0148925781, propagate_backward_time: 734.4742431641, weight_update_time: 1.4564932585, other_time: 20.6481933594
epoch time: 71.6047363281s, input_fired_time: 1.2942498922, output_fired_time: 0.0000000000, propagate_forward_time: 67.4890441895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8214416504
validation[          , genome  6427] predictions:    6330/  10000 (63.30%), best:    6244/10000 (62.44%), error:     11480.53223, best error:     11429.76367 on epoch:    72, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1246.1019287109s, input_fired_time: 11.7520227432, output_fired_time: 10.5262947083, propagate_forward_time: 470.4250488281, propagate_backward_time: 734.6778564453, weight_update_time: 1.4436501265, other_time: 18.7207031250
epoch time: 72.8681945801s, input_fired_time: 1.3184316158, output_fired_time: 0.0000000000, propagate_forward_time: 68.6164169312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9333496094
validation[          , genome  6427] predictions:    6261/  10000 (62.61%), best:    6244/10000 (62.44%), error:     11529.75000, best error:     11429.76367 on epoch:    72, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 524.6962280273s, input_fired_time: 7.6984267235, output_fired_time: 0.0000000000, propagate_forward_time: 498.6068420410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.3909606934
best training[          , genome  6427] predictions:   39528/  50000 (79.06%), best:    6244/10000 (62.44%), error:     31509.50781, best error:     11429.76367 on epoch:    72, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 113.3212966919s, input_fired_time: 1.6147776842, output_fired_time: 0.0000000000, propagate_forward_time: 108.0953445435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6111755371
   testing[          , genome  6427] predictions:    6244/  10000 (62.44%), best:    6244/10000 (62.44%), error:     11429.76367, best error:     11429.76367 on epoch:    72, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
01:10:07 (3704): called boinc_finish(0)

</stderr_txt>
]]>