Nameexact_genome_1542727803_182_6428_0
Workunit4101345
Created20 Nov 2018, 20:18:21 UTC
Sent20 Nov 2018, 20:18:35 UTC
Report deadline9 Feb 2019, 11:25:16 UTC
Received24 Nov 2018, 7:31:14 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID88573
Run time1 days 12 hours 49 min 20 sec
CPU time1 days 12 hours 49 min 20 sec
Validate stateValid
Credit20,157.41
Device peak FLOPS3.35 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size519.90 MB
Peak swap size518.86 MB
Peak disk usage10.15 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
gate_forward_time: 102.6537933350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7292404175
validation[          , genome  6428] predictions:    5528/  10000 (55.28%), best:    5528/10000 (55.28%), error:     13807.18555, best error:     13807.18555 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 1188.4210205078s, input_fired_time: 10.5016813278, output_fired_time: 9.6312170029, propagate_forward_time: 456.7320251465, propagate_backward_time: 696.5249633789, weight_update_time: 1.3724375963, other_time: 15.0310668945
epoch time: 79.5159378052s, input_fired_time: 1.2108954191, output_fired_time: 0.0000000000, propagate_forward_time: 75.7207412720, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5843048096
validation[          , genome  6428] predictions:    5317/  10000 (53.17%), best:    5528/10000 (55.28%), error:     14913.32715, best error:     13807.18555 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 1373.6018066406s, input_fired_time: 11.4119253159, output_fired_time: 11.1090860367, propagate_forward_time: 533.4132690430, propagate_backward_time: 801.8500976563, weight_update_time: 1.4906247854, other_time: 15.8174438477
epoch time: 81.7227859497s, input_fired_time: 1.1781988144, output_fired_time: 0.0000000000, propagate_forward_time: 78.0389862061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5055999756
validation[          , genome  6428] predictions:    4913/  10000 (49.13%), best:    5528/10000 (55.28%), error:     17290.17773, best error:     13807.18555 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 1176.3281250000s, input_fired_time: 10.3364658356, output_fired_time: 9.5017929077, propagate_forward_time: 451.3260498047, propagate_backward_time: 690.3843383789, weight_update_time: 1.3533513546, other_time: 14.7794799805
epoch time: 121.9287261963s, input_fired_time: 1.5426814556, output_fired_time: 0.0000000000, propagate_forward_time: 117.5193099976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8667373657
validation[          , genome  6428] predictions:    5509/  10000 (55.09%), best:    5528/10000 (55.28%), error:     14063.06934, best error:     13807.18555 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 1152.1733398438s, input_fired_time: 10.3767471313, output_fired_time: 9.3504886627, propagate_forward_time: 441.5124816895, propagate_backward_time: 676.0295410156, weight_update_time: 1.3481396437, other_time: 14.9041748047
epoch time: 69.4987182617s, input_fired_time: 1.0806355476, output_fired_time: 0.0000000000, propagate_forward_time: 66.0145263672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4035568237
validation[          , genome  6428] predictions:    5433/  10000 (54.33%), best:    5528/10000 (55.28%), error:     14263.69434, best error:     13807.18555 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 1357.7214355469s, input_fired_time: 11.3192300797, output_fired_time: 10.9691200256, propagate_forward_time: 527.4987182617, propagate_backward_time: 792.3720092773, weight_update_time: 1.4754074812, other_time: 15.5623779297
epoch time: 127.8267059326s, input_fired_time: 1.5905336142, output_fired_time: 0.0000000000, propagate_forward_time: 123.3407897949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8953857422
validation[          , genome  6428] predictions:    5593/  10000 (55.93%), best:    5593/10000 (55.93%), error:     13388.69434, best error:     13388.69434 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 1275.3231201172s, input_fired_time: 10.8754968643, output_fired_time: 10.2874526978, propagate_forward_time: 492.6281127930, propagate_backward_time: 746.3477783203, weight_update_time: 1.4208070040, other_time: 15.1842651367
epoch time: 89.8878479004s, input_fired_time: 1.2647993565, output_fired_time: 0.0000000000, propagate_forward_time: 86.0282211304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5948257446
validation[          , genome  6428] predictions:    5337/  10000 (53.37%), best:    5593/10000 (55.93%), error:     14149.66895, best error:     13388.69434 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1201.3524169922s, input_fired_time: 10.4964113235, output_fired_time: 9.6876640320, propagate_forward_time: 460.9918823242, propagate_backward_time: 705.3275756836, weight_update_time: 1.3704826832, other_time: 14.8488769531
epoch time: 115.1253585815s, input_fired_time: 1.5413484573, output_fired_time: 0.0000000000, propagate_forward_time: 110.6422576904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9417495728
validation[          , genome  6428] predictions:    5410/  10000 (54.10%), best:    5593/10000 (55.93%), error:     14521.48340, best error:     13388.69434 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 1114.8194580078s, input_fired_time: 10.3134889603, output_fired_time: 9.0532608032, propagate_forward_time: 425.9622192383, propagate_backward_time: 654.6092529297, weight_update_time: 1.3305131197, other_time: 14.8812866211
epoch time: 72.3638458252s, input_fired_time: 1.1139154434, output_fired_time: 0.0000000000, propagate_forward_time: 68.8091659546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4407653809
validation[          , genome  6428] predictions:    5472/  10000 (54.72%), best:    5593/10000 (55.93%), error:     14216.90918, best error:     13388.69434 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 1304.5700683594s, input_fired_time: 11.0328540802, output_fired_time: 10.4846477509, propagate_forward_time: 504.2020568848, propagate_backward_time: 763.5889282227, weight_update_time: 1.4374455214, other_time: 15.2616577148
epoch time: 115.6480331421s, input_fired_time: 1.4983766079, output_fired_time: 0.0000000000, propagate_forward_time: 111.3154754639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8341827393
validation[          , genome  6428] predictions:    5481/  10000 (54.81%), best:    5593/10000 (55.93%), error:     13832.72168, best error:     13388.69434 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 1287.9023437500s, input_fired_time: 11.0702505112, output_fired_time: 10.4066104889, propagate_forward_time: 497.8996276855, propagate_backward_time: 753.1190185547, weight_update_time: 1.4360839128, other_time: 15.4068603516
epoch time: 98.7045516968s, input_fired_time: 1.3533576727, output_fired_time: 0.0000000000, propagate_forward_time: 94.6688003540, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6823959351
validation[          , genome  6428] predictions:    5589/  10000 (55.89%), best:    5589/10000 (55.89%), error:     13279.84668, best error:     13279.84668 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 954.7943115234s, input_fired_time: 9.2960119247, output_fired_time: 7.7508592606, propagate_forward_time: 359.3323669434, propagate_backward_time: 564.5852661133, weight_update_time: 1.2064206600, other_time: 13.8297729492
epoch time: 99.5335006714s, input_fired_time: 1.3542274237, output_fired_time: 0.0000000000, propagate_forward_time: 95.5025024414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6767730713
validation[          , genome  6428] predictions:    5712/  10000 (57.12%), best:    5712/10000 (57.12%), error:     13179.11816, best error:     13179.11816 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 1290.4038085938s, input_fired_time: 11.0656032562, output_fired_time: 10.5194053650, propagate_forward_time: 496.2926330566, propagate_backward_time: 756.5331420898, weight_update_time: 1.4391295910, other_time: 15.9931030273
epoch time: 67.8152236938s, input_fired_time: 1.0917071104, output_fired_time: 0.0000000000, propagate_forward_time: 64.3014831543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4220352173
validation[          , genome  6428] predictions:    5544/  10000 (55.44%), best:    5712/10000 (57.12%), error:     13738.55859, best error:     13179.11816 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 1188.0155029297s, input_fired_time: 10.4750242233, output_fired_time: 9.5726575851, propagate_forward_time: 456.7571411133, propagate_backward_time: 696.5537109375, weight_update_time: 1.3569382429, other_time: 14.6570434570
epoch time: 85.2186889648s, input_fired_time: 1.2220591307, output_fired_time: 0.0000000000, propagate_forward_time: 81.5123367310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4842910767
validation[          , genome  6428] predictions:    5679/  10000 (56.79%), best:    5712/10000 (57.12%), error:     13200.78516, best error:     13179.11816 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 1260.0416259766s, input_fired_time: 10.8705615997, output_fired_time: 10.2159948349, propagate_forward_time: 484.0545043945, propagate_backward_time: 739.4229125977, weight_update_time: 1.4147680998, other_time: 15.4776611328
epoch time: 104.3082275391s, input_fired_time: 1.4074009657, output_fired_time: 0.0000000000, propagate_forward_time: 100.2197494507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6810760498
validation[          , genome  6428] predictions:    5826/  10000 (58.26%), best:    5826/10000 (58.26%), error:     13033.12402, best error:     13033.12402 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 1199.5588378906s, input_fired_time: 10.6157789230, output_fired_time: 9.7284317017, propagate_forward_time: 460.3879699707, propagate_backward_time: 703.6435546875, weight_update_time: 1.3710539341, other_time: 15.1832275391
epoch time: 92.3168869019s, input_fired_time: 1.3293634653, output_fired_time: 0.0000000000, propagate_forward_time: 87.6786422729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3088836670
validation[          , genome  6428] predictions:    5894/  10000 (58.94%), best:    5894/10000 (58.94%), error:     12462.98633, best error:     12462.98633 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1282.6430664063s, input_fired_time: 11.7084054947, output_fired_time: 10.5539064407, propagate_forward_time: 489.5895080566, propagate_backward_time: 752.4518432617, weight_update_time: 1.4639003277, other_time: 18.3394165039
epoch time: 126.8572235107s, input_fired_time: 1.6889365911, output_fired_time: 0.0000000000, propagate_forward_time: 122.0857772827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0825119019
validation[          , genome  6428] predictions:    5520/  10000 (55.20%), best:    5894/10000 (58.94%), error:     13747.74805, best error:     12462.98633 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1238.1719970703s, input_fired_time: 11.3348245621, output_fired_time: 10.1871891022, propagate_forward_time: 475.4301452637, propagate_backward_time: 724.5189208984, weight_update_time: 1.4344469309, other_time: 16.7009277344
epoch time: 72.4736480713s, input_fired_time: 1.2101566792, output_fired_time: 0.0000000000, propagate_forward_time: 68.5952377319, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6682510376
validation[          , genome  6428] predictions:    5671/  10000 (56.71%), best:    5894/10000 (58.94%), error:     13331.47070, best error:     12462.98633 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 1283.8677978516s, input_fired_time: 11.4483184814, output_fired_time: 10.5166006088, propagate_forward_time: 493.2770996094, propagate_backward_time: 751.9124755859, weight_update_time: 1.4554305077, other_time: 16.7132568359
epoch time: 71.4611968994s, input_fired_time: 1.1099569798, output_fired_time: 0.0000000000, propagate_forward_time: 67.9898147583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3614273071
validation[          , genome  6428] predictions:    5801/  10000 (58.01%), best:    5894/10000 (58.94%), error:     13197.92676, best error:     12462.98633 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1243.3795166016s, input_fired_time: 10.8466711044, output_fired_time: 10.0337581635, propagate_forward_time: 479.1317443848, propagate_backward_time: 728.1930541992, weight_update_time: 1.3999395370, other_time: 15.1742553711
epoch time: 97.1503677368s, input_fired_time: 1.3506965637, output_fired_time: 0.0000000000, propagate_forward_time: 93.1822204590, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6174468994
validation[          , genome  6428] predictions:    5781/  10000 (57.81%), best:    5894/10000 (58.94%), error:     12812.06445, best error:     12462.98633 on epoch:    30, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1091.6860351563s, input_fired_time: 10.5089673996, output_fired_time: 9.0046033859, propagate_forward_time: 413.5668334961, propagate_backward_time: 642.3870239258, weight_update_time: 1.3278930187, other_time: 16.2186279297
epoch time: 86.2517395020s, input_fired_time: 1.3216959238, output_fired_time: 0.0000000000, propagate_forward_time: 82.2043609619, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7256851196
validation[          , genome  6428] predictions:    6014/  10000 (60.14%), best:    6014/10000 (60.14%), error:     12110.61816, best error:     12110.61816 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1355.4316406250s, input_fired_time: 11.9749650955, output_fired_time: 11.1323986053, propagate_forward_time: 522.8764038086, propagate_backward_time: 792.0588989258, weight_update_time: 1.5129052401, other_time: 17.3889160156
epoch time: 119.0646286011s, input_fired_time: 1.6155271530, output_fired_time: 0.0000000000, propagate_forward_time: 113.5863342285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8627700806
validation[          , genome  6428] predictions:    5728/  10000 (57.28%), best:    6014/10000 (60.14%), error:     13243.05273, best error:     12110.61816 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1212.1221923828s, input_fired_time: 10.7250566483, output_fired_time: 9.8737258911, propagate_forward_time: 463.2227172852, propagate_backward_time: 712.3896484375, weight_update_time: 1.3870832920, other_time: 15.9109497070
epoch time: 90.6651687622s, input_fired_time: 1.3021038771, output_fired_time: 0.0000000000, propagate_forward_time: 86.8065643311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5565032959
validation[          , genome  6428] predictions:    5834/  10000 (58.34%), best:    6014/10000 (60.14%), error:     12775.63281, best error:     12110.61816 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 1228.9792480469s, input_fired_time: 10.8627262115, output_fired_time: 9.9438610077, propagate_forward_time: 472.2658996582, propagate_backward_time: 720.3310546875, weight_update_time: 1.3970574141, other_time: 15.5758056641
epoch time: 83.8514480591s, input_fired_time: 1.2568594217, output_fired_time: 0.0000000000, propagate_forward_time: 79.7510528564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8435363770
validation[          , genome  6428] predictions:    5875/  10000 (58.75%), best:    6014/10000 (60.14%), error:     12704.35059, best error:     12110.61816 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 1277.1697998047s, input_fired_time: 11.7548713684, output_fired_time: 10.6351442337, propagate_forward_time: 485.1935119629, propagate_backward_time: 749.7137451172, weight_update_time: 1.4755144119, other_time: 19.8725585938
epoch time: 101.2020263672s, input_fired_time: 1.4794247150, output_fired_time: 0.0000000000, propagate_forward_time: 96.8264694214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8961334229
validation[          , genome  6428] predictions:    5855/  10000 (58.55%), best:    6014/10000 (60.14%), error:     12479.80762, best error:     12110.61816 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 1032.6390380859s, input_fired_time: 9.8559064865, output_fired_time: 8.3985195160, propagate_forward_time: 390.7085266113, propagate_backward_time: 609.2218017578, weight_update_time: 1.2608914375, other_time: 14.4543457031
epoch time: 103.7226181030s, input_fired_time: 1.4788178205, output_fired_time: 0.0000000000, propagate_forward_time: 98.6273345947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6164627075
validation[          , genome  6428] predictions:    5924/  10000 (59.24%), best:    6014/10000 (60.14%), error:     12645.13770, best error:     12110.61816 on epoch:    35, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 1218.8699951172s, input_fired_time: 11.4113616943, output_fired_time: 10.2401342392, propagate_forward_time: 459.9264526367, propagate_backward_time: 716.7567749023, weight_update_time: 1.4299652576, other_time: 20.5352783203
epoch time: 119.9607086182s, input_fired_time: 1.6785008907, output_fired_time: 0.0000000000, propagate_forward_time: 114.5399169922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7422943115
validation[          , genome  6428] predictions:    5752/  10000 (57.52%), best:    6014/10000 (60.14%), error:     13146.19238, best error:     12110.61816 on epoch:    35, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 1192.8270263672s, input_fired_time: 11.1127433777, output_fired_time: 9.8747510910, propagate_forward_time: 452.3601074219, propagate_backward_time: 700.9376220703, weight_update_time: 1.4010883570, other_time: 18.5417480469
epoch time: 95.0069503784s, input_fired_time: 1.3460681438, output_fired_time: 0.0000000000, propagate_forward_time: 90.9813613892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6795196533
validation[          , genome  6428] predictions:    5736/  10000 (57.36%), best:    6014/10000 (60.14%), error:     13170.08398, best error:     12110.61816 on epoch:    35, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 1262.7811279297s, input_fired_time: 11.1256790161, output_fired_time: 10.3209018707, propagate_forward_time: 484.3792724609, propagate_backward_time: 740.5939941406, weight_update_time: 1.4198269844, other_time: 16.3612060547
epoch time: 114.1156387329s, input_fired_time: 1.5375603437, output_fired_time: 0.0000000000, propagate_forward_time: 109.6278686523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9502105713
validation[          , genome  6428] predictions:    5929/  10000 (59.29%), best:    6014/10000 (60.14%), error:     12275.78418, best error:     12110.61816 on epoch:    35, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 1279.7614746094s, input_fired_time: 11.3478832245, output_fired_time: 10.5136327744, propagate_forward_time: 489.1321716309, propagate_backward_time: 751.6641235352, weight_update_time: 1.4489516020, other_time: 17.1035766602
epoch time: 97.2153549194s, input_fired_time: 1.4637559652, output_fired_time: 0.0000000000, propagate_forward_time: 92.5324325562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2191696167
validation[          , genome  6428] predictions:    5967/  10000 (59.67%), best:    6014/10000 (60.14%), error:     12238.62402, best error:     12110.61816 on epoch:    35, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 1228.1088867188s, input_fired_time: 11.3263826370, output_fired_time: 10.1206636429, propagate_forward_time: 470.5708312988, propagate_backward_time: 718.9147338867, weight_update_time: 1.4249047041, other_time: 17.1763305664
epoch time: 78.5421447754s, input_fired_time: 1.2648198605, output_fired_time: 0.0000000000, propagate_forward_time: 74.6930313110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5842971802
validation[          , genome  6428] predictions:    5805/  10000 (58.05%), best:    6014/10000 (60.14%), error:     13001.87891, best error:     12110.61816 on epoch:    35, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 1166.5587158203s, input_fired_time: 11.0963363647, output_fired_time: 9.6581382751, propagate_forward_time: 443.5063781738, propagate_backward_time: 684.5685424805, weight_update_time: 1.3886337280, other_time: 17.7294311523
epoch time: 100.0432357788s, input_fired_time: 1.4678447247, output_fired_time: 0.0000000000, propagate_forward_time: 95.7633590698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8120346069
validation[          , genome  6428] predictions:    5861/  10000 (58.61%), best:    6014/10000 (60.14%), error:     13062.28125, best error:     12110.61816 on epoch:    35, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 1122.2471923828s, input_fired_time: 10.8804798126, output_fired_time: 9.2861833572, propagate_forward_time: 424.9812622070, propagate_backward_time: 660.1973266602, weight_update_time: 1.3567265272, other_time: 16.9019775391
epoch time: 107.5566101074s, input_fired_time: 1.4821752310, output_fired_time: 0.0000000000, propagate_forward_time: 101.7407836914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3336486816
validation[          , genome  6428] predictions:    5842/  10000 (58.42%), best:    6014/10000 (60.14%), error:     12705.14746, best error:     12110.61816 on epoch:    35, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1180.7897949219s, input_fired_time: 10.7297925949, output_fired_time: 9.9686431885, propagate_forward_time: 447.2761230469, propagate_backward_time: 695.3656005859, weight_update_time: 1.3791787624, other_time: 17.4497070313
epoch time: 115.2268676758s, input_fired_time: 1.5489335060, output_fired_time: 0.0000000000, propagate_forward_time: 110.0759353638, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6019973755
validation[          , genome  6428] predictions:    5945/  10000 (59.45%), best:    6014/10000 (60.14%), error:     12322.05176, best error:     12110.61816 on epoch:    35, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1125.1958007813s, input_fired_time: 10.6153516769, output_fired_time: 9.2483406067, propagate_forward_time: 426.9718322754, propagate_backward_time: 662.1604614258, weight_update_time: 1.3396915197, other_time: 16.1998901367
epoch time: 105.5379562378s, input_fired_time: 1.5073838234, output_fired_time: 0.0000000000, propagate_forward_time: 101.0461578369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9844131470
validation[          , genome  6428] predictions:    5813/  10000 (58.13%), best:    6014/10000 (60.14%), error:     13030.68652, best error:     12110.61816 on epoch:    35, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 1205.2321777344s, input_fired_time: 11.4677581787, output_fired_time: 10.0741682053, propagate_forward_time: 456.1891784668, propagate_backward_time: 708.8190917969, weight_update_time: 1.4162268639, other_time: 18.6818847656
epoch time: 94.1280364990s, input_fired_time: 1.4335124493, output_fired_time: 0.0000000000, propagate_forward_time: 89.6736831665, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0208435059
validation[          , genome  6428] predictions:    5752/  10000 (57.52%), best:    6014/10000 (60.14%), error:     12990.75586, best error:     12110.61816 on epoch:    35, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 1223.9226074219s, input_fired_time: 10.9573335648, output_fired_time: 10.0734233856, propagate_forward_time: 465.5332336426, propagate_backward_time: 720.8293457031, weight_update_time: 1.4009767771, other_time: 16.5294189453
epoch time: 69.5493545532s, input_fired_time: 1.1469229460, output_fired_time: 0.0000000000, propagate_forward_time: 65.9562759399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4461593628
validation[          , genome  6428] predictions:    6017/  10000 (60.17%), best:    6014/10000 (60.14%), error:     12146.03906, best error:     12110.61816 on epoch:    35, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 1273.9144287109s, input_fired_time: 11.5768051147, output_fired_time: 10.6933012009, propagate_forward_time: 480.8092346191, propagate_backward_time: 749.7086791992, weight_update_time: 1.4636234045, other_time: 21.1264038086
epoch time: 109.9517898560s, input_fired_time: 1.6063222885, output_fired_time: 0.0000000000, propagate_forward_time: 104.2316589355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1138076782
validation[          , genome  6428] predictions:    5960/  10000 (59.60%), best:    6014/10000 (60.14%), error:     12271.71191, best error:     12110.61816 on epoch:    35, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 1175.8889160156s, input_fired_time: 11.3259811401, output_fired_time: 9.7763671875, propagate_forward_time: 444.8967285156, propagate_backward_time: 691.1251831055, weight_update_time: 1.3962233067, other_time: 18.7647094727
epoch time: 67.8315582275s, input_fired_time: 1.1292167902, output_fired_time: 0.0000000000, propagate_forward_time: 64.2823257446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4200134277
validation[          , genome  6428] predictions:    5929/  10000 (59.29%), best:    6014/10000 (60.14%), error:     12453.12012, best error:     12110.61816 on epoch:    35, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 1236.6022949219s, input_fired_time: 11.2632055283, output_fired_time: 10.1488637924, propagate_forward_time: 474.6406860352, propagate_backward_time: 724.3123779297, weight_update_time: 1.4176100492, other_time: 16.2372436523
epoch time: 79.5518493652s, input_fired_time: 1.3083202839, output_fired_time: 0.0000000000, propagate_forward_time: 75.4904403687, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7530899048
validation[          , genome  6428] predictions:    6036/  10000 (60.36%), best:    6036/10000 (60.36%), error:     11961.11328, best error:     11961.11328 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 1116.7778320313s, input_fired_time: 10.6082935333, output_fired_time: 9.2338924408, propagate_forward_time: 421.7540283203, propagate_backward_time: 657.9599609375, weight_update_time: 1.3395087719, other_time: 17.2216796875
epoch time: 96.6367492676s, input_fired_time: 1.4287695885, output_fired_time: 0.0000000000, propagate_forward_time: 91.2452926636, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9626846313
validation[          , genome  6428] predictions:    6078/  10000 (60.78%), best:    6036/10000 (60.36%), error:     12014.14453, best error:     11961.11328 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 1195.6584472656s, input_fired_time: 10.9064331055, output_fired_time: 9.8938627243, propagate_forward_time: 453.4127502441, propagate_backward_time: 703.5676269531, weight_update_time: 1.3925594091, other_time: 17.8776855469
epoch time: 78.1154403687s, input_fired_time: 1.2243247032, output_fired_time: 0.0000000000, propagate_forward_time: 73.9597320557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9313812256
validation[          , genome  6428] predictions:    6079/  10000 (60.79%), best:    6079/10000 (60.79%), error:     11958.89746, best error:     11958.89746 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 1147.1968994141s, input_fired_time: 10.6088638306, output_fired_time: 9.4963788986, propagate_forward_time: 433.4963073730, propagate_backward_time: 676.4494628906, weight_update_time: 1.3554515839, other_time: 17.1458740234
epoch time: 95.0751190186s, input_fired_time: 1.3826388121, output_fired_time: 0.0000000000, propagate_forward_time: 90.8050308228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8874511719
validation[          , genome  6428] predictions:    6014/  10000 (60.14%), best:    6079/10000 (60.79%), error:     12060.03906, best error:     11958.89746 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 1240.4261474609s, input_fired_time: 11.1083402634, output_fired_time: 10.1778039932, propagate_forward_time: 473.3092651367, propagate_backward_time: 728.6306152344, weight_update_time: 1.4172939062, other_time: 17.2000122070
epoch time: 88.0121536255s, input_fired_time: 1.3138000965, output_fired_time: 0.0000000000, propagate_forward_time: 84.0306930542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6676635742
validation[          , genome  6428] predictions:    6046/  10000 (60.46%), best:    6079/10000 (60.79%), error:     12034.83105, best error:     11958.89746 on epoch:    56, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 1164.4222412109s, input_fired_time: 10.9894514084, output_fired_time: 9.6434917450, propagate_forward_time: 440.8656005859, propagate_backward_time: 685.5713500977, weight_update_time: 1.3760993481, other_time: 17.3523559570
epoch time: 111.4043121338s, input_fired_time: 1.5220173597, output_fired_time: 0.0000000000, propagate_forward_time: 106.1473083496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7349853516
validation[          , genome  6428] predictions:    6046/  10000 (60.46%), best:    6079/10000 (60.79%), error:     11979.76855, best error:     11958.89746 on epoch:    56, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 1037.2485351563s, input_fired_time: 10.0355463028, output_fired_time: 8.5377779007, propagate_forward_time: 389.9082336426, propagate_backward_time: 612.9630126953, weight_update_time: 1.2758282423, other_time: 15.8039550781
epoch time: 91.7019958496s, input_fired_time: 1.3408812284, output_fired_time: 0.0000000000, propagate_forward_time: 86.8970108032, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4641036987
validation[          , genome  6428] predictions:    6026/  10000 (60.26%), best:    6079/10000 (60.79%), error:     12154.68164, best error:     11958.89746 on epoch:    56, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 1081.7097167969s, input_fired_time: 10.3031473160, output_fired_time: 8.9275875092, propagate_forward_time: 407.2272644043, propagate_backward_time: 638.7892456055, weight_update_time: 1.3167772293, other_time: 16.4624633789
epoch time: 105.8251419067s, input_fired_time: 1.4885859489, output_fired_time: 0.0000000000, propagate_forward_time: 100.9311981201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4053573608
validation[          , genome  6428] predictions:    5995/  10000 (59.95%), best:    6079/10000 (60.79%), error:     12217.29492, best error:     11958.89746 on epoch:    56, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 1115.8259277344s, input_fired_time: 10.4665145874, output_fired_time: 9.3357229233, propagate_forward_time: 418.4124145508, propagate_backward_time: 659.8464965820, weight_update_time: 1.3412882090, other_time: 17.7647705078
epoch time: 93.7569503784s, input_fired_time: 1.3679505587, output_fired_time: 0.0000000000, propagate_forward_time: 88.7830047607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6059951782
validation[          , genome  6428] predictions:    6057/  10000 (60.57%), best:    6079/10000 (60.79%), error:     12264.63672, best error:     11958.89746 on epoch:    56, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 1209.3300781250s, input_fired_time: 11.0532512665, output_fired_time: 10.0840654373, propagate_forward_time: 456.8459472656, propagate_backward_time: 712.7922973633, weight_update_time: 1.4338188171, other_time: 18.5545043945
epoch time: 84.0970306396s, input_fired_time: 1.2969493866, output_fired_time: 0.0000000000, propagate_forward_time: 79.8569107056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9431686401
validation[          , genome  6428] predictions:    6116/  10000 (61.16%), best:    6116/10000 (61.16%), error:     11907.63770, best error:     11907.63770 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 1281.8132324219s, input_fired_time: 11.3611812592, output_fired_time: 10.5948638916, propagate_forward_time: 488.2079772949, propagate_backward_time: 753.9831542969, weight_update_time: 1.4459182024, other_time: 17.6660156250
epoch time: 108.7617034912s, input_fired_time: 1.5066921711, output_fired_time: 0.0000000000, propagate_forward_time: 104.4414672852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8135452271
validation[          , genome  6428] predictions:    6018/  10000 (60.18%), best:    6116/10000 (61.16%), error:     12240.03809, best error:     11907.63770 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 1177.5358886719s, input_fired_time: 10.8125696182, output_fired_time: 9.7328004837, propagate_forward_time: 446.7205810547, propagate_backward_time: 693.3567504883, weight_update_time: 1.3730403185, other_time: 16.9131469727
epoch time: 99.8944931030s, input_fired_time: 1.4244661331, output_fired_time: 0.0000000000, propagate_forward_time: 94.9818649292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4881591797
validation[          , genome  6428] predictions:    6124/  10000 (61.24%), best:    6116/10000 (61.16%), error:     11936.65039, best error:     11907.63770 on epoch:    63, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 1267.3559570313s, input_fired_time: 11.2946004868, output_fired_time: 10.5350933075, propagate_forward_time: 480.4759216309, propagate_backward_time: 746.9475097656, weight_update_time: 1.4442460537, other_time: 18.1029052734
epoch time: 71.9046478271s, input_fired_time: 1.1786750555, output_fired_time: 0.0000000000, propagate_forward_time: 68.3136901855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4122848511
validation[          , genome  6428] predictions:    6202/  10000 (62.02%), best:    6202/10000 (62.02%), error:     11774.68652, best error:     11774.68652 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 1105.9371337891s, input_fired_time: 10.4348735809, output_fired_time: 9.1496572495, propagate_forward_time: 417.7016601563, propagate_backward_time: 651.6835327148, weight_update_time: 1.3348456621, other_time: 16.9674682617
epoch time: 106.6305847168s, input_fired_time: 1.4888064861, output_fired_time: 0.0000000000, propagate_forward_time: 101.4059829712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7357940674
validation[          , genome  6428] predictions:    6096/  10000 (60.96%), best:    6202/10000 (62.02%), error:     12310.16113, best error:     11774.68652 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 1152.9271240234s, input_fired_time: 10.6902828217, output_fired_time: 9.5429363251, propagate_forward_time: 436.0628051758, propagate_backward_time: 679.6524658203, weight_update_time: 1.3589582443, other_time: 16.9785766602
epoch time: 94.3230972290s, input_fired_time: 1.3811954260, output_fired_time: 0.0000000000, propagate_forward_time: 89.8907394409, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0511627197
validation[          , genome  6428] predictions:    6158/  10000 (61.58%), best:    6202/10000 (62.02%), error:     11788.16992, best error:     11774.68652 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 1177.6520996094s, input_fired_time: 10.8391580582, output_fired_time: 9.7933921814, propagate_forward_time: 445.0337219238, propagate_backward_time: 694.4860839844, weight_update_time: 1.3788152933, other_time: 17.4998779297
epoch time: 113.5604171753s, input_fired_time: 1.5643272400, output_fired_time: 0.0000000000, propagate_forward_time: 108.8100738525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1860198975
validation[          , genome  6428] predictions:    6050/  10000 (60.50%), best:    6202/10000 (62.02%), error:     12225.17676, best error:     11774.68652 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 1096.7551269531s, input_fired_time: 10.4176559448, output_fired_time: 9.0474357605, propagate_forward_time: 413.9118347168, propagate_backward_time: 646.9451293945, weight_update_time: 1.3166218996, other_time: 16.4330444336
epoch time: 89.6133956909s, input_fired_time: 1.3410800695, output_fired_time: 0.0000000000, propagate_forward_time: 85.3905563354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8817596436
validation[          , genome  6428] predictions:    6167/  10000 (61.67%), best:    6167/10000 (61.67%), error:     11603.40234, best error:     11603.40234 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 1274.4135742188s, input_fired_time: 11.7958669662, output_fired_time: 10.6236152649, propagate_forward_time: 483.5304260254, propagate_backward_time: 748.6902465820, weight_update_time: 1.4708282948, other_time: 19.7733764648
epoch time: 113.5835494995s, input_fired_time: 1.6621792316, output_fired_time: 0.0000000000, propagate_forward_time: 107.2837295532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6376419067
validation[          , genome  6428] predictions:    6003/  10000 (60.03%), best:    6167/10000 (61.67%), error:     12380.62793, best error:     11603.40234 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 1203.3465576172s, input_fired_time: 11.3103971481, output_fired_time: 10.1077461243, propagate_forward_time: 452.6051330566, propagate_backward_time: 709.3963623047, weight_update_time: 1.4185500145, other_time: 19.9268798828
epoch time: 106.2317047119s, input_fired_time: 1.4947175980, output_fired_time: 0.0000000000, propagate_forward_time: 100.5773086548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1596755981
validation[          , genome  6428] predictions:    6161/  10000 (61.61%), best:    6167/10000 (61.67%), error:     11764.51563, best error:     11603.40234 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 1126.2351074219s, input_fired_time: 10.5746860504, output_fired_time: 9.3267631531, propagate_forward_time: 425.3751831055, propagate_backward_time: 664.0927124023, weight_update_time: 1.3439589739, other_time: 16.8657226563
epoch time: 83.2745971680s, input_fired_time: 1.2872393131, output_fired_time: 0.0000000000, propagate_forward_time: 78.7855377197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2018203735
validation[          , genome  6428] predictions:    6133/  10000 (61.33%), best:    6167/10000 (61.67%), error:     11908.24219, best error:     11603.40234 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 1196.8448486328s, input_fired_time: 11.0025157928, output_fired_time: 9.9156579971, propagate_forward_time: 452.5009765625, propagate_backward_time: 705.7934570313, weight_update_time: 1.3957986832, other_time: 17.6322021484
epoch time: 105.3658447266s, input_fired_time: 1.5009084940, output_fired_time: 0.0000000000, propagate_forward_time: 100.2292251587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6357116699
validation[          , genome  6428] predictions:    6147/  10000 (61.47%), best:    6167/10000 (61.67%), error:     11847.21094, best error:     11603.40234 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 1229.4414062500s, input_fired_time: 11.1547040939, output_fired_time: 10.2553205490, propagate_forward_time: 464.8229675293, propagate_backward_time: 724.7457275391, weight_update_time: 1.4188797474, other_time: 18.4626464844
epoch time: 116.9137496948s, input_fired_time: 1.6111116409, output_fired_time: 0.0000000000, propagate_forward_time: 111.3656616211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9369735718
validation[          , genome  6428] predictions:    6098/  10000 (60.98%), best:    6167/10000 (61.67%), error:     11881.37891, best error:     11603.40234 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 1221.7993164063s, input_fired_time: 11.0840740204, output_fired_time: 10.0819597244, propagate_forward_time: 463.9998779297, propagate_backward_time: 719.5065917969, weight_update_time: 1.4052921534, other_time: 17.1268310547
epoch time: 84.8701400757s, input_fired_time: 1.3077155352, output_fired_time: 0.0000000000, propagate_forward_time: 80.2928695679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2695541382
validation[          , genome  6428] predictions:    6097/  10000 (60.97%), best:    6167/10000 (61.67%), error:     11860.55469, best error:     11603.40234 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 1117.9342041016s, input_fired_time: 10.5437126160, output_fired_time: 9.3319787979, propagate_forward_time: 419.7594299316, propagate_backward_time: 660.6019287109, weight_update_time: 1.3416398764, other_time: 17.6971435547
epoch time: 104.9636917114s, input_fired_time: 1.4926012754, output_fired_time: 0.0000000000, propagate_forward_time: 99.4701919556, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0009002686
validation[          , genome  6428] predictions:    6127/  10000 (61.27%), best:    6167/10000 (61.67%), error:     11874.16113, best error:     11603.40234 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 1124.0693359375s, input_fired_time: 10.7789030075, output_fired_time: 9.4424571991, propagate_forward_time: 422.1387939453, propagate_backward_time: 663.9204711914, weight_update_time: 1.3555463552, other_time: 17.7886352539
epoch time: 103.7008895874s, input_fired_time: 1.4839969873, output_fired_time: 0.0000000000, propagate_forward_time: 99.3205795288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8963165283
validation[          , genome  6428] predictions:    6200/  10000 (62.00%), best:    6167/10000 (61.67%), error:     11747.65820, best error:     11603.40234 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 1214.6114501953s, input_fired_time: 11.0881538391, output_fired_time: 10.0341548920, propagate_forward_time: 461.7227783203, propagate_backward_time: 714.6998901367, weight_update_time: 1.4007145166, other_time: 17.0664672852
epoch time: 117.8862457275s, input_fired_time: 1.6212719679, output_fired_time: 0.0000000000, propagate_forward_time: 112.5963973999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6685791016
validation[          , genome  6428] predictions:    6020/  10000 (60.20%), best:    6167/10000 (61.67%), error:     12111.88086, best error:     11603.40234 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1220.0983886719s, input_fired_time: 11.1312522888, output_fired_time: 10.2729291916, propagate_forward_time: 459.6655578613, propagate_backward_time: 720.3066406250, weight_update_time: 1.4171904325, other_time: 18.7220458984
epoch time: 80.4201965332s, input_fired_time: 1.2747324705, output_fired_time: 0.0000000000, propagate_forward_time: 76.2409896851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9044723511
validation[          , genome  6428] predictions:    6166/  10000 (61.66%), best:    6167/10000 (61.67%), error:     11841.44727, best error:     11603.40234 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1219.6192626953s, input_fired_time: 11.1192979813, output_fired_time: 10.1400032043, propagate_forward_time: 461.9407043457, propagate_backward_time: 719.1751708984, weight_update_time: 1.4105371237, other_time: 17.2441406250
epoch time: 88.6462783813s, input_fired_time: 1.3470951319, output_fired_time: 0.0000000000, propagate_forward_time: 84.0393905640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2597961426
validation[          , genome  6428] predictions:    6117/  10000 (61.17%), best:    6167/10000 (61.67%), error:     11857.82813, best error:     11603.40234 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1379.4094238281s, input_fired_time: 12.5642232895, output_fired_time: 11.6247558594, propagate_forward_time: 524.3544311523, propagate_backward_time: 808.8454589844, weight_update_time: 1.5555875301, other_time: 22.0205688477
epoch time: 104.9603881836s, input_fired_time: 1.4868944883, output_fired_time: 0.0000000000, propagate_forward_time: 100.4638137817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0096817017
validation[          , genome  6428] predictions:    6198/  10000 (61.98%), best:    6198/10000 (61.98%), error:     11570.53809, best error:     11570.53809 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 1141.3287353516s, input_fired_time: 10.9222860336, output_fired_time: 9.6000556946, propagate_forward_time: 427.5255737305, propagate_backward_time: 674.0750122070, weight_update_time: 1.3763716221, other_time: 19.2058105469
epoch time: 114.6549377441s, input_fired_time: 1.5802724361, output_fired_time: 0.0000000000, propagate_forward_time: 109.9391174316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1355514526
validation[          , genome  6428] predictions:    6171/  10000 (61.71%), best:    6198/10000 (61.98%), error:     11693.58398, best error:     11570.53809 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 1218.6491699219s, input_fired_time: 11.1473741531, output_fired_time: 10.0485124588, propagate_forward_time: 462.9923095703, propagate_backward_time: 717.2174072266, weight_update_time: 1.4015830755, other_time: 17.2436523438
epoch time: 107.5938796997s, input_fired_time: 1.5388460159, output_fired_time: 0.0000000000, propagate_forward_time: 102.0084075928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0466232300
validation[          , genome  6428] predictions:    6206/  10000 (62.06%), best:    6198/10000 (61.98%), error:     11807.57031, best error:     11570.53809 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 1160.7102050781s, input_fired_time: 10.8096828461, output_fired_time: 9.5996923447, propagate_forward_time: 438.2171630859, propagate_backward_time: 684.7672119141, weight_update_time: 1.3662929535, other_time: 17.3164062500
epoch time: 121.9061813354s, input_fired_time: 1.7467374802, output_fired_time: 0.0000000000, propagate_forward_time: 116.1202163696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0392303467
validation[          , genome  6428] predictions:    6271/  10000 (62.71%), best:    6271/10000 (62.71%), error:     11551.48242, best error:     11551.48242 on epoch:    85, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 1200.1163330078s, input_fired_time: 11.3118638992, output_fired_time: 10.0779390335, propagate_forward_time: 451.8239440918, propagate_backward_time: 707.1366577148, weight_update_time: 1.4125994444, other_time: 19.7659301758
epoch time: 96.3281173706s, input_fired_time: 1.4238736629, output_fired_time: 0.0000000000, propagate_forward_time: 91.4778213501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4264221191
validation[          , genome  6428] predictions:    6186/  10000 (61.86%), best:    6271/10000 (62.71%), error:     11811.50684, best error:     11551.48242 on epoch:    85, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 1219.0895996094s, input_fired_time: 11.3207721710, output_fired_time: 10.1980676651, propagate_forward_time: 461.3068237305, propagate_backward_time: 717.7078857422, weight_update_time: 1.4236426353, other_time: 18.5559692383
epoch time: 85.8844909668s, input_fired_time: 1.4071437120, output_fired_time: 0.0000000000, propagate_forward_time: 80.8970565796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5802917480
validation[          , genome  6428] predictions:    6232/  10000 (62.32%), best:    6271/10000 (62.71%), error:     11645.07520, best error:     11551.48242 on epoch:    85, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 1264.3564453125s, input_fired_time: 11.3676481247, output_fired_time: 10.6026878357, propagate_forward_time: 477.7041625977, propagate_backward_time: 745.7456665039, weight_update_time: 1.4482769966, other_time: 18.9362792969
epoch time: 68.2485809326s, input_fired_time: 1.1669341326, output_fired_time: 0.0000000000, propagate_forward_time: 64.6886825562, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3929672241
validation[          , genome  6428] predictions:    6161/  10000 (61.61%), best:    6271/10000 (62.71%), error:     11621.72949, best error:     11551.48242 on epoch:    85, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1234.5073242188s, input_fired_time: 11.2897377014, output_fired_time: 10.4664020538, propagate_forward_time: 463.2347717285, propagate_backward_time: 729.2095336914, weight_update_time: 1.4373114109, other_time: 20.3068237305
epoch time: 101.6177749634s, input_fired_time: 1.4658622742, output_fired_time: 0.0000000000, propagate_forward_time: 96.6601257324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4917907715
validation[          , genome  6428] predictions:    6178/  10000 (61.78%), best:    6271/10000 (62.71%), error:     11711.80762, best error:     11551.48242 on epoch:    85, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1372.9968261719s, input_fired_time: 12.4282064438, output_fired_time: 11.4035196304, propagate_forward_time: 524.8948974609, propagate_backward_time: 804.4393920898, weight_update_time: 1.5403331518, other_time: 19.8307495117
epoch time: 68.8501586914s, input_fired_time: 1.2602205276, output_fired_time: 0.0000000000, propagate_forward_time: 64.8764343262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7135009766
validation[          , genome  6428] predictions:    6193/  10000 (61.93%), best:    6271/10000 (62.71%), error:     11770.11621, best error:     11551.48242 on epoch:    85, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 1252.3696289063s, input_fired_time: 11.3084640503, output_fired_time: 10.3950386047, propagate_forward_time: 474.6073303223, propagate_backward_time: 738.2754516602, weight_update_time: 1.4303280115, other_time: 17.7833862305
epoch time: 67.0838394165s, input_fired_time: 1.1418386698, output_fired_time: 0.0000000000, propagate_forward_time: 63.5985450745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3434562683
validation[          , genome  6428] predictions:    6147/  10000 (61.47%), best:    6271/10000 (62.71%), error:     11883.48633, best error:     11551.48242 on epoch:    85, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1278.1519775391s, input_fired_time: 11.5437479019, output_fired_time: 10.6619367599, propagate_forward_time: 483.5361938477, propagate_backward_time: 753.0964355469, weight_update_time: 1.4584931135, other_time: 19.3136596680
epoch time: 83.9015655518s, input_fired_time: 1.3329280615, output_fired_time: 0.0000000000, propagate_forward_time: 78.9942474365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5743865967
validation[          , genome  6428] predictions:    6221/  10000 (62.21%), best:    6271/10000 (62.71%), error:     11648.95215, best error:     11551.48242 on epoch:    85, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1181.5917968750s, input_fired_time: 10.9554471970, output_fired_time: 9.8324699402, propagate_forward_time: 446.0364074707, propagate_backward_time: 697.1387939453, weight_update_time: 1.3794506788, other_time: 17.6286621094
epoch time: 116.2815551758s, input_fired_time: 1.5968780518, output_fired_time: 0.0000000000, propagate_forward_time: 111.0453109741, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6393661499
validation[          , genome  6428] predictions:    6158/  10000 (61.58%), best:    6271/10000 (62.71%), error:     11712.01465, best error:     11551.48242 on epoch:    85, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1200.1451416016s, input_fired_time: 11.0383739471, output_fired_time: 9.9631757736, propagate_forward_time: 453.3660278320, propagate_backward_time: 708.4321289063, weight_update_time: 1.3955872059, other_time: 17.3455200195
epoch time: 98.7161407471s, input_fired_time: 1.4406236410, output_fired_time: 0.0000000000, propagate_forward_time: 94.0906982422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1848220825
validation[          , genome  6428] predictions:    6226/  10000 (62.26%), best:    6271/10000 (62.71%), error:     11710.74121, best error:     11551.48242 on epoch:    85, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1268.4506835938s, input_fired_time: 11.4638433456, output_fired_time: 10.6654338837, propagate_forward_time: 477.6904907227, propagate_backward_time: 749.1306152344, weight_update_time: 1.4508620501, other_time: 19.5003051758
epoch time: 67.8101654053s, input_fired_time: 1.1524170637, output_fired_time: 0.0000000000, propagate_forward_time: 64.3057861328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3519592285
validation[          , genome  6428] predictions:    6237/  10000 (62.37%), best:    6271/10000 (62.71%), error:     11592.65039, best error:     11551.48242 on epoch:    85, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1314.2193603516s, input_fired_time: 12.0764045715, output_fired_time: 11.0479211807, propagate_forward_time: 496.9260559082, propagate_backward_time: 772.3966674805, weight_update_time: 1.5009047985, other_time: 21.7722778320
epoch time: 69.4980316162s, input_fired_time: 1.2516708374, output_fired_time: 0.0000000000, propagate_forward_time: 65.5815277100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6648330688
validation[          , genome  6428] predictions:    6296/  10000 (62.96%), best:    6271/10000 (62.71%), error:     11629.72852, best error:     11551.48242 on epoch:    85, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1223.3718261719s, input_fired_time: 11.3572254181, output_fired_time: 10.3051033020, propagate_forward_time: 460.1948547363, propagate_backward_time: 722.0439453125, weight_update_time: 1.4289947748, other_time: 19.4708251953
epoch time: 111.9991760254s, input_fired_time: 1.7571042776, output_fired_time: 0.0000000000, propagate_forward_time: 104.8334121704, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4086608887
validation[          , genome  6428] predictions:    6172/  10000 (61.72%), best:    6271/10000 (62.71%), error:     11735.51660, best error:     11551.48242 on epoch:    85, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1227.8145751953s, input_fired_time: 11.6092138290, output_fired_time: 10.2600059509, propagate_forward_time: 464.2825927734, propagate_backward_time: 722.0871582031, weight_update_time: 1.4420986176, other_time: 19.5755615234
epoch time: 87.7862319946s, input_fired_time: 1.3428214788, output_fired_time: 0.0000000000, propagate_forward_time: 83.1029052734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3405075073
validation[          , genome  6428] predictions:    6269/  10000 (62.69%), best:    6271/10000 (62.71%), error:     11593.16797, best error:     11551.48242 on epoch:    85, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1249.6840820313s, input_fired_time: 11.4804201126, output_fired_time: 10.3988847733, propagate_forward_time: 473.8663330078, propagate_backward_time: 734.5721435547, weight_update_time: 1.4397587776, other_time: 19.3662109375
epoch time: 104.4823303223s, input_fired_time: 1.5005910397, output_fired_time: 0.0000000000, propagate_forward_time: 98.9443130493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0374298096
validation[          , genome  6428] predictions:    6142/  10000 (61.42%), best:    6271/10000 (62.71%), error:     11851.26270, best error:     11551.48242 on epoch:    85, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1201.1494140625s, input_fired_time: 11.0614128113, output_fired_time: 10.0044660568, propagate_forward_time: 452.9971313477, propagate_backward_time: 709.2316894531, weight_update_time: 1.4002074003, other_time: 17.8546752930
epoch time: 97.3010559082s, input_fired_time: 1.4303855896, output_fired_time: 0.0000000000, propagate_forward_time: 92.1109619141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7597045898
validation[          , genome  6428] predictions:    6249/  10000 (62.49%), best:    6271/10000 (62.71%), error:     11618.49707, best error:     11551.48242 on epoch:    85, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 462.2721252441s, input_fired_time: 6.9335446358, output_fired_time: 0.0000000000, propagate_forward_time: 438.8175659180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.5210266113
best training[          , genome  6428] predictions:   40318/  50000 (80.64%), best:    6271/10000 (62.71%), error:     29276.54492, best error:     11551.48242 on epoch:    85, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 90.7386398315s, input_fired_time: 1.3814622164, output_fired_time: 0.0000000000, propagate_forward_time: 86.4418487549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9153289795
   testing[          , genome  6428] predictions:    6271/  10000 (62.71%), best:    6271/10000 (62.71%), error:     11551.48242, best error:     11551.48242 on epoch:    85, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
01:28:38 (2564): called boinc_finish(0)

</stderr_txt>
]]>