Nameexact_genome_1542069603_186_5788_0
Workunit4086000
Created13 Nov 2018, 11:55:29 UTC
Sent13 Nov 2018, 12:25:45 UTC
Report deadline5 Feb 2019, 15:23:55 UTC
Received16 Nov 2018, 21:23:33 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID75310
Run time1 days 8 hours 7 min 33 sec
CPU time1 days 8 hours 7 min 33 sec
Validate stateValid
Credit21,030.93
Device peak FLOPS3.28 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size527.10 MB
Peak swap size529.67 MB
Peak disk usage6.62 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
    13083.38379 on epoch:    12, epoch:   14/100, mu: 0.8392921686, learning_rate: 0.0028537740, weight_decay: 0.0002088856

epoch time: 1054.7366943359s, input_fired_time: 15.8047494888, output_fired_time: 4.6028747559, propagate_forward_time: 409.1176452637, propagate_backward_time: 614.4133300781, weight_update_time: 0.6048852801, other_time: 10.7979736328
epoch time: 84.3195953369s, input_fired_time: 0.7747139335, output_fired_time: 0.0000000000, propagate_forward_time: 81.9246902466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6201934814
validation[          , genome  5788] predictions:    5194/  10000 (51.94%), best:    5477/10000 (54.77%), error:     14417.85938, best error:     13083.38379 on epoch:    12, epoch:   15/100, mu: 0.8503854275, learning_rate: 0.0026833306, weight_decay: 0.0001998910

epoch time: 1057.9226074219s, input_fired_time: 15.8365335464, output_fired_time: 4.6210227013, propagate_forward_time: 410.4829711914, propagate_backward_time: 616.1093139648, weight_update_time: 0.6037097573, other_time: 10.8728027344
epoch time: 84.3910675049s, input_fired_time: 0.7854681015, output_fired_time: 0.0000000000, propagate_forward_time: 81.9813079834, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6242904663
validation[          , genome  5788] predictions:    5488/  10000 (54.88%), best:    5488/10000 (54.88%), error:     12771.37695, best error:     12771.37695 on epoch:    16, epoch:   16/100, mu: 0.8606621027, learning_rate: 0.0025230669, weight_decay: 0.0001912837

epoch time: 1053.9171142578s, input_fired_time: 15.8182544708, output_fired_time: 4.5862255096, propagate_forward_time: 408.8747863770, propagate_backward_time: 613.8590698242, weight_update_time: 0.6019229889, other_time: 10.7788696289
epoch time: 84.1132049561s, input_fired_time: 0.7850114107, output_fired_time: 0.0000000000, propagate_forward_time: 81.7068099976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6213836670
validation[          , genome  5788] predictions:    5623/  10000 (56.23%), best:    5623/10000 (56.23%), error:     12754.73828, best error:     12754.73828 on epoch:    17, epoch:   17/100, mu: 0.8701823354, learning_rate: 0.0023723752, weight_decay: 0.0001830470

epoch time: 1054.0742187500s, input_fired_time: 15.8235521317, output_fired_time: 4.6053271294, propagate_forward_time: 408.2075500488, propagate_backward_time: 614.6112060547, weight_update_time: 0.6036838889, other_time: 10.8265380859
epoch time: 84.3698577881s, input_fired_time: 0.7870783806, output_fired_time: 0.0000000000, propagate_forward_time: 81.9479446411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6348342896
validation[          , genome  5788] predictions:    5511/  10000 (55.11%), best:    5623/10000 (56.23%), error:     12949.13770, best error:     12754.73828 on epoch:    17, epoch:   18/100, mu: 0.8790018559, learning_rate: 0.0022306836, weight_decay: 0.0001751650

epoch time: 1056.7303466797s, input_fired_time: 15.8555240631, output_fired_time: 4.6033930779, propagate_forward_time: 409.4353027344, propagate_backward_time: 616.0376586914, weight_update_time: 0.6048099399, other_time: 10.7985229492
epoch time: 84.9330673218s, input_fired_time: 0.8000081182, output_fired_time: 0.0000000000, propagate_forward_time: 82.5111770630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6218795776
validation[          , genome  5788] predictions:    5667/  10000 (56.67%), best:    5667/10000 (56.67%), error:     12609.60254, best error:     12609.60254 on epoch:    19, epoch:   19/100, mu: 0.8871721625, learning_rate: 0.0020974546, weight_decay: 0.0001676224

epoch time: 1056.8688964844s, input_fired_time: 15.9505672455, output_fired_time: 4.5996007919, propagate_forward_time: 409.5648498535, propagate_backward_time: 615.9179687500, weight_update_time: 0.6056585312, other_time: 10.8359375000
epoch time: 84.5511550903s, input_fired_time: 0.8008378148, output_fired_time: 0.0000000000, propagate_forward_time: 82.1199264526, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6303939819
validation[          , genome  5788] predictions:    5678/  10000 (56.78%), best:    5678/10000 (56.78%), error:     12561.10352, best error:     12561.10352 on epoch:    20, epoch:   20/100, mu: 0.8947410583, learning_rate: 0.0019721829, weight_decay: 0.0001604046

epoch time: 1057.2517089844s, input_fired_time: 15.9063291550, output_fired_time: 4.6012034416, propagate_forward_time: 409.5541992188, propagate_backward_time: 616.3819580078, weight_update_time: 0.6036726832, other_time: 10.8079833984
epoch time: 84.3584213257s, input_fired_time: 0.8008717895, output_fired_time: 0.0000000000, propagate_forward_time: 81.9395141602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6180343628
validation[          , genome  5788] predictions:    5567/  10000 (55.67%), best:    5678/10000 (56.78%), error:     12716.07422, best error:     12561.10352 on epoch:    20, epoch:   21/100, mu: 0.9017528296, learning_rate: 0.0018543930, weight_decay: 0.0001534976

epoch time: 1056.1306152344s, input_fired_time: 15.9374923706, output_fired_time: 4.5998034477, propagate_forward_time: 409.2305603027, propagate_backward_time: 615.5567016602, weight_update_time: 0.6021149158, other_time: 10.8059692383
epoch time: 84.0563659668s, input_fired_time: 0.8073589802, output_fired_time: 0.0000000000, propagate_forward_time: 81.6256332397, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6233749390
validation[          , genome  5788] predictions:    5502/  10000 (55.02%), best:    5678/10000 (56.78%), error:     12799.40430, best error:     12561.10352 on epoch:    20, epoch:   22/100, mu: 0.9082484841, learning_rate: 0.0017436382, weight_decay: 0.0001468880

epoch time: 1057.5689697266s, input_fired_time: 15.9247846603, output_fired_time: 4.6065788269, propagate_forward_time: 409.5119018555, propagate_backward_time: 616.7298583984, weight_update_time: 0.6085164547, other_time: 10.7958374023
epoch time: 83.9889373779s, input_fired_time: 0.8053644896, output_fired_time: 0.0000000000, propagate_forward_time: 81.5689620972, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6146087646
validation[          , genome  5788] predictions:    5766/  10000 (57.66%), best:    5766/10000 (57.66%), error:     12525.43555, best error:     12525.43555 on epoch:    23, epoch:   23/100, mu: 0.9142659903, learning_rate: 0.0016394983, weight_decay: 0.0001405630

epoch time: 1055.4042968750s, input_fired_time: 15.9792499542, output_fired_time: 4.5944833755, propagate_forward_time: 409.4297790527, propagate_backward_time: 614.6072998047, weight_update_time: 0.6062758565, other_time: 10.7934570312
epoch time: 84.2827377319s, input_fired_time: 0.8084114790, output_fired_time: 0.0000000000, propagate_forward_time: 81.8573303223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6169967651
validation[          , genome  5788] predictions:    5762/  10000 (57.62%), best:    5762/10000 (57.62%), error:     12399.14551, best error:     12399.14551 on epoch:    24, epoch:   24/100, mu: 0.9198405743, learning_rate: 0.0015415782, weight_decay: 0.0001345103

epoch time: 1055.6296386719s, input_fired_time: 15.9448928833, output_fired_time: 4.5872735977, propagate_forward_time: 408.9878540039, propagate_backward_time: 615.2802124023, weight_update_time: 0.6024660468, other_time: 10.8293457031
epoch time: 84.2530212402s, input_fired_time: 0.8277381659, output_fired_time: 0.0000000000, propagate_forward_time: 81.8001785278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6251068115
validation[          , genome  5788] predictions:    5710/  10000 (57.10%), best:    5762/10000 (57.62%), error:     12430.58301, best error:     12399.14551 on epoch:    24, epoch:   25/100, mu: 0.9250048399, learning_rate: 0.0014495065, weight_decay: 0.0001287183

epoch time: 1058.3714599609s, input_fired_time: 15.9661369324, output_fired_time: 4.5936131477, propagate_forward_time: 410.6676635742, propagate_backward_time: 616.3221435547, weight_update_time: 0.6041969657, other_time: 10.8218383789
epoch time: 84.4343566895s, input_fired_time: 0.8086505532, output_fired_time: 0.0000000000, propagate_forward_time: 82.0019073486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6238021851
validation[          , genome  5788] predictions:    5592/  10000 (55.92%), best:    5762/10000 (57.62%), error:     12625.73535, best error:     12399.14551 on epoch:    24, epoch:   26/100, mu: 0.9297890067, learning_rate: 0.0013629338, weight_decay: 0.0001231757

epoch time: 1056.4288330078s, input_fired_time: 16.0099277496, output_fired_time: 4.5908098221, propagate_forward_time: 408.6050720215, propagate_backward_time: 616.4325561523, weight_update_time: 0.6063929796, other_time: 10.7904663086
epoch time: 83.9147415161s, input_fired_time: 0.8103649020, output_fired_time: 0.0000000000, propagate_forward_time: 81.4847717285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6196060181
validation[          , genome  5788] predictions:    5686/  10000 (56.86%), best:    5762/10000 (57.62%), error:     12497.11621, best error:     12399.14551 on epoch:    24, epoch:   27/100, mu: 0.9342209697, learning_rate: 0.0012815316, weight_decay: 0.0001178718

epoch time: 1053.4177246094s, input_fired_time: 15.9752492905, output_fired_time: 4.5874991417, propagate_forward_time: 407.6450805664, propagate_backward_time: 614.4339599609, weight_update_time: 0.6041507125, other_time: 10.7759399414
epoch time: 84.2354583740s, input_fired_time: 0.8233432770, output_fired_time: 0.0000000000, propagate_forward_time: 81.7923355103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6197814941
validation[          , genome  5788] predictions:    5794/  10000 (57.94%), best:    5794/10000 (57.94%), error:     12299.58105, best error:     12299.58105 on epoch:    28, epoch:   28/100, mu: 0.9383267164, learning_rate: 0.0012049914, weight_decay: 0.0001127962

epoch time: 1056.2854003906s, input_fired_time: 16.0009880066, output_fired_time: 4.5957088470, propagate_forward_time: 409.1136169434, propagate_backward_time: 615.7578125000, weight_update_time: 0.6014821529, other_time: 10.8172607422
epoch time: 84.0954666138s, input_fired_time: 0.8150001168, output_fired_time: 0.0000000000, propagate_forward_time: 81.6621475220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6183166504
validation[          , genome  5788] predictions:    5889/  10000 (58.89%), best:    5889/10000 (58.89%), error:     12095.54785, best error:     12095.54785 on epoch:    29, epoch:   29/100, mu: 0.9421302676, learning_rate: 0.0011330225, weight_decay: 0.0001079392

epoch time: 1053.4548339844s, input_fired_time: 15.9965248108, output_fired_time: 4.5905427933, propagate_forward_time: 407.9143676758, propagate_backward_time: 614.1579589844, weight_update_time: 0.6044086218, other_time: 10.7953491211
epoch time: 83.8881759644s, input_fired_time: 0.8229591846, output_fired_time: 0.0000000000, propagate_forward_time: 81.4485321045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6166839600
validation[          , genome  5788] predictions:    5913/  10000 (59.13%), best:    5913/10000 (59.13%), error:     11835.30078, best error:     11835.30078 on epoch:    30, epoch:   30/100, mu: 0.9456538558, learning_rate: 0.0010653520, weight_decay: 0.0001032913

epoch time: 1056.3402099609s, input_fired_time: 16.0503520966, output_fired_time: 4.6037759781, propagate_forward_time: 408.8160705566, propagate_backward_time: 616.0953979492, weight_update_time: 0.6046726704, other_time: 10.7747192383
epoch time: 84.1186218262s, input_fired_time: 0.8281389475, output_fired_time: 0.0000000000, propagate_forward_time: 81.6707153320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6197662354
validation[          , genome  5788] predictions:    5873/  10000 (58.73%), best:    5913/10000 (59.13%), error:     11963.34277, best error:     11835.30078 on epoch:    30, epoch:   31/100, mu: 0.9489180446, learning_rate: 0.0010017231, weight_decay: 0.0000988436

epoch time: 1055.5660400391s, input_fired_time: 16.0303688049, output_fired_time: 4.5930018425, propagate_forward_time: 408.9339294434, propagate_backward_time: 615.2383422852, weight_update_time: 0.6021158099, other_time: 10.7703247070
epoch time: 84.0014038086s, input_fired_time: 0.8274820447, output_fired_time: 0.0000000000, propagate_forward_time: 81.5474777222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6264419556
validation[          , genome  5788] predictions:    5867/  10000 (58.67%), best:    5913/10000 (59.13%), error:     11992.18555, best error:     11835.30078 on epoch:    30, epoch:   32/100, mu: 0.9519419670, learning_rate: 0.0009418945, weight_decay: 0.0000945874

epoch time: 1056.0822753906s, input_fired_time: 16.0351181030, output_fired_time: 4.6353201866, propagate_forward_time: 408.9837951660, propagate_backward_time: 615.6194458008, weight_update_time: 0.6032647491, other_time: 10.8085327148
epoch time: 84.3778457642s, input_fired_time: 0.8287659883, output_fired_time: 0.0000000000, propagate_forward_time: 81.9318313599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6172485352
validation[          , genome  5788] predictions:    5890/  10000 (58.90%), best:    5913/10000 (59.13%), error:     11853.07324, best error:     11835.30078 on epoch:    30, epoch:   33/100, mu: 0.9547433257, learning_rate: 0.0008856393, weight_decay: 0.0000905145

epoch time: 1057.5216064453s, input_fired_time: 16.0527133942, output_fired_time: 4.6237626076, propagate_forward_time: 408.9364013672, propagate_backward_time: 617.0603027344, weight_update_time: 0.6053668857, other_time: 10.8483886719
epoch time: 84.1744232178s, input_fired_time: 0.8287687302, output_fired_time: 0.0000000000, propagate_forward_time: 81.7238693237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6217880249
validation[          , genome  5788] predictions:    5735/  10000 (57.35%), best:    5913/10000 (59.13%), error:     12492.07324, best error:     11835.30078 on epoch:    30, epoch:   34/100, mu: 0.9573385119, learning_rate: 0.0008327439, weight_decay: 0.0000866169

epoch time: 1058.3994140625s, input_fired_time: 16.1164207458, output_fired_time: 4.5967268944, propagate_forward_time: 410.5718994141, propagate_backward_time: 616.2553100586, weight_update_time: 0.6041061282, other_time: 10.8590698242
epoch time: 83.9348144531s, input_fired_time: 0.8318556547, output_fired_time: 0.0000000000, propagate_forward_time: 81.4804687500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6224899292
validation[          , genome  5788] predictions:    5879/  10000 (58.79%), best:    5913/10000 (59.13%), error:     11924.75098, best error:     11835.30078 on epoch:    30, epoch:   35/100, mu: 0.9597426653, learning_rate: 0.0007830077, weight_decay: 0.0000828872

epoch time: 1057.6486816406s, input_fired_time: 16.0861892700, output_fired_time: 4.6142191887, propagate_forward_time: 409.6527099609, propagate_backward_time: 616.5066528320, weight_update_time: 0.6026879549, other_time: 10.7888793945
epoch time: 84.3577423096s, input_fired_time: 0.8344550729, output_fired_time: 0.0000000000, propagate_forward_time: 81.8523635864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6709213257
validation[          , genome  5788] predictions:    6085/  10000 (60.85%), best:    6085/10000 (60.85%), error:     11473.46094, best error:     11473.46094 on epoch:    36, epoch:   36/100, mu: 0.9619698524, learning_rate: 0.0007362420, weight_decay: 0.0000793181

epoch time: 1055.8859863281s, input_fired_time: 16.0732421875, output_fired_time: 4.6292486191, propagate_forward_time: 409.1417541504, propagate_backward_time: 615.2576904297, weight_update_time: 0.6027591228, other_time: 10.7840576172
epoch time: 84.6897811890s, input_fired_time: 0.8370191455, output_fired_time: 0.0000000000, propagate_forward_time: 82.2252960205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6274642944
validation[          , genome  5788] predictions:    5979/  10000 (59.79%), best:    6085/10000 (60.85%), error:     11788.23047, best error:     11473.46094 on epoch:    36, epoch:   37/100, mu: 0.9640330672, learning_rate: 0.0006922695, weight_decay: 0.0000759026

epoch time: 1060.2226562500s, input_fired_time: 16.1503105164, output_fired_time: 4.6206440926, propagate_forward_time: 411.5923767090, propagate_backward_time: 617.0487060547, weight_update_time: 0.6067748070, other_time: 10.8106689453
epoch time: 84.2811126709s, input_fired_time: 0.8329463005, output_fired_time: 0.0000000000, propagate_forward_time: 81.8320846558, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6160812378
validation[          , genome  5788] predictions:    6031/  10000 (60.31%), best:    6085/10000 (60.85%), error:     11543.44434, best error:     11473.46094 on epoch:    36, epoch:   38/100, mu: 0.9659444094, learning_rate: 0.0006509233, weight_decay: 0.0000726343

epoch time: 1058.5949707031s, input_fired_time: 16.1091384888, output_fired_time: 4.6150817871, propagate_forward_time: 410.0944519043, propagate_backward_time: 616.9517211914, weight_update_time: 0.6032207608, other_time: 10.8245239258
epoch time: 84.1700744629s, input_fired_time: 0.8381110430, output_fired_time: 0.0000000000, propagate_forward_time: 81.7053451538, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6266174316
validation[          , genome  5788] predictions:    5921/  10000 (59.21%), best:    6085/10000 (60.85%), error:     11756.16211, best error:     11473.46094 on epoch:    36, epoch:   39/100, mu: 0.9677150846, learning_rate: 0.0006120465, weight_decay: 0.0000695066

epoch time: 1060.9086914062s, input_fired_time: 16.1221046448, output_fired_time: 4.6042881012, propagate_forward_time: 412.1329650879, propagate_backward_time: 617.1969604492, weight_update_time: 0.6046433449, other_time: 10.8524780273
epoch time: 84.0084838867s, input_fired_time: 0.8401542306, output_fired_time: 0.0000000000, propagate_forward_time: 81.5472793579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6210479736
validation[          , genome  5788] predictions:    6053/  10000 (60.53%), best:    6053/10000 (60.53%), error:     11463.34668, best error:     11463.34668 on epoch:    40, epoch:   40/100, mu: 0.9693554044, learning_rate: 0.0005754916, weight_decay: 0.0000665137

epoch time: 1054.8822021484s, input_fired_time: 16.0886631012, output_fired_time: 4.5888700485, propagate_forward_time: 408.4952087402, propagate_backward_time: 614.9295654297, weight_update_time: 0.6026230454, other_time: 10.7799072266
epoch time: 83.9398193359s, input_fired_time: 0.8367431164, output_fired_time: 0.0000000000, propagate_forward_time: 81.4851455688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6179275513
validation[          , genome  5788] predictions:    6011/  10000 (60.11%), best:    6053/10000 (60.53%), error:     11562.53613, best error:     11463.34668 on epoch:    40, epoch:   41/100, mu: 0.9708750248, learning_rate: 0.0005411200, weight_decay: 0.0000636496

epoch time: 1056.4382324219s, input_fired_time: 16.1135654449, output_fired_time: 4.5967316628, propagate_forward_time: 408.9155273438, propagate_backward_time: 616.0432739258, weight_update_time: 0.6024908423, other_time: 10.7692260742
epoch time: 84.0742340088s, input_fired_time: 0.8418930769, output_fired_time: 0.0000000000, propagate_forward_time: 81.5832824707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6490554810
validation[          , genome  5788] predictions:    6010/  10000 (60.10%), best:    6053/10000 (60.53%), error:     11572.78809, best error:     11463.34668 on epoch:    40, epoch:   42/100, mu: 0.9722827673, learning_rate: 0.0005088012, weight_decay: 0.0000609088

epoch time: 1060.6396484375s, input_fired_time: 16.1538181305, output_fired_time: 4.6194734573, propagate_forward_time: 411.1870727539, propagate_backward_time: 617.8717041016, weight_update_time: 0.6030815840, other_time: 10.8075561523
epoch time: 84.2592010498s, input_fired_time: 0.8441769481, output_fired_time: 0.0000000000, propagate_forward_time: 81.7979202271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6171035767
validation[          , genome  5788] predictions:    6013/  10000 (60.13%), best:    6013/10000 (60.13%), error:     11430.65332, best error:     11430.65332 on epoch:    43, epoch:   43/100, mu: 0.9735869169, learning_rate: 0.0004784127, weight_decay: 0.0000582861

epoch time: 1057.6567382812s, input_fired_time: 16.1465625763, output_fired_time: 4.5896701813, propagate_forward_time: 410.4202880859, propagate_backward_time: 615.6754760742, weight_update_time: 0.6032408476, other_time: 10.8246459961
epoch time: 84.0040283203s, input_fired_time: 0.8505841494, output_fired_time: 0.0000000000, propagate_forward_time: 81.5358352661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6176071167
validation[          , genome  5788] predictions:    5919/  10000 (59.19%), best:    6013/10000 (60.13%), error:     11860.34766, best error:     11430.65332 on epoch:    43, epoch:   44/100, mu: 0.9747950435, learning_rate: 0.0004498392, weight_decay: 0.0000557763

epoch time: 1058.7280273438s, input_fired_time: 16.1727809906, output_fired_time: 4.5981669426, propagate_forward_time: 410.0281066895, propagate_backward_time: 617.0962524414, weight_update_time: 0.6040158868, other_time: 10.8328247070
epoch time: 84.6850051880s, input_fired_time: 0.8512412310, output_fired_time: 0.0000000000, propagate_forward_time: 82.2029113770, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6308517456
validation[          , genome  5788] predictions:    6044/  10000 (60.44%), best:    6013/10000 (60.13%), error:     11461.13477, best error:     11430.65332 on epoch:    43, epoch:   45/100, mu: 0.9759142399, learning_rate: 0.0004229723, weight_decay: 0.0000533746

epoch time: 1060.0877685547s, input_fired_time: 16.1736412048, output_fired_time: 4.6125550270, propagate_forward_time: 410.6863403320, propagate_backward_time: 617.7935791016, weight_update_time: 0.6044302583, other_time: 10.8217163086
epoch time: 84.1331787109s, input_fired_time: 0.8501346707, output_fired_time: 0.0000000000, propagate_forward_time: 81.6681137085, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6149291992
validation[          , genome  5788] predictions:    5949/  10000 (59.49%), best:    6013/10000 (60.13%), error:     11655.10352, best error:     11430.65332 on epoch:    43, epoch:   46/100, mu: 0.9769510627, learning_rate: 0.0003977100, weight_decay: 0.0000510763

epoch time: 1056.1014404297s, input_fired_time: 16.1928176880, output_fired_time: 4.5922141075, propagate_forward_time: 408.7420349121, propagate_backward_time: 615.7729492188, weight_update_time: 0.6018640399, other_time: 10.8013916016
epoch time: 84.9413375854s, input_fired_time: 0.8580363989, output_fired_time: 0.0000000000, propagate_forward_time: 82.4530410767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6302566528
validation[          , genome  5788] predictions:    5950/  10000 (59.50%), best:    6013/10000 (60.13%), error:     11589.46582, best error:     11430.65332 on epoch:    43, epoch:   47/100, mu: 0.9779115915, learning_rate: 0.0003739565, weight_decay: 0.0000488769

epoch time: 1053.5062255859s, input_fired_time: 16.1452331543, output_fired_time: 4.6104369164, propagate_forward_time: 407.4871826172, propagate_backward_time: 614.4397583008, weight_update_time: 0.6019062996, other_time: 10.8235473633
epoch time: 84.0141067505s, input_fired_time: 0.8496337533, output_fired_time: 0.0000000000, propagate_forward_time: 81.5542602539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6102142334
validation[          , genome  5788] predictions:    6093/  10000 (60.93%), best:    6093/10000 (60.93%), error:     11280.21973, best error:     11280.21973 on epoch:    48, epoch:   48/100, mu: 0.9788013697, learning_rate: 0.0003516217, weight_decay: 0.0000467723

epoch time: 1055.0617675781s, input_fired_time: 16.1630229950, output_fired_time: 4.5931177139, propagate_forward_time: 407.9613342285, propagate_backward_time: 615.5214233398, weight_update_time: 0.6024338603, other_time: 10.8229370117
epoch time: 84.0364761353s, input_fired_time: 0.8575040698, output_fired_time: 0.0000000000, propagate_forward_time: 81.5601119995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6188583374
validation[          , genome  5788] predictions:    6009/  10000 (60.09%), best:    6093/10000 (60.93%), error:     11510.39941, best error:     11280.21973 on epoch:    48, epoch:   49/100, mu: 0.9796257019, learning_rate: 0.0003306209, weight_decay: 0.0000447583

epoch time: 1056.4007568359s, input_fired_time: 16.1790599823, output_fired_time: 4.6029257774, propagate_forward_time: 408.8770141602, propagate_backward_time: 615.9810791016, weight_update_time: 0.6018083692, other_time: 10.7606811523
epoch time: 86.8828887939s, input_fired_time: 0.8638584018, output_fired_time: 0.0000000000, propagate_forward_time: 84.3540802002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6649475098
validation[          , genome  5788] predictions:    6101/  10000 (61.01%), best:    6093/10000 (60.93%), error:     11316.22949, best error:     11280.21973 on epoch:    48, epoch:   50/100, mu: 0.9803893566, learning_rate: 0.0003108743, weight_decay: 0.0000428310

epoch time: 1056.6790771484s, input_fired_time: 16.2177944183, output_fired_time: 4.5926971436, propagate_forward_time: 409.1540527344, propagate_backward_time: 615.9155273438, weight_update_time: 0.6038501263, other_time: 10.7990722656
epoch time: 84.0284957886s, input_fired_time: 0.8546949625, output_fired_time: 0.0000000000, propagate_forward_time: 81.5665130615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6072845459
validation[          , genome  5788] predictions:    6136/  10000 (61.36%), best:    6136/10000 (61.36%), error:     11249.53027, best error:     11249.53027 on epoch:    51, epoch:   51/100, mu: 0.9810967445, learning_rate: 0.0002923071, weight_decay: 0.0000409867

epoch time: 1057.1679687500s, input_fired_time: 16.2042350769, output_fired_time: 4.5987582207, propagate_forward_time: 409.7823791504, propagate_backward_time: 615.8028564453, weight_update_time: 0.6032066941, other_time: 10.7797851562
epoch time: 84.0652770996s, input_fired_time: 0.8531071544, output_fired_time: 0.0000000000, propagate_forward_time: 81.6004791260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6116943359
validation[          , genome  5788] predictions:    6003/  10000 (60.03%), best:    6136/10000 (61.36%), error:     11567.67383, best error:     11249.53027 on epoch:    51, epoch:   52/100, mu: 0.9817520976, learning_rate: 0.0002748489, weight_decay: 0.0000392218

epoch time: 1057.5633544922s, input_fired_time: 16.2328205109, output_fired_time: 4.6134300232, propagate_forward_time: 410.0657043457, propagate_backward_time: 615.8695678711, weight_update_time: 0.6030029058, other_time: 10.7819213867
epoch time: 84.3876800537s, input_fired_time: 0.8543879986, output_fired_time: 0.0000000000, propagate_forward_time: 81.9097900391, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6235046387
validation[          , genome  5788] predictions:    6182/  10000 (61.82%), best:    6182/10000 (61.82%), error:     11127.53906, best error:     11127.53906 on epoch:    53, epoch:   53/100, mu: 0.9823592305, learning_rate: 0.0002584334, weight_decay: 0.0000375329

epoch time: 2227.3508300781s, input_fired_time: 16.2375411987, output_fired_time: 4.6141967773, propagate_forward_time: 409.1985778809, propagate_backward_time: 1786.5003662109, weight_update_time: 0.6039140224, other_time: 10.8000488281
epoch time: 84.7211837769s, input_fired_time: 0.8600394726, output_fired_time: 0.0000000000, propagate_forward_time: 82.2281112671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6330337524
validation[          , genome  5788] predictions:    6155/  10000 (61.55%), best:    6182/10000 (61.82%), error:     11135.00000, best error:     11127.53906 on epoch:    53, epoch:   54/100, mu: 0.9829216599, learning_rate: 0.0002429983, weight_decay: 0.0000359167

epoch time: 1056.0687255859s, input_fired_time: 16.2151374817, output_fired_time: 4.5876178741, propagate_forward_time: 408.8667297363, propagate_backward_time: 615.5780029297, weight_update_time: 0.6045268774, other_time: 10.8212890625
epoch time: 84.2406692505s, input_fired_time: 0.8616909385, output_fired_time: 0.0000000000, propagate_forward_time: 81.7643814087, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6145935059
validation[          , genome  5788] predictions:    6160/  10000 (61.60%), best:    6160/10000 (61.60%), error:     11122.80762, best error:     11122.80762 on epoch:    55, epoch:   55/100, mu: 0.9834426641, learning_rate: 0.0002284851, weight_decay: 0.0000343702

epoch time: 1055.4261474609s, input_fired_time: 16.3324222565, output_fired_time: 4.5840950012, propagate_forward_time: 408.3670349121, propagate_backward_time: 615.3672485352, weight_update_time: 0.6049239039, other_time: 10.7753295898
epoch time: 83.9962997437s, input_fired_time: 0.8772597909, output_fired_time: 0.0000000000, propagate_forward_time: 81.4808044434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6382369995
validation[          , genome  5788] predictions:    6197/  10000 (61.97%), best:    6197/10000 (61.97%), error:     11027.56152, best error:     11027.56152 on epoch:    56, epoch:   56/100, mu: 0.9839253426, learning_rate: 0.0002148386, weight_decay: 0.0000328902

epoch time: 1055.4598388672s, input_fired_time: 16.2343559265, output_fired_time: 4.5974020958, propagate_forward_time: 408.3124694824, propagate_backward_time: 615.5573120117, weight_update_time: 0.6021692157, other_time: 10.7582397461
epoch time: 84.1071166992s, input_fired_time: 0.8648176193, output_fired_time: 0.0000000000, propagate_forward_time: 81.6280899048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6142120361
validation[          , genome  5788] predictions:    6152/  10000 (61.52%), best:    6152/10000 (61.52%), error:     11009.39746, best error:     11009.39746 on epoch:    57, epoch:   57/100, mu: 0.9843724966, learning_rate: 0.0002020073, weight_decay: 0.0000314739

epoch time: 1057.5039062500s, input_fired_time: 16.2479801178, output_fired_time: 4.6074609756, propagate_forward_time: 409.9982299805, propagate_backward_time: 615.8579101562, weight_update_time: 0.6030442715, other_time: 10.7924194336
epoch time: 84.3564300537s, input_fired_time: 0.8665184379, output_fired_time: 0.0000000000, propagate_forward_time: 81.8693923950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6205215454
validation[          , genome  5788] predictions:    6157/  10000 (61.57%), best:    6152/10000 (61.52%), error:     11078.50977, best error:     11009.39746 on epoch:    57, epoch:   58/100, mu: 0.9847867489, learning_rate: 0.0001899423, weight_decay: 0.0000301187

epoch time: 1058.4893798828s, input_fired_time: 16.2576694489, output_fired_time: 4.6204013824, propagate_forward_time: 410.3600769043, propagate_backward_time: 616.4555664062, weight_update_time: 0.6032967567, other_time: 10.7956542969
epoch time: 84.1744308472s, input_fired_time: 0.8661112785, output_fired_time: 0.0000000000, propagate_forward_time: 81.6976013184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6107177734
validation[          , genome  5788] predictions:    6262/  10000 (62.62%), best:    6262/10000 (62.62%), error:     10856.67285, best error:     10856.67285 on epoch:    59, epoch:   59/100, mu: 0.9851704836, learning_rate: 0.0001785978, weight_decay: 0.0000288217

epoch time: 1070.9671630859s, input_fired_time: 16.2951831818, output_fired_time: 4.6522345543, propagate_forward_time: 415.6603698730, propagate_backward_time: 623.4970092773, weight_update_time: 0.6069374681, other_time: 10.8623657227
epoch time: 84.7483291626s, input_fired_time: 0.8691759706, output_fired_time: 0.0000000000, propagate_forward_time: 82.2477416992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6314086914
validation[          , genome  5788] predictions:    6199/  10000 (61.99%), best:    6262/10000 (62.62%), error:     11038.81836, best error:     10856.67285 on epoch:    59, epoch:   60/100, mu: 0.9855259657, learning_rate: 0.0001679310, weight_decay: 0.0000275807

epoch time: 1057.4920654297s, input_fired_time: 16.2597293854, output_fired_time: 4.5837402344, propagate_forward_time: 409.9357604980, propagate_backward_time: 615.9172973633, weight_update_time: 0.6053714156, other_time: 10.7954711914
epoch time: 84.0033187866s, input_fired_time: 0.8655343056, output_fired_time: 0.0000000000, propagate_forward_time: 81.5198135376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6179733276
validation[          , genome  5788] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     10797.90625, best error:     10797.90625 on epoch:    61, epoch:   61/100, mu: 0.9858552814, learning_rate: 0.0001579012, weight_decay: 0.0000263931

epoch time: 2957.9641113281s, input_fired_time: 16.2309913635, output_fired_time: 4.5856375694, propagate_forward_time: 2311.3002929688, propagate_backward_time: 615.0597534180, weight_update_time: 0.6309670806, other_time: 10.7874145508
epoch time: 84.1307220459s, input_fired_time: 0.8691529036, output_fired_time: 0.0000000000, propagate_forward_time: 81.6108093262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6507568359
validation[          , genome  5788] predictions:    6239/  10000 (62.39%), best:    6239/10000 (62.39%), error:     10782.89062, best error:     10782.89062 on epoch:    62, epoch:   62/100, mu: 0.9861603379, learning_rate: 0.0001484704, weight_decay: 0.0000252566

epoch time: 1057.4589843750s, input_fired_time: 16.2545089722, output_fired_time: 4.6045775414, propagate_forward_time: 409.6675109863, propagate_backward_time: 616.1156616211, weight_update_time: 0.6020808220, other_time: 10.8167114258
epoch time: 84.5516967773s, input_fired_time: 0.8724340200, output_fired_time: 0.0000000000, propagate_forward_time: 82.0570907593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6221694946
validation[          , genome  5788] predictions:    6211/  10000 (62.11%), best:    6239/10000 (62.39%), error:     10895.73047, best error:     10782.89062 on epoch:    62, epoch:   63/100, mu: 0.9864429832, learning_rate: 0.0001396029, weight_decay: 0.0000241690

epoch time: 1057.1317138672s, input_fired_time: 16.3116836548, output_fired_time: 4.6464943886, propagate_forward_time: 409.1349182129, propagate_backward_time: 616.2475585938, weight_update_time: 0.6018990278, other_time: 10.7911376953
epoch time: 84.0516967773s, input_fired_time: 0.8712471128, output_fired_time: 0.0000000000, propagate_forward_time: 81.5609436035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6195068359
validation[          , genome  5788] predictions:    6156/  10000 (61.56%), best:    6239/10000 (62.39%), error:     11153.97363, best error:     10782.89062 on epoch:    62, epoch:   64/100, mu: 0.9867048264, learning_rate: 0.0001312651, weight_decay: 0.0000231283

epoch time: 1059.3850097656s, input_fired_time: 16.3227272034, output_fired_time: 4.5984907150, propagate_forward_time: 410.9026489258, propagate_backward_time: 616.7036132812, weight_update_time: 0.6044113636, other_time: 10.8574829102
epoch time: 84.2404251099s, input_fired_time: 0.8681443930, output_fired_time: 0.0000000000, propagate_forward_time: 81.7389984131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6332855225
validation[          , genome  5788] predictions:    6192/  10000 (61.92%), best:    6239/10000 (62.39%), error:     11107.33594, best error:     10782.89062 on epoch:    62, epoch:   65/100, mu: 0.9869473577, learning_rate: 0.0001234252, weight_decay: 0.0000221324

epoch time: 1058.2556152344s, input_fired_time: 16.2656993866, output_fired_time: 4.5894927979, propagate_forward_time: 410.4250488281, propagate_backward_time: 616.1595458984, weight_update_time: 0.6073756814, other_time: 10.8157958984
epoch time: 84.1032638550s, input_fired_time: 0.8730676770, output_fired_time: 0.0000000000, propagate_forward_time: 81.6112747192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6189193726
validation[          , genome  5788] predictions:    6242/  10000 (62.42%), best:    6239/10000 (62.39%), error:     10795.10645, best error:     10782.89062 on epoch:    62, epoch:   66/100, mu: 0.9871720672, learning_rate: 0.0001160535, weight_decay: 0.0000211794

epoch time: 1057.4938964844s, input_fired_time: 16.2895622253, output_fired_time: 4.6015710831, propagate_forward_time: 409.6589355469, propagate_backward_time: 616.1503295898, weight_update_time: 0.6035283208, other_time: 10.7935180664
epoch time: 84.7254791260s, input_fired_time: 0.8728848696, output_fired_time: 0.0000000000, propagate_forward_time: 82.2157669067, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6368255615
validation[          , genome  5788] predictions:    6275/  10000 (62.75%), best:    6275/10000 (62.75%), error:     10743.59570, best error:     10743.59570 on epoch:    67, epoch:   67/100, mu: 0.9873802066, learning_rate: 0.0001091222, weight_decay: 0.0000202674

epoch time: 1072.5847167969s, input_fired_time: 16.3601360321, output_fired_time: 4.6426959038, propagate_forward_time: 415.5379028320, propagate_backward_time: 625.1428833008, weight_update_time: 0.6107535958, other_time: 10.9011230469
epoch time: 84.3208389282s, input_fired_time: 0.8744463325, output_fired_time: 0.0000000000, propagate_forward_time: 81.8303985596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6159973145
validation[          , genome  5788] predictions:    6207/  10000 (62.07%), best:    6275/10000 (62.75%), error:     10901.07910, best error:     10743.59570 on epoch:    67, epoch:   68/100, mu: 0.9875730276, learning_rate: 0.0001026048, weight_decay: 0.0000193947

epoch time: 1055.6657714844s, input_fired_time: 16.3085060120, output_fired_time: 4.6079277992, propagate_forward_time: 408.6984252930, propagate_backward_time: 615.1912231445, weight_update_time: 0.6026848555, other_time: 10.8597412109
epoch time: 83.9814910889s, input_fired_time: 0.8726469278, output_fired_time: 0.0000000000, propagate_forward_time: 81.4984512329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6103897095
validation[          , genome  5788] predictions:    6317/  10000 (63.17%), best:    6317/10000 (63.17%), error:     10712.26465, best error:     10712.26465 on epoch:    69, epoch:   69/100, mu: 0.9877516627, learning_rate: 0.0000964766, weight_decay: 0.0000185595

epoch time: 1058.0974121094s, input_fired_time: 16.2209262848, output_fired_time: 4.6053404808, propagate_forward_time: 407.3055114746, propagate_backward_time: 619.1672973633, weight_update_time: 0.6023567319, other_time: 10.7982788086
epoch time: 84.1873855591s, input_fired_time: 0.8730866313, output_fired_time: 0.0000000000, propagate_forward_time: 81.7116165161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6026840210
validation[          , genome  5788] predictions:    6254/  10000 (62.54%), best:    6317/10000 (63.17%), error:     10757.19336, best error:     10712.26465 on epoch:    69, epoch:   70/100, mu: 0.9879171848, learning_rate: 0.0000907145, weight_decay: 0.0000177604

epoch time: 1058.2772216797s, input_fired_time: 16.2639904022, output_fired_time: 4.6047072411, propagate_forward_time: 409.7168579102, propagate_backward_time: 616.9006958008, weight_update_time: 0.6014155149, other_time: 10.7908935547
epoch time: 83.9698944092s, input_fired_time: 0.8746014833, output_fired_time: 0.0000000000, propagate_forward_time: 81.4841308594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6111602783
validation[          , genome  5788] predictions:    6227/  10000 (62.27%), best:    6317/10000 (63.17%), error:     10953.62109, best error:     10712.26465 on epoch:    69, epoch:   71/100, mu: 0.9880704880, learning_rate: 0.0000852965, weight_decay: 0.0000169956

epoch time: 1051.8602294922s, input_fired_time: 16.2313919067, output_fired_time: 4.5930423737, propagate_forward_time: 407.1721496582, propagate_backward_time: 613.0557861328, weight_update_time: 0.6048839688, other_time: 10.8078613281
epoch time: 83.9687271118s, input_fired_time: 0.8782113194, output_fired_time: 0.0000000000, propagate_forward_time: 81.4724121094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6181030273
validation[          , genome  5788] predictions:    6266/  10000 (62.66%), best:    6317/10000 (63.17%), error:     10758.10547, best error:     10712.26465 on epoch:    69, epoch:   72/100, mu: 0.9882125258, learning_rate: 0.0000802021, weight_decay: 0.0000162638

epoch time: 1050.6040039062s, input_fired_time: 16.2180881500, output_fired_time: 4.5752873421, propagate_forward_time: 406.6235351562, propagate_backward_time: 612.4693603516, weight_update_time: 0.6014756560, other_time: 10.7176513672
epoch time: 83.9616317749s, input_fired_time: 0.8749821186, output_fired_time: 0.0000000000, propagate_forward_time: 81.4689407349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6177062988
validation[          , genome  5788] predictions:    6299/  10000 (62.99%), best:    6299/10000 (62.99%), error:     10687.45801, best error:     10687.45801 on epoch:    73, epoch:   73/100, mu: 0.9883440733, learning_rate: 0.0000754120, weight_decay: 0.0000155635

epoch time: 1053.3569335938s, input_fired_time: 16.3088111877, output_fired_time: 4.5906324387, propagate_forward_time: 408.0400390625, propagate_backward_time: 613.6893920898, weight_update_time: 0.5998681784, other_time: 10.7280883789
epoch time: 83.9242782593s, input_fired_time: 0.8737600446, output_fired_time: 0.0000000000, propagate_forward_time: 81.4384002686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6121215820
validation[          , genome  5788] predictions:    6301/  10000 (63.01%), best:    6299/10000 (62.99%), error:     10702.05273, best error:     10687.45801 on epoch:    73, epoch:   74/100, mu: 0.9884659648, learning_rate: 0.0000709080, weight_decay: 0.0000148933

epoch time: 1055.6497802734s, input_fired_time: 16.2781352997, output_fired_time: 4.5892190933, propagate_forward_time: 408.5854492188, propagate_backward_time: 615.3639526367, weight_update_time: 0.6059125066, other_time: 10.8330688477
epoch time: 84.3343811035s, input_fired_time: 0.8782675862, output_fired_time: 0.0000000000, propagate_forward_time: 81.8329620361, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6231536865
validation[          , genome  5788] predictions:    6252/  10000 (62.52%), best:    6299/10000 (62.99%), error:     10811.90234, best error:     10687.45801 on epoch:    73, epoch:   75/100, mu: 0.9885788560, learning_rate: 0.0000666730, weight_decay: 0.0000142520

epoch time: 9430.9521484375s, input_fired_time: 16.3412628174, output_fired_time: 4.6312327385, propagate_forward_time: 411.2646789551, propagate_backward_time: 8987.7177734375, weight_update_time: 0.6079049110, other_time: 10.9980468750
epoch time: 84.5861968994s, input_fired_time: 0.8926419616, output_fired_time: 0.0000000000, propagate_forward_time: 82.0074462891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6861114502
validation[          , genome  5788] predictions:    6267/  10000 (62.67%), best:    6299/10000 (62.99%), error:     10756.09473, best error:     10687.45801 on epoch:    73, epoch:   76/100, mu: 0.9886834621, learning_rate: 0.0000626909, weight_decay: 0.0000136383

epoch time: 1065.1604003906s, input_fired_time: 16.3989734650, output_fired_time: 4.7524352074, propagate_forward_time: 413.2535400391, propagate_backward_time: 619.1418457031, weight_update_time: 0.6276384592, other_time: 11.6136474609
epoch time: 85.1211853027s, input_fired_time: 0.8919088244, output_fired_time: 0.0000000000, propagate_forward_time: 82.5504760742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6788024902
validation[          , genome  5788] predictions:    6290/  10000 (62.90%), best:    6290/10000 (62.90%), error:     10658.23535, best error:     10658.23535 on epoch:    77, epoch:   77/100, mu: 0.9887803793, learning_rate: 0.0000589466, weight_decay: 0.0000130510

epoch time: 1064.9744873047s, input_fired_time: 16.3734245300, output_fired_time: 4.6878728867, propagate_forward_time: 412.1238098145, propagate_backward_time: 620.4700927734, weight_update_time: 0.6166233420, other_time: 11.3193359375
epoch time: 84.6197814941s, input_fired_time: 0.8852221370, output_fired_time: 0.0000000000, propagate_forward_time: 82.1144638062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6200942993
validation[          , genome  5788] predictions:    6391/  10000 (63.91%), best:    6391/10000 (63.91%), error:     10519.24414, best error:     10519.24414 on epoch:    78, epoch:   78/100, mu: 0.9888701439, learning_rate: 0.0000554260, weight_decay: 0.0000124891

epoch time: 1063.1358642578s, input_fired_time: 16.4430332184, output_fired_time: 4.6765246391, propagate_forward_time: 412.5791931152, propagate_backward_time: 618.0932617188, weight_update_time: 0.6192053556, other_time: 11.3438720703
epoch time: 85.2317199707s, input_fired_time: 0.8928473592, output_fired_time: 0.0000000000, propagate_forward_time: 82.6604995728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6783752441
validation[          , genome  5788] predictions:    6321/  10000 (63.21%), best:    6391/10000 (63.91%), error:     10671.08887, best error:     10519.24414 on epoch:    78, epoch:   79/100, mu: 0.9889532924, learning_rate: 0.0000521156, weight_decay: 0.0000119513

epoch time: 1059.7319335938s, input_fired_time: 16.3869037628, output_fired_time: 4.7199048996, propagate_forward_time: 410.1706542969, propagate_backward_time: 616.8319702148, weight_update_time: 0.6275979280, other_time: 11.6224975586
epoch time: 84.3948593140s, input_fired_time: 0.8902856112, output_fired_time: 0.0000000000, propagate_forward_time: 81.8452758789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6592941284
validation[          , genome  5788] predictions:    6341/  10000 (63.41%), best:    6391/10000 (63.91%), error:     10644.50781, best error:     10519.24414 on epoch:    78, epoch:   80/100, mu: 0.9890303612, learning_rate: 0.0000490030, weight_decay: 0.0000114367

epoch time: 1060.8876953125s, input_fired_time: 16.3489036560, output_fired_time: 4.6669454575, propagate_forward_time: 409.5887145996, propagate_backward_time: 619.1170654297, weight_update_time: 0.6125344038, other_time: 11.1660156250
epoch time: 84.3577194214s, input_fired_time: 0.8836742640, output_fired_time: 0.0000000000, propagate_forward_time: 81.8476943970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6263504028
validation[          , genome  5788] predictions:    6296/  10000 (62.96%), best:    6391/10000 (63.91%), error:     10680.58691, best error:     10519.24414 on epoch:    78, epoch:   81/100, mu: 0.9891017079, learning_rate: 0.0000460763, weight_decay: 0.0000109442

epoch time: 1014.5286254883s, input_fired_time: 15.7262239456, output_fired_time: 4.4230966568, propagate_forward_time: 392.4472045898, propagate_backward_time: 591.4223632812, weight_update_time: 0.5823129416, other_time: 10.5097656250
epoch time: 84.5597839355s, input_fired_time: 0.8888333440, output_fired_time: 0.0000000000, propagate_forward_time: 82.0359039307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6350479126
validation[          , genome  5788] predictions:    6268/  10000 (62.68%), best:    6391/10000 (63.91%), error:     10672.19824, best error:     10519.24414 on epoch:    78, epoch:   82/100, mu: 0.9891678095, learning_rate: 0.0000433243, weight_decay: 0.0000104729

epoch time: 1044.2427978516s, input_fired_time: 16.1616230011, output_fired_time: 4.5656380653, propagate_forward_time: 404.5174865723, propagate_backward_time: 608.2039184570, weight_update_time: 0.5984084010, other_time: 10.7941284180
epoch time: 85.3718719482s, input_fired_time: 0.8953111768, output_fired_time: 0.0000000000, propagate_forward_time: 82.8314056396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6451568604
validation[          , genome  5788] predictions:    6312/  10000 (63.12%), best:    6391/10000 (63.91%), error:     10579.01465, best error:     10519.24414 on epoch:    78, epoch:   83/100, mu: 0.9892290831, learning_rate: 0.0000407368, weight_decay: 0.0000100220

epoch time: 1058.9001464844s, input_fired_time: 16.3926849365, output_fired_time: 4.5990185738, propagate_forward_time: 410.1076660156, propagate_backward_time: 616.8654785156, weight_update_time: 0.6052457094, other_time: 10.9353027344
epoch time: 78.6210861206s, input_fired_time: 0.8431305289, output_fired_time: 0.0000000000, propagate_forward_time: 76.2455978394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5323562622
validation[          , genome  5788] predictions:    6337/  10000 (63.37%), best:    6391/10000 (63.91%), error:     10562.66309, best error:     10519.24414 on epoch:    78, epoch:   84/100, mu: 0.9892858267, learning_rate: 0.0000383037, weight_decay: 0.0000095904

epoch time: 1051.9543457031s, input_fired_time: 16.2898578644, output_fired_time: 4.5888614655, propagate_forward_time: 406.7154235840, propagate_backward_time: 613.4328613281, weight_update_time: 0.6059553027, other_time: 10.9272460938
epoch time: 85.4940872192s, input_fired_time: 0.8983266950, output_fired_time: 0.0000000000, propagate_forward_time: 82.9515380859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6442260742
validation[          , genome  5788] predictions:    6369/  10000 (63.69%), best:    6391/10000 (63.91%), error:     10546.62891, best error:     10519.24414 on epoch:    78, epoch:   85/100, mu: 0.9893383980, learning_rate: 0.0000360160, weight_decay: 0.0000091775

epoch time: 1052.5329589844s, input_fired_time: 16.2868747711, output_fired_time: 4.6042599678, propagate_forward_time: 407.7138671875, propagate_backward_time: 613.0927734375, weight_update_time: 0.6008011103, other_time: 10.8352050781
epoch time: 85.0720901489s, input_fired_time: 0.8995654583, output_fired_time: 0.0000000000, propagate_forward_time: 82.5297088623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6428146362
validation[          , genome  5788] predictions:    6361/  10000 (63.61%), best:    6391/10000 (63.91%), error:     10536.93750, best error:     10519.24414 on epoch:    78, epoch:   86/100, mu: 0.9893870950, learning_rate: 0.0000338649, weight_decay: 0.0000087823

epoch time: 1047.9195556641s, input_fired_time: 16.2121429443, output_fired_time: 4.5686101913, propagate_forward_time: 405.2974548340, propagate_backward_time: 611.0644531250, weight_update_time: 0.5986296535, other_time: 10.7768554688
epoch time: 84.2522811890s, input_fired_time: 0.8934366703, output_fired_time: 0.0000000000, propagate_forward_time: 81.7357559204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6230850220
validation[          , genome  5788] predictions:    6370/  10000 (63.70%), best:    6370/10000 (63.70%), error:     10463.42969, best error:     10463.42969 on epoch:    87, epoch:   87/100, mu: 0.9894322157, learning_rate: 0.0000318423, weight_decay: 0.0000084041

epoch time: 1051.5756835938s, input_fired_time: 16.3209342957, output_fired_time: 4.5732603073, propagate_forward_time: 407.4557189941, propagate_backward_time: 612.4116210938, weight_update_time: 0.6004668474, other_time: 10.8142089844
epoch time: 84.9224166870s, input_fired_time: 0.9008318186, output_fired_time: 0.0000000000, propagate_forward_time: 82.3894271851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6321563721
validation[          , genome  5788] predictions:    6363/  10000 (63.63%), best:    6370/10000 (63.70%), error:     10497.43750, best error:     10463.42969 on epoch:    87, epoch:   88/100, mu: 0.9894739985, learning_rate: 0.0000299405, weight_decay: 0.0000080422

epoch time: 1055.9903564453s, input_fired_time: 16.3409347534, output_fired_time: 4.6049885750, propagate_forward_time: 408.7079162598, propagate_backward_time: 615.4292602539, weight_update_time: 0.6035395861, other_time: 10.9072875977
epoch time: 81.1479797363s, input_fired_time: 0.8607526422, output_fired_time: 0.0000000000, propagate_forward_time: 78.7095947266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5776290894
validation[          , genome  5788] predictions:    6352/  10000 (63.52%), best:    6370/10000 (63.70%), error:     10536.86328, best error:     10463.42969 on epoch:    87, epoch:   89/100, mu: 0.9895127416, learning_rate: 0.0000281523, weight_decay: 0.0000076959

epoch time: 1059.6146240234s, input_fired_time: 16.3787593842, output_fired_time: 4.6097307205, propagate_forward_time: 409.9787292480, propagate_backward_time: 617.7874145508, weight_update_time: 0.6042402387, other_time: 10.8599243164
epoch time: 84.4670410156s, input_fired_time: 0.8917687535, output_fired_time: 0.0000000000, propagate_forward_time: 81.9484100342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6268615723
validation[          , genome  5788] predictions:    6390/  10000 (63.90%), best:    6370/10000 (63.70%), error:     10479.15039, best error:     10463.42969 on epoch:    87, epoch:   90/100, mu: 0.9895486236, learning_rate: 0.0000264709, weight_decay: 0.0000073646

epoch time: 1043.2011718750s, input_fired_time: 16.1212844849, output_fired_time: 4.5829401016, propagate_forward_time: 402.2223815918, propagate_backward_time: 609.0601196289, weight_update_time: 0.6049015522, other_time: 11.2144165039
epoch time: 84.0479125977s, input_fired_time: 0.8932906389, output_fired_time: 0.0000000000, propagate_forward_time: 81.5251388550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6294860840
validation[          , genome  5788] predictions:    6325/  10000 (63.25%), best:    6370/10000 (63.70%), error:     10579.75000, best error:     10463.42969 on epoch:    87, epoch:   91/100, mu: 0.9895818233, learning_rate: 0.0000248899, weight_decay: 0.0000070474

epoch time: 1035.8027343750s, input_fired_time: 15.9672842026, output_fired_time: 4.5358524323, propagate_forward_time: 400.9959411621, propagate_backward_time: 603.3693237305, weight_update_time: 0.5891987085, other_time: 10.9343872070
epoch time: 84.9732971191s, input_fired_time: 0.8998606205, output_fired_time: 0.0000000000, propagate_forward_time: 82.3732147217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7002182007
validation[          , genome  5788] predictions:    6391/  10000 (63.91%), best:    6370/10000 (63.70%), error:     10464.64941, best error:     10463.42969 on epoch:    87, epoch:   92/100, mu: 0.9896125793, learning_rate: 0.0000234033, weight_decay: 0.0000067440

epoch time: 1056.5837402344s, input_fired_time: 16.3598899841, output_fired_time: 4.6084136963, propagate_forward_time: 408.5896301270, propagate_backward_time: 615.9351806641, weight_update_time: 0.6117401719, other_time: 11.0906982422
epoch time: 84.4940032959s, input_fired_time: 0.8949841857, output_fired_time: 0.0000000000, propagate_forward_time: 81.9724807739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6265411377
validation[          , genome  5788] predictions:    6344/  10000 (63.44%), best:    6370/10000 (63.70%), error:     10517.57812, best error:     10463.42969 on epoch:    87, epoch:   93/100, mu: 0.9896410704, learning_rate: 0.0000220056, weight_decay: 0.0000064536

epoch time: 1065.9980468750s, input_fired_time: 16.4606399536, output_fired_time: 4.6296696663, propagate_forward_time: 413.6296691895, propagate_backward_time: 620.2078247070, weight_update_time: 0.6106724739, other_time: 11.0702514648
epoch time: 78.9573974609s, input_fired_time: 0.8437560797, output_fired_time: 0.0000000000, propagate_forward_time: 76.5675277710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5461120605
validation[          , genome  5788] predictions:    6386/  10000 (63.86%), best:    6386/10000 (63.86%), error:     10442.68457, best error:     10442.68457 on epoch:    94, epoch:   94/100, mu: 0.9896674752, learning_rate: 0.0000206913, weight_decay: 0.0000061757

epoch time: 1064.7027587891s, input_fired_time: 16.4449214935, output_fired_time: 4.6238684654, propagate_forward_time: 412.4286193848, propagate_backward_time: 620.1408081055, weight_update_time: 0.6105249524, other_time: 11.0645141602
epoch time: 83.6889419556s, input_fired_time: 0.9001047611, output_fired_time: 0.0000000000, propagate_forward_time: 81.0853347778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7034988403
validation[          , genome  5788] predictions:    6367/  10000 (63.67%), best:    6367/10000 (63.67%), error:     10438.50879, best error:     10438.50879 on epoch:    95, epoch:   95/100, mu: 0.9896919727, learning_rate: 0.0000194555, weight_decay: 0.0000059098

epoch time: 1045.8300781250s, input_fired_time: 16.1891021729, output_fired_time: 4.5933094025, propagate_forward_time: 404.7541809082, propagate_backward_time: 609.3063964844, weight_update_time: 0.6010377407, other_time: 10.9871826172
epoch time: 85.9498596191s, input_fired_time: 0.9086408615, output_fired_time: 0.0000000000, propagate_forward_time: 83.3939208984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6473007202
validation[          , genome  5788] predictions:    6381/  10000 (63.81%), best:    6367/10000 (63.67%), error:     10451.48730, best error:     10438.50879 on epoch:    95, epoch:   96/100, mu: 0.9897146225, learning_rate: 0.0000182935, weight_decay: 0.0000056553

epoch time: 1056.4635009766s, input_fired_time: 16.3416881561, output_fired_time: 4.6346611977, propagate_forward_time: 409.2971801758, propagate_backward_time: 615.1561889648, weight_update_time: 0.6056446433, other_time: 11.0338134766
epoch time: 84.9025650024s, input_fired_time: 0.9072126746, output_fired_time: 0.0000000000, propagate_forward_time: 82.3489990234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6463546753
validation[          , genome  5788] predictions:    6377/  10000 (63.77%), best:    6367/10000 (63.67%), error:     10466.69922, best error:     10438.50879 on epoch:    95, epoch:   97/100, mu: 0.9897356033, learning_rate: 0.0000172009, weight_decay: 0.0000054118

epoch time: 1051.7757568359s, input_fired_time: 16.2704467773, output_fired_time: 4.5639648438, propagate_forward_time: 407.4517517090, propagate_backward_time: 612.4875488281, weight_update_time: 0.6074078083, other_time: 11.0020751953
epoch time: 85.1443023682s, input_fired_time: 0.9043309093, output_fired_time: 0.0000000000, propagate_forward_time: 82.6063385010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6336364746
validation[          , genome  5788] predictions:    6355/  10000 (63.55%), best:    6367/10000 (63.67%), error:     10456.37500, best error:     10438.50879 on epoch:    95, epoch:   98/100, mu: 0.9897550941, learning_rate: 0.0000161735, weight_decay: 0.0000051787

epoch time: 1063.1000976562s, input_fired_time: 16.4569015503, output_fired_time: 4.6122827530, propagate_forward_time: 413.0807495117, propagate_backward_time: 617.9780273438, weight_update_time: 0.6053734422, other_time: 10.9721069336
epoch time: 82.3425369263s, input_fired_time: 0.8791345954, output_fired_time: 0.0000000000, propagate_forward_time: 79.8489379883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6144638062
validation[          , genome  5788] predictions:    6398/  10000 (63.98%), best:    6367/10000 (63.67%), error:     10474.22168, best error:     10438.50879 on epoch:    95, epoch:   99/100, mu: 0.9897730947, learning_rate: 0.0000152076, weight_decay: 0.0000049557

epoch time: 1062.9311523438s, input_fired_time: 16.3401641846, output_fired_time: 4.6040244102, propagate_forward_time: 411.7563476562, propagate_backward_time: 619.1808471680, weight_update_time: 0.6144371033, other_time: 11.0497436523
epoch time: 85.1261291504s, input_fired_time: 0.9236613512, output_fired_time: 0.0000000000, propagate_forward_time: 82.5480651855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6544036865
validation[          , genome  5788] predictions:    6350/  10000 (63.50%), best:    6367/10000 (63.67%), error:     10500.27246, best error:     10438.50879 on epoch:    95, epoch:  100/100, mu: 0.9897897840, learning_rate: 0.0000142993, weight_decay: 0.0000047423

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 414.4429016113s, input_fired_time: 4.4333896637, output_fired_time: 0.0000000000, propagate_forward_time: 401.8573913574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.1521301270
best training[          , genome  5788] predictions:   36896/  50000 (73.79%), best:    6367/10000 (63.67%), error:     39363.84375, best error:     10438.50879 on epoch:    95, epoch:  101/100, mu: 0.9898052812, learning_rate: 0.0000134453, weight_decay: 0.0000045381
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 85.3839187622s, input_fired_time: 0.9041149616, output_fired_time: 0.0000000000, propagate_forward_time: 82.7962341309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6835708618
   testing[          , genome  5788] predictions:    6367/  10000 (63.67%), best:    6367/10000 (63.67%), error:     10438.50879, best error:     10438.50879 on epoch:    95, epoch:  101/100, mu: 0.9898052812, learning_rate: 0.0000134453, weight_decay: 0.0000045381
backpropagation finished successfully!
21:22:46 (19229): called boinc_finish(0)

</stderr_txt>
]]>