Nameexact_genome_1518178202_54_18333_1
Workunit2991769
Created9 Feb 2018, 13:42:34 UTC
Sent9 Feb 2018, 14:21:52 UTC
Report deadline19 Mar 2018, 20:35:18 UTC
Received12 Feb 2018, 9:45:09 UTC
Server stateOver
OutcomeValidate error
Client stateDone
Exit status0 (0x0)
Computer ID60844
Run time12 hours 43 min 39 sec
CPU time12 hours 43 min 39 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS2.79 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size170.20 MB
Peak swap size172.94 MB
Peak disk usage2.23 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2048473358
validation[          , genome 18333] predictions:    9842/  10000 (98.42%), best:    9865/10000 (98.65%), error:       518.82336, best error:       428.87326 on epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 410.7830200195s, input_fired_time: 6.7046103477, output_fired_time: 4.7371606827, propagate_forward_time: 152.1114807129, propagate_backward_time: 240.7107696533, weight_update_time: 0.3690458834, other_time: 6.5189971924
epoch time: 32.3354263306s, input_fired_time: 0.6857953072, output_fired_time: 0.0000000000, propagate_forward_time: 30.4458122253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2038192749
validation[          , genome 18333] predictions:    9822/  10000 (98.22%), best:    9865/10000 (98.65%), error:       541.79572, best error:       428.87326 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 416.7816772461s, input_fired_time: 6.7694153786, output_fired_time: 4.7678289413, propagate_forward_time: 154.3161621094, propagate_backward_time: 244.3875427246, weight_update_time: 0.3727851808, other_time: 6.5407409668
epoch time: 32.3618659973s, input_fired_time: 0.6964200139, output_fired_time: 0.0000000000, propagate_forward_time: 30.4586067200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2068386078
validation[          , genome 18333] predictions:    9855/  10000 (98.55%), best:    9865/10000 (98.65%), error:       446.69525, best error:       428.87326 on epoch:    12, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 429.7911987305s, input_fired_time: 6.9113407135, output_fired_time: 4.9216980934, propagate_forward_time: 158.3730316162, propagate_backward_time: 252.9726409912, weight_update_time: 0.3798732460, other_time: 6.6125030518
epoch time: 32.3549461365s, input_fired_time: 0.6987267137, output_fired_time: 0.0000000000, propagate_forward_time: 30.4556293488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2005901337
validation[          , genome 18333] predictions:    9861/  10000 (98.61%), best:    9861/10000 (98.61%), error:       427.10532, best error:       427.10532 on epoch:    17, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 411.3136291504s, input_fired_time: 6.7343668938, output_fired_time: 4.7688298225, propagate_forward_time: 152.1577758789, propagate_backward_time: 241.1448059082, weight_update_time: 0.3690561354, other_time: 6.5078430176
epoch time: 32.3612060547s, input_fired_time: 0.7035369873, output_fired_time: 0.0000000000, propagate_forward_time: 30.4560184479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2016506195
validation[          , genome 18333] predictions:    9834/  10000 (98.34%), best:    9861/10000 (98.61%), error:       546.90753, best error:       427.10532 on epoch:    17, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 410.6947631836s, input_fired_time: 6.7480325699, output_fired_time: 4.7180819511, propagate_forward_time: 152.1856231689, propagate_backward_time: 240.5386962891, weight_update_time: 0.3689991832, other_time: 6.5043182373
epoch time: 32.3554229736s, input_fired_time: 0.6968091726, output_fired_time: 0.0000000000, propagate_forward_time: 30.4573345184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2012786865
validation[          , genome 18333] predictions:    9805/  10000 (98.05%), best:    9861/10000 (98.61%), error:       646.04303, best error:       427.10532 on epoch:    17, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 423.4376525879s, input_fired_time: 6.8684058189, output_fired_time: 4.8232073784, propagate_forward_time: 156.3890533447, propagate_backward_time: 248.7926940918, weight_update_time: 0.3753701150, other_time: 6.5642852783
epoch time: 32.8615646362s, input_fired_time: 0.7067750096, output_fired_time: 0.0000000000, propagate_forward_time: 30.9458904266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2088985443
validation[          , genome 18333] predictions:    9854/  10000 (98.54%), best:    9861/10000 (98.61%), error:       444.00699, best error:       427.10532 on epoch:    17, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 2189.8559570312s, input_fired_time: 6.9672355652, output_fired_time: 4.9747700691, propagate_forward_time: 160.6718444824, propagate_backward_time: 2010.6051025391, weight_update_time: 0.3833422959, other_time: 6.6368408203
epoch time: 32.3352699280s, input_fired_time: 0.6949824691, output_fired_time: 0.0000000000, propagate_forward_time: 30.4435997009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1966876984
validation[          , genome 18333] predictions:    9845/  10000 (98.45%), best:    9861/10000 (98.61%), error:       507.46756, best error:       427.10532 on epoch:    17, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 411.5053710938s, input_fired_time: 6.7356295586, output_fired_time: 4.7715106010, propagate_forward_time: 152.2380218506, propagate_backward_time: 241.2645721436, weight_update_time: 0.3686057925, other_time: 6.4956359863
epoch time: 32.4260292053s, input_fired_time: 0.6990790963, output_fired_time: 0.0000000000, propagate_forward_time: 30.5244884491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2024612427
validation[          , genome 18333] predictions:    9846/  10000 (98.46%), best:    9861/10000 (98.61%), error:       497.20953, best error:       427.10532 on epoch:    17, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 412.0700683594s, input_fired_time: 6.7478122711, output_fired_time: 4.7775182724, propagate_forward_time: 152.4191894531, propagate_backward_time: 241.6156921387, weight_update_time: 0.3689474165, other_time: 6.5098571777
epoch time: 32.3805007935s, input_fired_time: 0.6959592700, output_fired_time: 0.0000000000, propagate_forward_time: 30.4821891785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2023525238
validation[          , genome 18333] predictions:    9819/  10000 (98.19%), best:    9861/10000 (98.61%), error:       507.71713, best error:       427.10532 on epoch:    17, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 411.7768859863s, input_fired_time: 6.7591691017, output_fired_time: 4.7651572227, propagate_forward_time: 152.5582122803, propagate_backward_time: 241.1841125488, weight_update_time: 0.3690042794, other_time: 6.5102386475
epoch time: 32.3844490051s, input_fired_time: 0.7014384866, output_fired_time: 0.0000000000, propagate_forward_time: 30.4804897308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2025203705
validation[          , genome 18333] predictions:    9851/  10000 (98.51%), best:    9861/10000 (98.61%), error:       474.76367, best error:       427.10532 on epoch:    17, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 410.3845825195s, input_fired_time: 6.7427635193, output_fired_time: 4.6707949638, propagate_forward_time: 152.3248443604, propagate_backward_time: 240.1372375488, weight_update_time: 0.3690701127, other_time: 6.5089263916
epoch time: 43.6783561707s, input_fired_time: 0.8770804405, output_fired_time: 0.0000000000, propagate_forward_time: 41.4478530884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3534240723
validation[          , genome 18333] predictions:    9858/  10000 (98.58%), best:    9861/10000 (98.61%), error:       461.80243, best error:       427.10532 on epoch:    17, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 413.5392456055s, input_fired_time: 6.7759866714, output_fired_time: 4.6857328415, propagate_forward_time: 153.3138885498, propagate_backward_time: 242.2360992432, weight_update_time: 0.3703953922, other_time: 6.5275268555
epoch time: 32.3955192566s, input_fired_time: 0.7016865611, output_fired_time: 0.0000000000, propagate_forward_time: 30.4887332916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2050991058
validation[          , genome 18333] predictions:    9836/  10000 (98.36%), best:    9861/10000 (98.61%), error:       540.29108, best error:       427.10532 on epoch:    17, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 409.7817687988s, input_fired_time: 6.7504391670, output_fired_time: 4.6312365532, propagate_forward_time: 152.3000183105, propagate_backward_time: 239.5855407715, weight_update_time: 0.3690506518, other_time: 6.5145568848
epoch time: 32.3816413879s, input_fired_time: 0.7021754980, output_fired_time: 0.0000000000, propagate_forward_time: 30.4763412476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2031250000
validation[          , genome 18333] predictions:    9865/  10000 (98.65%), best:    9865/10000 (98.65%), error:       419.50305, best error:       419.50305 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 418.6192626953s, input_fired_time: 6.8424487114, output_fired_time: 4.7292833328, propagate_forward_time: 155.0623931885, propagate_backward_time: 245.4179077148, weight_update_time: 0.3740348816, other_time: 6.5672454834
epoch time: 35.3061752319s, input_fired_time: 0.7427821159, output_fired_time: 0.0000000000, propagate_forward_time: 33.3253860474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2380065918
validation[          , genome 18333] predictions:    9867/  10000 (98.67%), best:    9865/10000 (98.65%), error:       441.25882, best error:       419.50305 on epoch:    27, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 423.5333862305s, input_fired_time: 6.8614716530, output_fired_time: 4.8601260185, propagate_forward_time: 156.1785583496, propagate_backward_time: 249.0708618164, weight_update_time: 0.3757342696, other_time: 6.5623474121
epoch time: 38.9704666138s, input_fired_time: 0.8002117276, output_fired_time: 0.0000000000, propagate_forward_time: 36.8888854980, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2813682556
validation[          , genome 18333] predictions:    9840/  10000 (98.40%), best:    9865/10000 (98.65%), error:       542.20844, best error:       419.50305 on epoch:    27, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 564.5011596680s, input_fired_time: 8.1616210938, output_fired_time: 6.1828994751, propagate_forward_time: 202.8375244141, propagate_backward_time: 340.0739746094, weight_update_time: 0.4550239444, other_time: 7.2451171875
epoch time: 50.2181701660s, input_fired_time: 0.9706853628, output_fired_time: 0.0000000000, propagate_forward_time: 47.8221893311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4252967834
validation[          , genome 18333] predictions:    9843/  10000 (98.43%), best:    9865/10000 (98.65%), error:       529.75537, best error:       419.50305 on epoch:    27, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 472.6987915039s, input_fired_time: 7.3067879677, output_fired_time: 5.3310823441, propagate_forward_time: 172.3997192383, propagate_backward_time: 280.8556823730, weight_update_time: 0.4028809667, other_time: 6.8055114746
epoch time: 32.3754768372s, input_fired_time: 0.7027890682, output_fired_time: 0.0000000000, propagate_forward_time: 30.4702053070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2024822235
validation[          , genome 18333] predictions:    9889/  10000 (98.89%), best:    9889/10000 (98.89%), error:       350.77377, best error:       350.77377 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 816.7954711914s, input_fired_time: 6.8296833038, output_fired_time: 4.7148294449, propagate_forward_time: 153.0203247070, propagate_backward_time: 241.5884704590, weight_update_time: 0.3720464408, other_time: 410.6421203613
epoch time: 32.6392860413s, input_fired_time: 0.7739740610, output_fired_time: 0.0000000000, propagate_forward_time: 30.5009059906, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3644065857
validation[          , genome 18333] predictions:    9847/  10000 (98.47%), best:    9889/10000 (98.89%), error:       489.86392, best error:       350.77377 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 413.3484191895s, input_fired_time: 7.1680688858, output_fired_time: 4.7561888695, propagate_forward_time: 152.9441528320, propagate_backward_time: 241.0945281982, weight_update_time: 0.3913323879, other_time: 7.3854827881
epoch time: 32.6911849976s, input_fired_time: 0.7817573547, output_fired_time: 0.0000000000, propagate_forward_time: 30.5485172272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3609104156
validation[          , genome 18333] predictions:    9872/  10000 (98.72%), best:    9889/10000 (98.89%), error:       387.65387, best error:       350.77377 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 414.1867065430s, input_fired_time: 7.2256927490, output_fired_time: 4.7988619804, propagate_forward_time: 152.9693298340, propagate_backward_time: 241.8042144775, weight_update_time: 0.3911876380, other_time: 7.3885955811
epoch time: 32.6903572083s, input_fired_time: 0.7684988976, output_fired_time: 0.0000000000, propagate_forward_time: 30.5593547821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3625030518
validation[          , genome 18333] predictions:    9873/  10000 (98.73%), best:    9889/10000 (98.89%), error:       372.21573, best error:       350.77377 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 411.5891418457s, input_fired_time: 7.1422510147, output_fired_time: 4.7065887451, propagate_forward_time: 152.4839324951, propagate_backward_time: 239.8879394531, weight_update_time: 0.3899129033, other_time: 7.3684234619
epoch time: 32.6711082458s, input_fired_time: 0.7752349377, output_fired_time: 0.0000000000, propagate_forward_time: 30.5341739655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3617000580
validation[          , genome 18333] predictions:    9890/  10000 (98.90%), best:    9889/10000 (98.89%), error:       386.77072, best error:       350.77377 on epoch:    31, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 411.7023925781s, input_fired_time: 7.1548871994, output_fired_time: 4.6962919235, propagate_forward_time: 152.4562988281, propagate_backward_time: 239.9639434814, weight_update_time: 0.3904171884, other_time: 7.4309844971
epoch time: 32.6352729797s, input_fired_time: 0.7719335556, output_fired_time: 0.0000000000, propagate_forward_time: 30.5006027222, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3627357483
validation[          , genome 18333] predictions:    9862/  10000 (98.62%), best:    9889/10000 (98.89%), error:       437.50854, best error:       350.77377 on epoch:    31, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 412.2792358398s, input_fired_time: 7.1564888954, output_fired_time: 4.7512645721, propagate_forward_time: 152.5391082764, propagate_backward_time: 240.4357452393, weight_update_time: 0.3902679086, other_time: 7.3966369629
epoch time: 32.6268310547s, input_fired_time: 0.7759791613, output_fired_time: 0.0000000000, propagate_forward_time: 30.4919719696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3588790894
validation[          , genome 18333] predictions:    9878/  10000 (98.78%), best:    9889/10000 (98.89%), error:       356.95898, best error:       350.77377 on epoch:    31, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 411.7451171875s, input_fired_time: 7.1697483063, output_fired_time: 4.7051692009, propagate_forward_time: 152.5605621338, propagate_backward_time: 239.9335327148, weight_update_time: 0.3901461065, other_time: 7.3761138916
epoch time: 32.6812400818s, input_fired_time: 0.7808260918, output_fired_time: 0.0000000000, propagate_forward_time: 30.5415973663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3588161469
validation[          , genome 18333] predictions:    9879/  10000 (98.79%), best:    9889/10000 (98.89%), error:       394.83691, best error:       350.77377 on epoch:    31, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 413.3094787598s, input_fired_time: 7.2331404686, output_fired_time: 4.7869334221, propagate_forward_time: 152.6594390869, propagate_backward_time: 241.1460113525, weight_update_time: 0.3912883103, other_time: 7.4839477539
epoch time: 32.6666870117s, input_fired_time: 0.7824593186, output_fired_time: 0.0000000000, propagate_forward_time: 30.5179691315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3662586212
validation[          , genome 18333] predictions:    9878/  10000 (98.78%), best:    9889/10000 (98.89%), error:       388.62051, best error:       350.77377 on epoch:    31, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 411.7442321777s, input_fired_time: 7.2392854691, output_fired_time: 4.7016558647, propagate_forward_time: 152.5093231201, propagate_backward_time: 239.9016876221, weight_update_time: 0.3912785351, other_time: 7.3922729492
epoch time: 32.6649665833s, input_fired_time: 0.7840242386, output_fired_time: 0.0000000000, propagate_forward_time: 30.5198001862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3611431122
validation[          , genome 18333] predictions:    9862/  10000 (98.62%), best:    9889/10000 (98.89%), error:       412.87769, best error:       350.77377 on epoch:    31, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 411.6064453125s, input_fired_time: 7.2390308380, output_fired_time: 4.6942234039, propagate_forward_time: 152.4945373535, propagate_backward_time: 239.7968750000, weight_update_time: 0.3907185495, other_time: 7.3817749023
epoch time: 32.6706924438s, input_fired_time: 0.7865164280, output_fired_time: 0.0000000000, propagate_forward_time: 30.5220069885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3621692657
validation[          , genome 18333] predictions:    9889/  10000 (98.89%), best:    9889/10000 (98.89%), error:       347.52884, best error:       347.52884 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 411.8074035645s, input_fired_time: 7.2442660332, output_fired_time: 4.6948881149, propagate_forward_time: 152.5449829102, propagate_backward_time: 239.9364471436, weight_update_time: 0.3909028769, other_time: 7.3868255615
epoch time: 32.6637153625s, input_fired_time: 0.7825954556, output_fired_time: 0.0000000000, propagate_forward_time: 30.5168399811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3642807007
validation[          , genome 18333] predictions:    9860/  10000 (98.60%), best:    9889/10000 (98.89%), error:       456.84628, best error:       347.52884 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 411.5276794434s, input_fired_time: 7.2204089165, output_fired_time: 4.6936697960, propagate_forward_time: 152.4719696045, propagate_backward_time: 239.7588043213, weight_update_time: 0.3907146156, other_time: 7.3828430176
epoch time: 32.6605529785s, input_fired_time: 0.7804342508, output_fired_time: 0.0000000000, propagate_forward_time: 30.5146198273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3654994965
validation[          , genome 18333] predictions:    9841/  10000 (98.41%), best:    9889/10000 (98.89%), error:       463.14444, best error:       347.52884 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 411.5864868164s, input_fired_time: 7.2307639122, output_fired_time: 4.6953763962, propagate_forward_time: 152.4865112305, propagate_backward_time: 239.7799682617, weight_update_time: 0.3910700381, other_time: 7.3938598633
epoch time: 32.6747360229s, input_fired_time: 0.7826408744, output_fired_time: 0.0000000000, propagate_forward_time: 30.5279102325, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3641853333
validation[          , genome 18333] predictions:    9873/  10000 (98.73%), best:    9889/10000 (98.89%), error:       404.47583, best error:       347.52884 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 411.4666442871s, input_fired_time: 7.2186288834, output_fired_time: 4.6940803528, propagate_forward_time: 152.4619140625, propagate_backward_time: 239.7037200928, weight_update_time: 0.3909706771, other_time: 7.3882904053
epoch time: 32.6760940552s, input_fired_time: 0.7851638198, output_fired_time: 0.0000000000, propagate_forward_time: 30.5266666412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3642635345
validation[          , genome 18333] predictions:    9894/  10000 (98.94%), best:    9894/10000 (98.94%), error:       316.18268, best error:       316.18268 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 411.7861938477s, input_fired_time: 7.2326288223, output_fired_time: 4.6962933540, propagate_forward_time: 152.5248718262, propagate_backward_time: 239.9326324463, weight_update_time: 0.3913732469, other_time: 7.3997650146
epoch time: 32.6615715027s, input_fired_time: 0.7827266455, output_fired_time: 0.0000000000, propagate_forward_time: 30.5153903961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3634548187
validation[          , genome 18333] predictions:    9847/  10000 (98.47%), best:    9894/10000 (98.94%), error:       499.29965, best error:       316.18268 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 411.6022644043s, input_fired_time: 7.2407050133, output_fired_time: 4.6964864731, propagate_forward_time: 152.4987335205, propagate_backward_time: 239.7768707275, weight_update_time: 0.3908570111, other_time: 7.3894958496
epoch time: 32.6676597595s, input_fired_time: 0.7847330570, output_fired_time: 0.0000000000, propagate_forward_time: 30.5179061890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3650207520
validation[          , genome 18333] predictions:    9879/  10000 (98.79%), best:    9894/10000 (98.94%), error:       353.84006, best error:       316.18268 on epoch:    45, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 675.4482421875s, input_fired_time: 7.2173819542, output_fired_time: 4.7446384430, propagate_forward_time: 153.4023284912, propagate_backward_time: 502.7155761719, weight_update_time: 0.3915773630, other_time: 7.3682861328
epoch time: 32.6303215027s, input_fired_time: 0.7746235132, output_fired_time: 0.0000000000, propagate_forward_time: 30.4954185486, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3602790833
validation[          , genome 18333] predictions:    9852/  10000 (98.52%), best:    9894/10000 (98.94%), error:       448.22058, best error:       316.18268 on epoch:    45, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 411.4236145020s, input_fired_time: 7.1875996590, output_fired_time: 4.6947379112, propagate_forward_time: 152.4649047852, propagate_backward_time: 239.6955413818, weight_update_time: 0.3899152279, other_time: 7.3808441162
epoch time: 32.8760337830s, input_fired_time: 0.7914599180, output_fired_time: 0.0000000000, propagate_forward_time: 30.6656188965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4189567566
validation[          , genome 18333] predictions:    9861/  10000 (98.61%), best:    9894/10000 (98.94%), error:       420.94440, best error:       316.18268 on epoch:    45, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 413.5587463379s, input_fired_time: 7.2894206047, output_fired_time: 4.7544145584, propagate_forward_time: 152.9398040771, propagate_backward_time: 240.9692993164, weight_update_time: 0.3910493553, other_time: 7.6057891846
epoch time: 32.6337318420s, input_fired_time: 0.7812674642, output_fired_time: 0.0000000000, propagate_forward_time: 30.4910354614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3614292145
validation[          , genome 18333] predictions:    9888/  10000 (98.88%), best:    9894/10000 (98.94%), error:       351.80673, best error:       316.18268 on epoch:    45, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 414.2197265625s, input_fired_time: 7.2185144424, output_fired_time: 4.7273263931, propagate_forward_time: 153.4739990234, propagate_backward_time: 241.4096984863, weight_update_time: 0.3913500905, other_time: 7.3901977539
epoch time: 32.7015724182s, input_fired_time: 0.7824884653, output_fired_time: 0.0000000000, propagate_forward_time: 30.5562896729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3627948761
validation[          , genome 18333] predictions:    9881/  10000 (98.81%), best:    9894/10000 (98.94%), error:       393.86581, best error:       316.18268 on epoch:    45, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 429.5365600586s, input_fired_time: 7.3654060364, output_fired_time: 4.8848185539, propagate_forward_time: 158.3368225098, propagate_backward_time: 251.5200195312, weight_update_time: 0.3982315361, other_time: 7.4294738770
epoch time: 32.5501861572s, input_fired_time: 0.7213529944, output_fired_time: 0.0000000000, propagate_forward_time: 30.5883674622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2404651642
validation[          , genome 18333] predictions:    9890/  10000 (98.90%), best:    9894/10000 (98.94%), error:       360.01160, best error:       316.18268 on epoch:    45, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 411.2053222656s, input_fired_time: 6.8718919754, output_fired_time: 4.6841754913, propagate_forward_time: 152.6052246094, propagate_backward_time: 240.3835754395, weight_update_time: 0.3699369133, other_time: 6.6604614258
epoch time: 32.4881820679s, input_fired_time: 0.7179471254, output_fired_time: 0.0000000000, propagate_forward_time: 30.5541915894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2160434723
validation[          , genome 18333] predictions:    9901/  10000 (99.01%), best:    9894/10000 (98.94%), error:       318.46063, best error:       316.18268 on epoch:    45, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 410.1166992188s, input_fired_time: 6.8197216988, output_fired_time: 4.6706542969, propagate_forward_time: 152.2153930664, propagate_backward_time: 239.8533325195, weight_update_time: 0.3695679009, other_time: 6.5575866699
epoch time: 32.3815650940s, input_fired_time: 0.7146126628, output_fired_time: 0.0000000000, propagate_forward_time: 30.4606342316, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2063179016
validation[          , genome 18333] predictions:    9891/  10000 (98.91%), best:    9894/10000 (98.94%), error:       329.61099, best error:       316.18268 on epoch:    45, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 410.1275024414s, input_fired_time: 6.8175220490, output_fired_time: 4.6761097908, propagate_forward_time: 152.1784210205, propagate_backward_time: 239.8970031738, weight_update_time: 0.3698100150, other_time: 6.5584259033
epoch time: 32.3829154968s, input_fired_time: 0.7140191793, output_fired_time: 0.0000000000, propagate_forward_time: 30.4613246918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2075710297
validation[          , genome 18333] predictions:    9884/  10000 (98.84%), best:    9894/10000 (98.94%), error:       334.66513, best error:       316.18268 on epoch:    45, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 410.2680358887s, input_fired_time: 6.8108105659, output_fired_time: 4.6919908524, propagate_forward_time: 152.1711883545, propagate_backward_time: 240.0373992920, weight_update_time: 0.3701170683, other_time: 6.5566406250
epoch time: 32.3875770569s, input_fired_time: 0.7152102590, output_fired_time: 0.0000000000, propagate_forward_time: 30.4646015167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2077655792
validation[          , genome 18333] predictions:    9888/  10000 (98.88%), best:    9894/10000 (98.94%), error:       350.13782, best error:       316.18268 on epoch:    45, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 410.9000549316s, input_fired_time: 6.8213129044, output_fired_time: 4.6994633675, propagate_forward_time: 152.3985290527, propagate_backward_time: 240.4080505371, weight_update_time: 0.3704322875, other_time: 6.5726928711
epoch time: 32.3995132446s, input_fired_time: 0.7129641771, output_fired_time: 0.0000000000, propagate_forward_time: 30.4805030823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2060451508
validation[          , genome 18333] predictions:    9900/  10000 (99.00%), best:    9894/10000 (98.94%), error:       323.88437, best error:       316.18268 on epoch:    45, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 412.8911132812s, input_fired_time: 6.9171624184, output_fired_time: 4.7433781624, propagate_forward_time: 152.8809814453, propagate_backward_time: 241.5931396484, weight_update_time: 0.3720528781, other_time: 6.7564392090
epoch time: 32.5813179016s, input_fired_time: 0.7282087207, output_fired_time: 0.0000000000, propagate_forward_time: 30.6079883575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2451210022
validation[          , genome 18333] predictions:    9884/  10000 (98.84%), best:    9894/10000 (98.94%), error:       354.09872, best error:       316.18268 on epoch:    45, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 412.6499633789s, input_fired_time: 6.9222159386, output_fired_time: 4.7235398293, propagate_forward_time: 152.8760681152, propagate_backward_time: 241.3724517822, weight_update_time: 0.3717209995, other_time: 6.7556915283
epoch time: 32.5739212036s, input_fired_time: 0.7259863019, output_fired_time: 0.0000000000, propagate_forward_time: 30.6039581299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2439765930
validation[          , genome 18333] predictions:    9895/  10000 (98.95%), best:    9894/10000 (98.94%), error:       319.67569, best error:       316.18268 on epoch:    45, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 2524.9365234375s, input_fired_time: 7.0414190292, output_fired_time: 4.8603157997, propagate_forward_time: 2255.1083984375, propagate_backward_time: 251.1678771973, weight_update_time: 0.3800759315, other_time: 6.7583923340
epoch time: 32.3784637451s, input_fired_time: 0.7158997059, output_fired_time: 0.0000000000, propagate_forward_time: 30.4568595886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2057037354
validation[          , genome 18333] predictions:    9899/  10000 (98.99%), best:    9899/10000 (98.99%), error:       306.08273, best error:       306.08273 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 411.4735717773s, input_fired_time: 6.8318815231, output_fired_time: 4.7513194084, propagate_forward_time: 152.3565979004, propagate_backward_time: 240.9671630859, weight_update_time: 0.3704225123, other_time: 6.5666198730
epoch time: 32.4307746887s, input_fired_time: 0.7193443179, output_fired_time: 0.0000000000, propagate_forward_time: 30.4930095673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2184200287
validation[          , genome 18333] predictions:    9879/  10000 (98.79%), best:    9899/10000 (98.99%), error:       364.56824, best error:       306.08273 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 411.2283325195s, input_fired_time: 6.8199729919, output_fired_time: 4.7510848045, propagate_forward_time: 152.2510375977, propagate_backward_time: 240.8545532227, weight_update_time: 0.3704420030, other_time: 6.5516662598
epoch time: 32.3928070068s, input_fired_time: 0.7169152498, output_fired_time: 0.0000000000, propagate_forward_time: 30.4687576294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2071342468
validation[          , genome 18333] predictions:    9892/  10000 (98.92%), best:    9899/10000 (98.99%), error:       330.30368, best error:       306.08273 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 409.9580688477s, input_fired_time: 6.8138780594, output_fired_time: 4.6629757881, propagate_forward_time: 152.1939697266, propagate_backward_time: 239.7312316895, weight_update_time: 0.3703058064, other_time: 6.5560302734
epoch time: 32.3797149658s, input_fired_time: 0.7168287635, output_fired_time: 0.0000000000, propagate_forward_time: 30.4576911926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2051944733
validation[          , genome 18333] predictions:    9904/  10000 (99.04%), best:    9899/10000 (98.99%), error:       321.75815, best error:       306.08273 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 410.5962524414s, input_fired_time: 6.8367094994, output_fired_time: 4.6877732277, propagate_forward_time: 152.2872009277, propagate_backward_time: 240.2286376953, weight_update_time: 0.3707554340, other_time: 6.5559387207
epoch time: 32.5011596680s, input_fired_time: 0.7200261354, output_fired_time: 0.0000000000, propagate_forward_time: 30.5705966949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2105369568
validation[          , genome 18333] predictions:    9891/  10000 (98.91%), best:    9899/10000 (98.99%), error:       345.57666, best error:       306.08273 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 410.8346862793s, input_fired_time: 6.8418068886, output_fired_time: 4.7037343979, propagate_forward_time: 152.3034362793, propagate_backward_time: 240.4230346680, weight_update_time: 0.3710576594, other_time: 6.5626831055
epoch time: 32.4224586487s, input_fired_time: 0.7172336578, output_fired_time: 0.0000000000, propagate_forward_time: 30.4989356995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2062892914
validation[          , genome 18333] predictions:    9895/  10000 (98.95%), best:    9899/10000 (98.99%), error:       340.95163, best error:       306.08273 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 410.7935180664s, input_fired_time: 6.8481421471, output_fired_time: 4.6958341599, propagate_forward_time: 152.3354492188, propagate_backward_time: 240.3521881104, weight_update_time: 0.3709190488, other_time: 6.5619049072
epoch time: 32.4149742126s, input_fired_time: 0.7179717422, output_fired_time: 0.0000000000, propagate_forward_time: 30.4912509918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2057514191
validation[          , genome 18333] predictions:    9899/  10000 (98.99%), best:    9899/10000 (98.99%), error:       316.84625, best error:       306.08273 on epoch:    60, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 410.8089294434s, input_fired_time: 6.8313632011, output_fired_time: 4.7218456268, propagate_forward_time: 152.2310791016, propagate_backward_time: 240.4658203125, weight_update_time: 0.3705099523, other_time: 6.5588378906
epoch time: 32.4191246033s, input_fired_time: 0.7190415263, output_fired_time: 0.0000000000, propagate_forward_time: 30.4954376221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2046451569
validation[          , genome 18333] predictions:    9885/  10000 (98.85%), best:    9899/10000 (98.99%), error:       359.38309, best error:       306.08273 on epoch:    60, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 411.1112976074s, input_fired_time: 6.8320474625, output_fired_time: 4.7332901955, propagate_forward_time: 152.2940673828, propagate_backward_time: 240.6866302490, weight_update_time: 0.3704065681, other_time: 6.5652618408
epoch time: 32.4143104553s, input_fired_time: 0.7171068788, output_fired_time: 0.0000000000, propagate_forward_time: 30.4920387268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2051639557
validation[          , genome 18333] predictions:    9862/  10000 (98.62%), best:    9899/10000 (98.99%), error:       424.96384, best error:       306.08273 on epoch:    60, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 411.5877990723s, input_fired_time: 6.8330583572, output_fired_time: 4.7415471077, propagate_forward_time: 152.3292846680, propagate_backward_time: 241.1068115234, weight_update_time: 0.3710231185, other_time: 6.5770874023
epoch time: 32.4464340210s, input_fired_time: 0.7169199586, output_fired_time: 0.0000000000, propagate_forward_time: 30.5042667389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2252464294
validation[          , genome 18333] predictions:    9893/  10000 (98.93%), best:    9899/10000 (98.99%), error:       316.62042, best error:       306.08273 on epoch:    60, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 442.3321228027s, input_fired_time: 7.2194037437, output_fired_time: 5.0269646645, propagate_forward_time: 162.6177673340, propagate_backward_time: 260.5697631836, weight_update_time: 0.3930891454, other_time: 6.8982238770
epoch time: 32.7346687317s, input_fired_time: 0.7286434770, output_fired_time: 0.0000000000, propagate_forward_time: 30.7597579956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2462654114
validation[          , genome 18333] predictions:    9894/  10000 (98.94%), best:    9899/10000 (98.99%), error:       329.53458, best error:       306.08273 on epoch:    60, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 409.9718933105s, input_fired_time: 6.8368988037, output_fired_time: 4.6438136101, propagate_forward_time: 152.3006591797, propagate_backward_time: 239.6195068359, weight_update_time: 0.3702290058, other_time: 6.5710449219
epoch time: 32.3803405762s, input_fired_time: 0.7183771133, output_fired_time: 0.0000000000, propagate_forward_time: 30.4555549622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2064094543
validation[          , genome 18333] predictions:    9893/  10000 (98.93%), best:    9899/10000 (98.99%), error:       342.88092, best error:       306.08273 on epoch:    60, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 410.5661010742s, input_fired_time: 6.8719272614, output_fired_time: 4.6764898300, propagate_forward_time: 152.3652954102, propagate_backward_time: 240.0779876709, weight_update_time: 0.3706637621, other_time: 6.5744171143
epoch time: 32.3869972229s, input_fired_time: 0.7170029879, output_fired_time: 0.0000000000, propagate_forward_time: 30.4644527435, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2055416107
validation[          , genome 18333] predictions:    9882/  10000 (98.82%), best:    9899/10000 (98.99%), error:       354.43793, best error:       306.08273 on epoch:    60, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 416.2153320312s, input_fired_time: 6.8841872215, output_fired_time: 4.7946839333, propagate_forward_time: 153.9546051025, propagate_backward_time: 244.0013580322, weight_update_time: 0.3729721010, other_time: 6.5805053711
epoch time: 34.0972938538s, input_fired_time: 0.7431324720, output_fired_time: 0.0000000000, propagate_forward_time: 32.1298942566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2242660522
validation[          , genome 18333] predictions:    9890/  10000 (98.90%), best:    9899/10000 (98.99%), error:       344.47244, best error:       306.08273 on epoch:    60, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 411.1708374023s, input_fired_time: 6.8469138145, output_fired_time: 4.6963071823, propagate_forward_time: 152.4140625000, propagate_backward_time: 240.6484375000, weight_update_time: 0.3701490760, other_time: 6.5650939941
epoch time: 32.4176788330s, input_fired_time: 0.7202287912, output_fired_time: 0.0000000000, propagate_forward_time: 30.4909458160, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2065048218
validation[          , genome 18333] predictions:    9896/  10000 (98.96%), best:    9899/10000 (98.99%), error:       345.57858, best error:       306.08273 on epoch:    60, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 411.0621643066s, input_fired_time: 6.8480572701, output_fired_time: 4.7196025848, propagate_forward_time: 152.3169250488, propagate_backward_time: 240.6096649170, weight_update_time: 0.3705175519, other_time: 6.5679168701
epoch time: 32.4157829285s, input_fired_time: 0.7186811566, output_fired_time: 0.0000000000, propagate_forward_time: 30.4902515411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2068500519
validation[          , genome 18333] predictions:    9903/  10000 (99.03%), best:    9899/10000 (98.99%), error:       308.22119, best error:       306.08273 on epoch:    60, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 411.2060852051s, input_fired_time: 6.8475022316, output_fired_time: 4.7159132957, propagate_forward_time: 152.3885040283, propagate_backward_time: 240.6856384277, weight_update_time: 0.3702724874, other_time: 6.5685272217
epoch time: 32.4245491028s, input_fired_time: 0.7219282985, output_fired_time: 0.0000000000, propagate_forward_time: 30.4959392548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2066822052
validation[          , genome 18333] predictions:    9894/  10000 (98.94%), best:    9899/10000 (98.99%), error:       326.19864, best error:       306.08273 on epoch:    60, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 411.3692626953s, input_fired_time: 6.8653349876, output_fired_time: 4.7357544899, propagate_forward_time: 152.3539428711, propagate_backward_time: 240.8349456787, weight_update_time: 0.3708916903, other_time: 6.5792999268
epoch time: 32.4233665466s, input_fired_time: 0.7225078344, output_fired_time: 0.0000000000, propagate_forward_time: 30.4918498993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2090091705
validation[          , genome 18333] predictions:    9880/  10000 (98.80%), best:    9899/10000 (98.99%), error:       366.80334, best error:       306.08273 on epoch:    60, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 411.0588684082s, input_fired_time: 6.8581228256, output_fired_time: 4.7086787224, propagate_forward_time: 152.3581085205, propagate_backward_time: 240.5598602295, weight_update_time: 0.3705439866, other_time: 6.5740966797
epoch time: 32.4287681580s, input_fired_time: 0.7209495306, output_fired_time: 0.0000000000, propagate_forward_time: 30.4990787506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2087402344
validation[          , genome 18333] predictions:    9899/  10000 (98.99%), best:    9899/10000 (98.99%), error:       322.30679, best error:       306.08273 on epoch:    60, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 411.7201843262s, input_fired_time: 6.8627576828, output_fired_time: 4.7177629471, propagate_forward_time: 152.5558471680, propagate_backward_time: 241.0028839111, weight_update_time: 0.3709657788, other_time: 6.5809173584
epoch time: 32.3963699341s, input_fired_time: 0.7213940620, output_fired_time: 0.0000000000, propagate_forward_time: 30.4694633484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2055130005
validation[          , genome 18333] predictions:    9903/  10000 (99.03%), best:    9903/10000 (99.03%), error:       297.07358, best error:       297.07358 on epoch:    79, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 411.2591552734s, input_fired_time: 6.8655138016, output_fired_time: 4.7166476250, propagate_forward_time: 152.4285278320, propagate_backward_time: 240.6737060547, weight_update_time: 0.3711632192, other_time: 6.5747680664
epoch time: 32.4125823975s, input_fired_time: 0.7268671989, output_fired_time: 0.0000000000, propagate_forward_time: 30.4780788422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2076358795
validation[          , genome 18333] predictions:    9511/  10000 (95.11%), best:    9903/10000 (99.03%), error:      1656.92554, best error:       297.07358 on epoch:    79, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

resetting weights to those on epoch: 79
epoch time: 410.9848632812s, input_fired_time: 6.8634452820, output_fired_time: 4.7213349342, propagate_forward_time: 152.2802124023, propagate_backward_time: 240.5535278320, weight_update_time: 0.3706870973, other_time: 6.5663452148
epoch time: 32.4027252197s, input_fired_time: 0.7201666236, output_fired_time: 0.0000000000, propagate_forward_time: 30.4779415131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2046165466
validation[          , genome 18333] predictions:    9916/  10000 (99.16%), best:    9916/10000 (99.16%), error:       292.61972, best error:       292.61972 on epoch:    81, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 413.1664123535s, input_fired_time: 6.8823027611, output_fired_time: 4.7497057915, propagate_forward_time: 153.1070251465, propagate_backward_time: 241.8572845459, weight_update_time: 0.3711121380, other_time: 6.5701141357
epoch time: 32.3831291199s, input_fired_time: 0.7216507792, output_fired_time: 0.0000000000, propagate_forward_time: 30.4546318054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2068462372
validation[          , genome 18333] predictions:    9894/  10000 (98.94%), best:    9916/10000 (99.16%), error:       338.63229, best error:       292.61972 on epoch:    81, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 410.9890747070s, input_fired_time: 6.8482427597, output_fired_time: 4.7455134392, propagate_forward_time: 152.1670227051, propagate_backward_time: 240.6725616455, weight_update_time: 0.3700937629, other_time: 6.5557403564
epoch time: 32.3915138245s, input_fired_time: 0.7229436636, output_fired_time: 0.0000000000, propagate_forward_time: 30.4605484009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2080211639
validation[          , genome 18333] predictions:    9846/  10000 (98.46%), best:    9916/10000 (99.16%), error:       499.70547, best error:       292.61972 on epoch:    81, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 411.4854125977s, input_fired_time: 6.8526158333, output_fired_time: 4.7521286011, propagate_forward_time: 152.3159179688, propagate_backward_time: 241.0008239746, weight_update_time: 0.3701580465, other_time: 6.5639038086
epoch time: 32.4095726013s, input_fired_time: 0.7247193456, output_fired_time: 0.0000000000, propagate_forward_time: 30.4813098907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2035427094
validation[          , genome 18333] predictions:    9898/  10000 (98.98%), best:    9916/10000 (99.16%), error:       305.69763, best error:       292.61972 on epoch:    81, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 411.6347351074s, input_fired_time: 6.8530893326, output_fired_time: 4.7728409767, propagate_forward_time: 152.2521514893, propagate_backward_time: 241.1997985840, weight_update_time: 0.3704165518, other_time: 6.5568695068
epoch time: 32.4001502991s, input_fired_time: 0.7197662592, output_fired_time: 0.0000000000, propagate_forward_time: 30.4726142883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2077693939
validation[          , genome 18333] predictions:    9907/  10000 (99.07%), best:    9916/10000 (99.16%), error:       295.38104, best error:       292.61972 on epoch:    81, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 411.7163085938s, input_fired_time: 6.8545269966, output_fired_time: 4.7712755203, propagate_forward_time: 152.3014526367, propagate_backward_time: 241.2287902832, weight_update_time: 0.3704060018, other_time: 6.5602722168
epoch time: 32.3965606689s, input_fired_time: 0.7195510268, output_fired_time: 0.0000000000, propagate_forward_time: 30.4717483521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2052612305
validation[          , genome 18333] predictions:    9887/  10000 (98.87%), best:    9916/10000 (99.16%), error:       345.32428, best error:       292.61972 on epoch:    81, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 412.1059570312s, input_fired_time: 6.8807063103, output_fired_time: 4.7608165741, propagate_forward_time: 152.4660034180, propagate_backward_time: 241.3770904541, weight_update_time: 0.3710894883, other_time: 6.6213531494
epoch time: 32.5664634705s, input_fired_time: 0.7299761772, output_fired_time: 0.0000000000, propagate_forward_time: 30.6111602783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2253265381
validation[          , genome 18333] predictions:    9905/  10000 (99.05%), best:    9916/10000 (99.16%), error:       301.83429, best error:       292.61972 on epoch:    81, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 410.4201965332s, input_fired_time: 6.8670964241, output_fired_time: 4.6879205704, propagate_forward_time: 152.2324829102, propagate_backward_time: 240.0717315674, weight_update_time: 0.3702014685, other_time: 6.5609588623
epoch time: 32.4249839783s, input_fired_time: 0.7231861949, output_fired_time: 0.0000000000, propagate_forward_time: 30.4953327179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2064647675
validation[          , genome 18333] predictions:    9899/  10000 (98.99%), best:    9916/10000 (99.16%), error:       310.40176, best error:       292.61972 on epoch:    81, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 409.8551940918s, input_fired_time: 6.8553347588, output_fired_time: 4.6306743622, propagate_forward_time: 152.2840881348, propagate_backward_time: 239.4985351562, weight_update_time: 0.3705889583, other_time: 6.5865478516
epoch time: 32.4141731262s, input_fired_time: 0.7200531363, output_fired_time: 0.0000000000, propagate_forward_time: 30.4881858826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2059345245
validation[          , genome 18333] predictions:    9909/  10000 (99.09%), best:    9916/10000 (99.16%), error:       302.72794, best error:       292.61972 on epoch:    81, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 411.1174621582s, input_fired_time: 6.8487625122, output_fired_time: 4.7355761528, propagate_forward_time: 152.2297363281, propagate_backward_time: 240.7485656738, weight_update_time: 0.3709513247, other_time: 6.5548400879
epoch time: 32.3945846558s, input_fired_time: 0.7256885171, output_fired_time: 0.0000000000, propagate_forward_time: 30.4635334015, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2053623199
validation[          , genome 18333] predictions:    9905/  10000 (99.05%), best:    9916/10000 (99.16%), error:       311.78882, best error:       292.61972 on epoch:    81, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 410.6200256348s, input_fired_time: 6.8633327484, output_fired_time: 4.6889276505, propagate_forward_time: 152.2842407227, propagate_backward_time: 240.1963348389, weight_update_time: 0.3706909716, other_time: 6.5871734619
epoch time: 32.4435157776s, input_fired_time: 0.7250025272, output_fired_time: 0.0000000000, propagate_forward_time: 30.4853343964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2331790924
validation[          , genome 18333] predictions:    9909/  10000 (99.09%), best:    9916/10000 (99.16%), error:       303.99371, best error:       292.61972 on epoch:    81, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 410.2366333008s, input_fired_time: 6.8752923012, output_fired_time: 4.6604819298, propagate_forward_time: 152.3347167969, propagate_backward_time: 239.8089447021, weight_update_time: 0.3704897761, other_time: 6.5571746826
epoch time: 32.3889656067s, input_fired_time: 0.7218623757, output_fired_time: 0.0000000000, propagate_forward_time: 30.4623374939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2047653198
validation[          , genome 18333] predictions:    9899/  10000 (98.99%), best:    9916/10000 (99.16%), error:       310.00644, best error:       292.61972 on epoch:    81, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 409.4805603027s, input_fired_time: 6.8501000404, output_fired_time: 4.6271419525, propagate_forward_time: 152.1526184082, propagate_backward_time: 239.2971038818, weight_update_time: 0.3704281747, other_time: 6.5536041260
epoch time: 32.3813209534s, input_fired_time: 0.7224512696, output_fired_time: 0.0000000000, propagate_forward_time: 30.4539413452, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2049274445
validation[          , genome 18333] predictions:    9909/  10000 (99.09%), best:    9916/10000 (99.16%), error:       304.51620, best error:       292.61972 on epoch:    81, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 409.8736877441s, input_fired_time: 6.8674192429, output_fired_time: 4.6469097137, propagate_forward_time: 152.2015686035, propagate_backward_time: 239.5987243652, weight_update_time: 0.3705193102, other_time: 6.5590515137
epoch time: 32.4488029480s, input_fired_time: 0.7250972390, output_fired_time: 0.0000000000, propagate_forward_time: 30.4895877838, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2341175079
validation[          , genome 18333] predictions:    9904/  10000 (99.04%), best:    9916/10000 (99.16%), error:       292.98563, best error:       292.61972 on epoch:    81, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 410.0578613281s, input_fired_time: 6.8714952469, output_fired_time: 4.6484055519, propagate_forward_time: 152.3068237305, propagate_backward_time: 239.6707305908, weight_update_time: 0.3708981574, other_time: 6.5604095459
epoch time: 32.4300651550s, input_fired_time: 0.7239787579, output_fired_time: 0.0000000000, propagate_forward_time: 30.4969348907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2091522217
validation[          , genome 18333] predictions:    9911/  10000 (99.11%), best:    9911/10000 (99.11%), error:       289.78204, best error:       289.78204 on epoch:    95, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 416.2178344727s, input_fired_time: 6.9148879051, output_fired_time: 4.7681741714, propagate_forward_time: 153.9739685059, propagate_backward_time: 243.9790649414, weight_update_time: 0.3738406897, other_time: 6.5817260742
epoch time: 34.5506515503s, input_fired_time: 0.7602967024, output_fired_time: 0.0000000000, propagate_forward_time: 32.5550003052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2353553772
validation[          , genome 18333] predictions:    9908/  10000 (99.08%), best:    9911/10000 (99.11%), error:       295.75162, best error:       289.78204 on epoch:    95, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 423.4973449707s, input_fired_time: 6.9930558205, output_fired_time: 4.8568677902, propagate_forward_time: 156.1895599365, propagate_backward_time: 248.8417358398, weight_update_time: 0.3771769702, other_time: 6.6161346436
epoch time: 32.3904685974s, input_fired_time: 0.7277536988, output_fired_time: 0.0000000000, propagate_forward_time: 30.4545269012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2081871033
validation[          , genome 18333] predictions:    9901/  10000 (99.01%), best:    9911/10000 (99.11%), error:       306.02997, best error:       289.78204 on epoch:    95, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 410.8255920410s, input_fired_time: 6.8590106964, output_fired_time: 4.7411403656, propagate_forward_time: 152.1537017822, propagate_backward_time: 240.5126342773, weight_update_time: 0.3707743883, other_time: 6.5590972900
epoch time: 32.3909416199s, input_fired_time: 0.7283342481, output_fired_time: 0.0000000000, propagate_forward_time: 30.4544868469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2081203461
validation[          , genome 18333] predictions:    9906/  10000 (99.06%), best:    9911/10000 (99.11%), error:       296.73984, best error:       289.78204 on epoch:    95, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 410.9046325684s, input_fired_time: 6.8628463745, output_fired_time: 4.7406430244, propagate_forward_time: 152.1455993652, propagate_backward_time: 240.5947418213, weight_update_time: 0.3707425296, other_time: 6.5608062744
epoch time: 32.4150657654s, input_fired_time: 0.7251555920, output_fired_time: 0.0000000000, propagate_forward_time: 30.4808158875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2090950012
validation[          , genome 18333] predictions:    9906/  10000 (99.06%), best:    9911/10000 (99.11%), error:       299.90088, best error:       289.78204 on epoch:    95, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 454.7600402832s, input_fired_time: 7.2784886360, output_fired_time: 5.1643109322, propagate_forward_time: 166.5320587158, propagate_backward_time: 269.0018920898, weight_update_time: 0.3956211507, other_time: 6.7832641602
epoch time: 51.0895500183s, input_fired_time: 1.0191805363, output_fired_time: 0.0000000000, propagate_forward_time: 48.6235542297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4468154907
validation[          , genome 18333] predictions:    9908/  10000 (99.08%), best:    9911/10000 (99.11%), error:       296.18988, best error:       289.78204 on epoch:    95, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 197.3130035400s, input_fired_time: 4.2178621292, output_fired_time: 0.0000000000, propagate_forward_time: 186.5621795654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5329589844
best training[          , genome 18333] predictions:   49997/  50000 (99.99%), best:    9911/10000 (99.11%), error:       159.79965, best error:       289.78204 on epoch:    95, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 49.5509872437s, input_fired_time: 0.9826545119, output_fired_time: 0.0000000000, propagate_forward_time: 47.1428146362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4255180359
   testing[          , genome 18333] predictions:    9906/  10000 (99.06%), best:    9911/10000 (99.11%), error:       281.82092, best error:       289.78204 on epoch:    95, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
10:24:13 (908): called boinc_finish(0)

</stderr_txt>
]]>