Nameexact_genome_1518178202_61_18388_0
Workunit2992450
Created9 Feb 2018, 17:54:34 UTC
Sent9 Feb 2018, 18:55:05 UTC
Report deadline5 Mar 2018, 11:09:41 UTC
Received11 Feb 2018, 20:28:10 UTC
Server stateOver
OutcomeValidate error
Client stateDone
Exit status0 (0x0)
Computer ID75310
Run time9 hours 2 min 1 sec
CPU time9 hours 2 min 1 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS3.67 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size168.90 MB
Peak swap size171.33 MB
Peak disk usage1.95 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
 21.2630615234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3829326630
validation[          , genome 18388] predictions:    9816/  10000 (98.16%), best:    9821/10000 (98.21%), error:       560.67651, best error:       556.47845 on epoch:     9, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 297.9776916504s, input_fired_time: 7.5829982758, output_fired_time: 4.9367780685, propagate_forward_time: 106.4629974365, propagate_backward_time: 171.3512115479, weight_update_time: 0.3437839150, other_time: 7.6437072754
epoch time: 23.4413433075s, input_fired_time: 0.7818591595, output_fired_time: 0.0000000000, propagate_forward_time: 21.2741718292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3853130341
validation[          , genome 18388] predictions:    9832/  10000 (98.32%), best:    9832/10000 (98.32%), error:       546.37622, best error:       546.37622 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 297.3117980957s, input_fired_time: 7.5561680794, output_fired_time: 4.9387550354, propagate_forward_time: 106.1954193115, propagate_backward_time: 171.0424346924, weight_update_time: 0.3421868384, other_time: 7.5790100098
epoch time: 23.4135932922s, input_fired_time: 0.7846928835, output_fired_time: 0.0000000000, propagate_forward_time: 21.2454833984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3834171295
validation[          , genome 18388] predictions:    9826/  10000 (98.26%), best:    9832/10000 (98.32%), error:       563.45776, best error:       546.37622 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 297.6676330566s, input_fired_time: 7.5764012337, output_fired_time: 4.9293932915, propagate_forward_time: 106.3295364380, propagate_backward_time: 171.2439575195, weight_update_time: 0.3428555727, other_time: 7.5883483887
epoch time: 23.4263267517s, input_fired_time: 0.7909334898, output_fired_time: 0.0000000000, propagate_forward_time: 21.2488670349, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3865261078
validation[          , genome 18388] predictions:    9741/  10000 (97.41%), best:    9832/10000 (98.32%), error:       861.00116, best error:       546.37622 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 297.2508850098s, input_fired_time: 7.5770421028, output_fired_time: 4.9309291840, propagate_forward_time: 106.2903976440, propagate_backward_time: 170.8787841797, weight_update_time: 0.3422662914, other_time: 7.5736999512
epoch time: 23.4199695587s, input_fired_time: 0.7879833579, output_fired_time: 0.0000000000, propagate_forward_time: 21.2463893890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3855972290
validation[          , genome 18388] predictions:    9848/  10000 (98.48%), best:    9848/10000 (98.48%), error:       506.56390, best error:       506.56390 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 8060.0605468750s, input_fired_time: 7.5738058090, output_fired_time: 4.9356336594, propagate_forward_time: 7868.8046875000, propagate_backward_time: 171.1678161621, weight_update_time: 0.3421992958, other_time: 7.5787658691
epoch time: 23.3978786469s, input_fired_time: 0.7820202708, output_fired_time: 0.0000000000, propagate_forward_time: 21.2392444611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3766136169
validation[          , genome 18388] predictions:    9828/  10000 (98.28%), best:    9848/10000 (98.48%), error:       535.52856, best error:       506.56390 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 295.2668457031s, input_fired_time: 7.5406188965, output_fired_time: 4.8957681656, propagate_forward_time: 105.5744705200, propagate_backward_time: 169.7252655029, weight_update_time: 0.3405144811, other_time: 7.5307159424
epoch time: 23.4206809998s, input_fired_time: 0.7886005044, output_fired_time: 0.0000000000, propagate_forward_time: 21.2486267090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3834533691
validation[          , genome 18388] predictions:    9834/  10000 (98.34%), best:    9848/10000 (98.48%), error:       542.47339, best error:       506.56390 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 297.4393615723s, input_fired_time: 7.5852766037, output_fired_time: 4.9411368370, propagate_forward_time: 106.2987365723, propagate_backward_time: 171.0273284912, weight_update_time: 0.3425212801, other_time: 7.5868988037
epoch time: 23.5138854980s, input_fired_time: 0.7808782458, output_fired_time: 0.0000000000, propagate_forward_time: 21.3407573700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3922500610
validation[          , genome 18388] predictions:    9817/  10000 (98.17%), best:    9848/10000 (98.48%), error:       621.73932, best error:       506.56390 on epoch:    18, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 297.3044433594s, input_fired_time: 7.5735607147, output_fired_time: 4.9242691994, propagate_forward_time: 106.2970733643, propagate_backward_time: 170.9064483643, weight_update_time: 0.3431395590, other_time: 7.6031188965
epoch time: 23.4936466217s, input_fired_time: 0.7890115380, output_fired_time: 0.0000000000, propagate_forward_time: 21.3171710968, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3874645233
validation[          , genome 18388] predictions:    9805/  10000 (98.05%), best:    9848/10000 (98.48%), error:       583.38959, best error:       506.56390 on epoch:    18, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 297.3738098145s, input_fired_time: 7.5902786255, output_fired_time: 4.9317421913, propagate_forward_time: 106.3210678101, propagate_backward_time: 170.9276123047, weight_update_time: 0.3433300257, other_time: 7.6031188965
epoch time: 23.4242897034s, input_fired_time: 0.7907137275, output_fired_time: 0.0000000000, propagate_forward_time: 21.2476902008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3858852386
validation[          , genome 18388] predictions:    9836/  10000 (98.36%), best:    9848/10000 (98.48%), error:       513.80261, best error:       506.56390 on epoch:    18, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 297.2997741699s, input_fired_time: 7.5996303558, output_fired_time: 4.9329051971, propagate_forward_time: 106.2756881714, propagate_backward_time: 170.9069519043, weight_update_time: 0.3427906036, other_time: 7.5845947266
epoch time: 23.5079154968s, input_fired_time: 0.7974860668, output_fired_time: 0.0000000000, propagate_forward_time: 21.3185062408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3919239044
validation[          , genome 18388] predictions:    9840/  10000 (98.40%), best:    9848/10000 (98.48%), error:       531.94427, best error:       506.56390 on epoch:    18, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 297.0408630371s, input_fired_time: 7.5899667740, output_fired_time: 4.9291529655, propagate_forward_time: 106.2400207520, propagate_backward_time: 170.7091064453, weight_update_time: 0.3423275948, other_time: 7.5726318359
epoch time: 23.4226608276s, input_fired_time: 0.7913963795, output_fired_time: 0.0000000000, propagate_forward_time: 21.2480316162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3832321167
validation[          , genome 18388] predictions:    9754/  10000 (97.54%), best:    9848/10000 (98.48%), error:       756.51770, best error:       506.56390 on epoch:    18, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 297.2971191406s, input_fired_time: 7.5983662605, output_fired_time: 4.9321928024, propagate_forward_time: 106.4186477661, propagate_backward_time: 170.7563171387, weight_update_time: 0.3426715434, other_time: 7.5916137695
epoch time: 23.4241542816s, input_fired_time: 0.7914118171, output_fired_time: 0.0000000000, propagate_forward_time: 21.2476844788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3850574493
validation[          , genome 18388] predictions:    9855/  10000 (98.55%), best:    9855/10000 (98.55%), error:       452.46774, best error:       452.46774 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 297.1340942383s, input_fired_time: 7.5939846039, output_fired_time: 4.9329476357, propagate_forward_time: 106.2460098267, propagate_backward_time: 170.7710113525, weight_update_time: 0.3436474502, other_time: 7.5901336670
epoch time: 23.4286022186s, input_fired_time: 0.7917203307, output_fired_time: 0.0000000000, propagate_forward_time: 21.2521820068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3847007751
validation[          , genome 18388] predictions:    9810/  10000 (98.10%), best:    9855/10000 (98.55%), error:       582.64050, best error:       452.46774 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 297.4710998535s, input_fired_time: 7.5905294418, output_fired_time: 4.9589471817, propagate_forward_time: 106.2892684937, propagate_backward_time: 171.0397949219, weight_update_time: 0.3423528373, other_time: 7.5925598145
epoch time: 23.4244728088s, input_fired_time: 0.7865529060, output_fired_time: 0.0000000000, propagate_forward_time: 21.2499294281, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3879909515
validation[          , genome 18388] predictions:    9845/  10000 (98.45%), best:    9855/10000 (98.55%), error:       474.86230, best error:       452.46774 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 297.4557800293s, input_fired_time: 7.5842967033, output_fired_time: 4.9559388161, propagate_forward_time: 106.2328109741, propagate_backward_time: 171.1094970703, weight_update_time: 0.3423608840, other_time: 7.5732421875
epoch time: 23.4239559174s, input_fired_time: 0.7941855788, output_fired_time: 0.0000000000, propagate_forward_time: 21.2435874939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3861827850
validation[          , genome 18388] predictions:    9838/  10000 (98.38%), best:    9855/10000 (98.55%), error:       527.14380, best error:       452.46774 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 296.9186401367s, input_fired_time: 7.6028542519, output_fired_time: 4.9271750450, propagate_forward_time: 106.2181930542, propagate_backward_time: 170.6062011719, weight_update_time: 0.3420543969, other_time: 7.5642089844
epoch time: 23.4218330383s, input_fired_time: 0.7937866449, output_fired_time: 0.0000000000, propagate_forward_time: 21.2460308075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3820152283
validation[          , genome 18388] predictions:    9852/  10000 (98.52%), best:    9855/10000 (98.55%), error:       477.63974, best error:       452.46774 on epoch:    26, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 296.9376220703s, input_fired_time: 7.6092109680, output_fired_time: 4.9250330925, propagate_forward_time: 106.2462997437, propagate_backward_time: 170.5843048096, weight_update_time: 0.3423367441, other_time: 7.5727691650
epoch time: 23.4213104248s, input_fired_time: 0.7890936136, output_fired_time: 0.0000000000, propagate_forward_time: 21.2463989258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3858184814
validation[          , genome 18388] predictions:    9813/  10000 (98.13%), best:    9855/10000 (98.55%), error:       550.24506, best error:       452.46774 on epoch:    26, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 296.7002563477s, input_fired_time: 7.5885715485, output_fired_time: 4.9168472290, propagate_forward_time: 106.1881027222, propagate_backward_time: 170.4461212158, weight_update_time: 0.3421612978, other_time: 7.5606231689
epoch time: 23.4185066223s, input_fired_time: 0.7889824510, output_fired_time: 0.0000000000, propagate_forward_time: 21.2477340698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3817901611
validation[          , genome 18388] predictions:    9866/  10000 (98.66%), best:    9866/10000 (98.66%), error:       424.82892, best error:       424.82892 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 740.1698608398s, input_fired_time: 7.7299838066, output_fired_time: 5.0387353897, propagate_forward_time: 545.6284179688, propagate_backward_time: 174.0035095215, weight_update_time: 0.3473729491, other_time: 7.7691955566
epoch time: 23.5606784821s, input_fired_time: 0.7990891933, output_fired_time: 0.0000000000, propagate_forward_time: 21.3727321625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3888568878
validation[          , genome 18388] predictions:    9834/  10000 (98.34%), best:    9866/10000 (98.66%), error:       504.44647, best error:       424.82892 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 297.1028747559s, input_fired_time: 7.5999498367, output_fired_time: 4.9364199638, propagate_forward_time: 106.2161102295, propagate_backward_time: 170.7521820068, weight_update_time: 0.3422770202, other_time: 7.5982055664
epoch time: 23.4352054596s, input_fired_time: 0.7924988866, output_fired_time: 0.0000000000, propagate_forward_time: 21.2518424988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3908634186
validation[          , genome 18388] predictions:    9843/  10000 (98.43%), best:    9866/10000 (98.66%), error:       501.33667, best error:       424.82892 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 297.2662353516s, input_fired_time: 7.5991091728, output_fired_time: 4.9387583733, propagate_forward_time: 106.3009872437, propagate_backward_time: 170.8202667236, weight_update_time: 0.3420599401, other_time: 7.6071014404
epoch time: 23.4317741394s, input_fired_time: 0.7975709438, output_fired_time: 0.0000000000, propagate_forward_time: 21.2477207184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3864822388
validation[          , genome 18388] predictions:    9856/  10000 (98.56%), best:    9866/10000 (98.66%), error:       452.37762, best error:       424.82892 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 297.1505432129s, input_fired_time: 7.6207523346, output_fired_time: 4.9396533966, propagate_forward_time: 106.2452850342, propagate_backward_time: 170.7681427002, weight_update_time: 0.3420079947, other_time: 7.5766906738
epoch time: 23.4282665253s, input_fired_time: 0.7951736450, output_fired_time: 0.0000000000, propagate_forward_time: 21.2517585754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3813343048
validation[          , genome 18388] predictions:    9868/  10000 (98.68%), best:    9868/10000 (98.68%), error:       409.53207, best error:       409.53207 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 296.9291076660s, input_fired_time: 7.6078071594, output_fired_time: 4.9333519936, propagate_forward_time: 106.1862030029, propagate_backward_time: 170.6382293701, weight_update_time: 0.3415055871, other_time: 7.5635070801
epoch time: 23.4170989990s, input_fired_time: 0.7928426266, output_fired_time: 0.0000000000, propagate_forward_time: 21.2454738617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3787822723
validation[          , genome 18388] predictions:    9852/  10000 (98.52%), best:    9868/10000 (98.68%), error:       491.17764, best error:       409.53207 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 296.7082519531s, input_fired_time: 7.5951366425, output_fired_time: 4.9242248535, propagate_forward_time: 106.1813049316, propagate_backward_time: 170.4523010254, weight_update_time: 0.3413151503, other_time: 7.5552978516
epoch time: 23.4215068817s, input_fired_time: 0.7955139875, output_fired_time: 0.0000000000, propagate_forward_time: 21.2469406128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3790531158
validation[          , genome 18388] predictions:    9838/  10000 (98.38%), best:    9868/10000 (98.68%), error:       520.95496, best error:       409.53207 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 296.8882446289s, input_fired_time: 7.6043996811, output_fired_time: 4.9309740067, propagate_forward_time: 106.2341995239, propagate_backward_time: 170.5618591309, weight_update_time: 0.3415358365, other_time: 7.5568237305
epoch time: 23.4520397186s, input_fired_time: 0.7991763353, output_fired_time: 0.0000000000, propagate_forward_time: 21.2620410919, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3908214569
validation[          , genome 18388] predictions:    9828/  10000 (98.28%), best:    9868/10000 (98.68%), error:       567.59717, best error:       409.53207 on epoch:    36, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 297.1791381836s, input_fired_time: 7.6201591492, output_fired_time: 4.9427309036, propagate_forward_time: 106.2888259888, propagate_backward_time: 170.7768554688, weight_update_time: 0.3413091600, other_time: 7.5505981445
epoch time: 23.4222812653s, input_fired_time: 0.7947748899, output_fired_time: 0.0000000000, propagate_forward_time: 21.2482738495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3792324066
validation[          , genome 18388] predictions:    9846/  10000 (98.46%), best:    9868/10000 (98.68%), error:       472.88071, best error:       409.53207 on epoch:    36, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 297.1196594238s, input_fired_time: 7.6090035439, output_fired_time: 4.9416351318, propagate_forward_time: 106.2489395142, propagate_backward_time: 170.7541351318, weight_update_time: 0.3417162895, other_time: 7.5659637451
epoch time: 23.4261932373s, input_fired_time: 0.7982113957, output_fired_time: 0.0000000000, propagate_forward_time: 21.2465209961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3814601898
validation[          , genome 18388] predictions:    9852/  10000 (98.52%), best:    9868/10000 (98.68%), error:       498.21823, best error:       409.53207 on epoch:    36, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 296.9980163574s, input_fired_time: 7.6128449440, output_fired_time: 4.9344396591, propagate_forward_time: 106.2294769287, propagate_backward_time: 170.6376342773, weight_update_time: 0.3421430588, other_time: 7.5836029053
epoch time: 23.4190864563s, input_fired_time: 0.7941618562, output_fired_time: 0.0000000000, propagate_forward_time: 21.2449188232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3800048828
validation[          , genome 18388] predictions:    9820/  10000 (98.20%), best:    9868/10000 (98.68%), error:       592.69281, best error:       409.53207 on epoch:    36, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 297.1755981445s, input_fired_time: 7.6263260841, output_fired_time: 4.9439930916, propagate_forward_time: 106.3553848267, propagate_backward_time: 170.6573028564, weight_update_time: 0.3430173099, other_time: 7.5926055908
epoch time: 23.2733516693s, input_fired_time: 0.7893573642, output_fired_time: 0.0000000000, propagate_forward_time: 21.1122322083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3717613220
validation[          , genome 18388] predictions:    9848/  10000 (98.48%), best:    9868/10000 (98.68%), error:       475.45544, best error:       409.53207 on epoch:    36, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 297.1778564453s, input_fired_time: 7.6163148880, output_fired_time: 4.9525423050, propagate_forward_time: 106.2189483643, propagate_backward_time: 170.8194580078, weight_update_time: 0.3420855999, other_time: 7.5706024170
epoch time: 23.4291477203s, input_fired_time: 0.7960625887, output_fired_time: 0.0000000000, propagate_forward_time: 21.2513542175, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3817310333
validation[          , genome 18388] predictions:    9861/  10000 (98.61%), best:    9868/10000 (98.68%), error:       485.32367, best error:       409.53207 on epoch:    36, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 297.3782348633s, input_fired_time: 7.6272521019, output_fired_time: 4.9528508186, propagate_forward_time: 106.3147277832, propagate_backward_time: 170.9199066162, weight_update_time: 0.3419516683, other_time: 7.5634918213
epoch time: 23.4544372559s, input_fired_time: 0.7998782396, output_fired_time: 0.0000000000, propagate_forward_time: 21.2710304260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3835277557
validation[          , genome 18388] predictions:    9866/  10000 (98.66%), best:    9868/10000 (98.68%), error:       442.51413, best error:       409.53207 on epoch:    36, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 297.1486816406s, input_fired_time: 7.6225504875, output_fired_time: 4.9547042847, propagate_forward_time: 106.2239532471, propagate_backward_time: 170.7612152100, weight_update_time: 0.3423182070, other_time: 7.5862426758
epoch time: 23.4237365723s, input_fired_time: 0.7976244092, output_fired_time: 0.0000000000, propagate_forward_time: 21.2458572388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3802547455
validation[          , genome 18388] predictions:    9869/  10000 (98.69%), best:    9868/10000 (98.68%), error:       449.78848, best error:       409.53207 on epoch:    36, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 297.1442260742s, input_fired_time: 7.6181735992, output_fired_time: 4.9431557655, propagate_forward_time: 106.2928695679, propagate_backward_time: 170.7000579834, weight_update_time: 0.3423164487, other_time: 7.5899810791
epoch time: 23.5091781616s, input_fired_time: 0.8015701175, output_fired_time: 0.0000000000, propagate_forward_time: 21.3187255859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3888816833
validation[          , genome 18388] predictions:    9873/  10000 (98.73%), best:    9868/10000 (98.68%), error:       427.18176, best error:       409.53207 on epoch:    36, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 297.6271362305s, input_fired_time: 7.6369190216, output_fired_time: 4.9392895699, propagate_forward_time: 106.5410079956, propagate_backward_time: 170.8943939209, weight_update_time: 0.3424380124, other_time: 7.6154937744
epoch time: 23.5181999207s, input_fired_time: 0.8020596504, output_fired_time: 0.0000000000, propagate_forward_time: 21.3226165771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3935241699
validation[          , genome 18388] predictions:    9873/  10000 (98.73%), best:    9868/10000 (98.68%), error:       422.57269, best error:       409.53207 on epoch:    36, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 297.8999328613s, input_fired_time: 7.6341629028, output_fired_time: 4.9399933815, propagate_forward_time: 106.6582489014, propagate_backward_time: 171.0382080078, weight_update_time: 0.3431062996, other_time: 7.6293182373
epoch time: 23.5233058929s, input_fired_time: 0.8048364520, output_fired_time: 0.0000000000, propagate_forward_time: 21.3339424133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3845272064
validation[          , genome 18388] predictions:    9851/  10000 (98.51%), best:    9868/10000 (98.68%), error:       492.07187, best error:       409.53207 on epoch:    36, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 296.8304748535s, input_fired_time: 7.6295957565, output_fired_time: 4.9282460213, propagate_forward_time: 106.2921524048, propagate_backward_time: 170.4146270752, weight_update_time: 0.3424184024, other_time: 7.5658416748
epoch time: 23.4790153503s, input_fired_time: 0.7977565527, output_fired_time: 0.0000000000, propagate_forward_time: 21.2989025116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3823566437
validation[          , genome 18388] predictions:    9845/  10000 (98.45%), best:    9868/10000 (98.68%), error:       515.80865, best error:       409.53207 on epoch:    36, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 296.7313537598s, input_fired_time: 7.6152787209, output_fired_time: 4.9290056229, propagate_forward_time: 106.1815948486, propagate_backward_time: 170.4395446777, weight_update_time: 0.3423940837, other_time: 7.5659332275
epoch time: 23.4364719391s, input_fired_time: 0.7989375591, output_fired_time: 0.0000000000, propagate_forward_time: 21.2547760010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3827590942
validation[          , genome 18388] predictions:    9800/  10000 (98.00%), best:    9868/10000 (98.68%), error:       638.52472, best error:       409.53207 on epoch:    36, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 297.1490478516s, input_fired_time: 7.6349263191, output_fired_time: 4.9465622902, propagate_forward_time: 106.2484741211, propagate_backward_time: 170.7590637207, weight_update_time: 0.3421041667, other_time: 7.5600280762
epoch time: 23.4468383789s, input_fired_time: 0.8033212423, output_fired_time: 0.0000000000, propagate_forward_time: 21.2556476593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3878688812
validation[          , genome 18388] predictions:    9871/  10000 (98.71%), best:    9868/10000 (98.68%), error:       439.63370, best error:       409.53207 on epoch:    36, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 296.8988647461s, input_fired_time: 7.6379928589, output_fired_time: 4.9310445786, propagate_forward_time: 106.2104873657, propagate_backward_time: 170.5548553467, weight_update_time: 0.3424019814, other_time: 7.5644989014
epoch time: 23.4293460846s, input_fired_time: 0.7982962728, output_fired_time: 0.0000000000, propagate_forward_time: 21.2496089935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3814411163
validation[          , genome 18388] predictions:    9849/  10000 (98.49%), best:    9868/10000 (98.68%), error:       508.75812, best error:       409.53207 on epoch:    36, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 296.6920776367s, input_fired_time: 7.6216349602, output_fired_time: 4.9228143692, propagate_forward_time: 106.2070083618, propagate_backward_time: 170.3730316162, weight_update_time: 0.3422782123, other_time: 7.5675811768
epoch time: 23.4318084717s, input_fired_time: 0.8001867533, output_fired_time: 0.0000000000, propagate_forward_time: 21.2479381561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3836841583
validation[          , genome 18388] predictions:    9844/  10000 (98.44%), best:    9868/10000 (98.68%), error:       470.27509, best error:       409.53207 on epoch:    36, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 297.0759277344s, input_fired_time: 7.6395821571, output_fired_time: 4.9389147758, propagate_forward_time: 106.2763061523, propagate_backward_time: 170.6470031738, weight_update_time: 0.3423741758, other_time: 7.5741271973
epoch time: 23.4409790039s, input_fired_time: 0.7983906269, output_fired_time: 0.0000000000, propagate_forward_time: 21.2603054047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3822822571
validation[          , genome 18388] predictions:    9857/  10000 (98.57%), best:    9868/10000 (98.68%), error:       489.80069, best error:       409.53207 on epoch:    36, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 296.8988952637s, input_fired_time: 7.6460528374, output_fired_time: 4.9307322502, propagate_forward_time: 106.2144470215, propagate_backward_time: 170.5361480713, weight_update_time: 0.3425725102, other_time: 7.5715179443
epoch time: 23.4274005890s, input_fired_time: 0.8005823493, output_fired_time: 0.0000000000, propagate_forward_time: 21.2455043793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3813133240
validation[          , genome 18388] predictions:    9879/  10000 (98.79%), best:    9879/10000 (98.79%), error:       407.90549, best error:       407.90549 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 296.6430358887s, input_fired_time: 7.6364183426, output_fired_time: 4.9211802483, propagate_forward_time: 106.2067337036, propagate_backward_time: 170.3219909668, weight_update_time: 0.3421752453, other_time: 7.5567321777
epoch time: 23.5373744965s, input_fired_time: 0.8035333157, output_fired_time: 0.0000000000, propagate_forward_time: 21.3489398956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3849010468
validation[          , genome 18388] predictions:    9855/  10000 (98.55%), best:    9879/10000 (98.79%), error:       453.87827, best error:       407.90549 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 296.5383300781s, input_fired_time: 7.6265339851, output_fired_time: 4.9203195572, propagate_forward_time: 106.1592559814, propagate_backward_time: 170.2698669434, weight_update_time: 0.3421844542, other_time: 7.5623626709
epoch time: 23.4406871796s, input_fired_time: 0.8007762432, output_fired_time: 0.0000000000, propagate_forward_time: 21.2563076019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3836040497
validation[          , genome 18388] predictions:    9869/  10000 (98.69%), best:    9879/10000 (98.79%), error:       436.02548, best error:       407.90549 on epoch:    56, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 296.7880554199s, input_fired_time: 7.6381874084, output_fired_time: 4.9294004440, propagate_forward_time: 106.2667541504, propagate_backward_time: 170.3936157227, weight_update_time: 0.3421542645, other_time: 7.5600891113
epoch time: 23.4708003998s, input_fired_time: 0.8054144382, output_fired_time: 0.0000000000, propagate_forward_time: 21.2729816437, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3924045563
validation[          , genome 18388] predictions:    9843/  10000 (98.43%), best:    9879/10000 (98.79%), error:       482.85754, best error:       407.90549 on epoch:    56, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 296.8448486328s, input_fired_time: 7.6439437866, output_fired_time: 4.9232707024, propagate_forward_time: 106.2835464478, propagate_backward_time: 170.4267425537, weight_update_time: 0.3422509730, other_time: 7.5673370361
epoch time: 23.4394836426s, input_fired_time: 0.8017491102, output_fired_time: 0.0000000000, propagate_forward_time: 21.2550678253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3826675415
validation[          , genome 18388] predictions:    9752/  10000 (97.52%), best:    9879/10000 (98.79%), error:       764.60522, best error:       407.90549 on epoch:    56, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 297.2019042969s, input_fired_time: 7.6255459785, output_fired_time: 4.9312925339, propagate_forward_time: 106.2371215820, propagate_backward_time: 170.8452758789, weight_update_time: 0.3423711956, other_time: 7.5626525879
epoch time: 23.4441127777s, input_fired_time: 0.7995862961, output_fired_time: 0.0000000000, propagate_forward_time: 21.2602882385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3842391968
validation[          , genome 18388] predictions:    9876/  10000 (98.76%), best:    9879/10000 (98.79%), error:       412.76541, best error:       407.90549 on epoch:    56, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 296.8062744141s, input_fired_time: 7.6353759766, output_fired_time: 4.9280467033, propagate_forward_time: 106.3102111816, propagate_backward_time: 170.3728027344, weight_update_time: 0.3420988321, other_time: 7.5598449707
epoch time: 23.4352607727s, input_fired_time: 0.7988376617, output_fired_time: 0.0000000000, propagate_forward_time: 21.2543506622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3820724487
validation[          , genome 18388] predictions:    9880/  10000 (98.80%), best:    9879/10000 (98.79%), error:       444.26044, best error:       407.90549 on epoch:    56, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 297.4882507324s, input_fired_time: 7.6476984024, output_fired_time: 4.9471759796, propagate_forward_time: 106.4384613037, propagate_backward_time: 170.8420257568, weight_update_time: 0.3458554149, other_time: 7.6128845215
epoch time: 23.7300052643s, input_fired_time: 0.8066236973, output_fired_time: 0.0000000000, propagate_forward_time: 21.5018424988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4215393066
validation[          , genome 18388] predictions:    9867/  10000 (98.67%), best:    9879/10000 (98.79%), error:       427.93530, best error:       407.90549 on epoch:    56, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 296.9757995605s, input_fired_time: 7.6516046524, output_fired_time: 4.9252057076, propagate_forward_time: 106.2939224243, propagate_backward_time: 170.4809265137, weight_update_time: 0.3429864049, other_time: 7.6241455078
epoch time: 23.4377689362s, input_fired_time: 0.8017058372, output_fired_time: 0.0000000000, propagate_forward_time: 21.2549438477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3811187744
validation[          , genome 18388] predictions:    9859/  10000 (98.59%), best:    9879/10000 (98.79%), error:       445.05234, best error:       407.90549 on epoch:    56, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 296.9614868164s, input_fired_time: 7.6494040489, output_fired_time: 4.9315085411, propagate_forward_time: 106.3235321045, propagate_backward_time: 170.4831695557, weight_update_time: 0.3422578871, other_time: 7.5738525391
epoch time: 23.5940780640s, input_fired_time: 0.8046080470, output_fired_time: 0.0000000000, propagate_forward_time: 21.3871765137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4022941589
validation[          , genome 18388] predictions:    9877/  10000 (98.77%), best:    9877/10000 (98.77%), error:       407.47644, best error:       407.47644 on epoch:    65, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 297.2825012207s, input_fired_time: 7.6458082199, output_fired_time: 4.9461698532, propagate_forward_time: 106.3733825684, propagate_backward_time: 170.7197265625, weight_update_time: 0.3427386582, other_time: 7.5974121094
epoch time: 23.4636917114s, input_fired_time: 0.8014105558, output_fired_time: 0.0000000000, propagate_forward_time: 21.2802753448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3820056915
validation[          , genome 18388] predictions:    9859/  10000 (98.59%), best:    9877/10000 (98.77%), error:       485.56506, best error:       407.47644 on epoch:    65, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 297.1773986816s, input_fired_time: 7.6471934319, output_fired_time: 4.9334197044, propagate_forward_time: 106.3251800537, propagate_backward_time: 170.6879272461, weight_update_time: 0.3423727453, other_time: 7.5836944580
epoch time: 23.4370708466s, input_fired_time: 0.8035956621, output_fired_time: 0.0000000000, propagate_forward_time: 21.2525634766, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3809108734
validation[          , genome 18388] predictions:    9872/  10000 (98.72%), best:    9877/10000 (98.77%), error:       426.75616, best error:       407.47644 on epoch:    65, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 297.3685913086s, input_fired_time: 7.6593956947, output_fired_time: 4.9429874420, propagate_forward_time: 106.3569869995, propagate_backward_time: 170.7926635742, weight_update_time: 0.3427315354, other_time: 7.6165466309
epoch time: 23.4569473267s, input_fired_time: 0.8035668135, output_fired_time: 0.0000000000, propagate_forward_time: 21.2718715668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3815097809
validation[          , genome 18388] predictions:    9861/  10000 (98.61%), best:    9877/10000 (98.77%), error:       459.84293, best error:       407.47644 on epoch:    65, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 2856.4746093750s, input_fired_time: 7.6597023010, output_fired_time: 4.9374423027, propagate_forward_time: 106.3491897583, propagate_backward_time: 2729.9494628906, weight_update_time: 0.3425312340, other_time: 7.5788574219
epoch time: 23.4387855530s, input_fired_time: 0.8071172833, output_fired_time: 0.0000000000, propagate_forward_time: 21.2520427704, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3796253204
validation[          , genome 18388] predictions:    9883/  10000 (98.83%), best:    9877/10000 (98.77%), error:       409.55841, best error:       407.47644 on epoch:    65, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 296.7188110352s, input_fired_time: 7.6570782661, output_fired_time: 4.9255609512, propagate_forward_time: 106.2264709473, propagate_backward_time: 170.3298797607, weight_update_time: 0.3419805765, other_time: 7.5798187256
epoch time: 23.4681930542s, input_fired_time: 0.8078144193, output_fired_time: 0.0000000000, propagate_forward_time: 21.2695636749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3908157349
validation[          , genome 18388] predictions:    9862/  10000 (98.62%), best:    9877/10000 (98.77%), error:       451.19666, best error:       407.47644 on epoch:    65, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 294.1329040527s, input_fired_time: 7.6006169319, output_fired_time: 4.8866729736, propagate_forward_time: 105.2183609009, propagate_backward_time: 168.9051666260, weight_update_time: 0.3406741917, other_time: 7.5221099854
epoch time: 23.4466533661s, input_fired_time: 0.8076725006, output_fired_time: 0.0000000000, propagate_forward_time: 21.2478961945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3910846710
validation[          , genome 18388] predictions:    9863/  10000 (98.63%), best:    9877/10000 (98.77%), error:       463.37241, best error:       407.47644 on epoch:    65, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 294.3417663574s, input_fired_time: 7.5960483551, output_fired_time: 4.8866548538, propagate_forward_time: 105.3504104614, propagate_backward_time: 168.9913940430, weight_update_time: 0.3395076692, other_time: 7.5172729492
epoch time: 23.3756141663s, input_fired_time: 0.8025561571, output_fired_time: 0.0000000000, propagate_forward_time: 21.1962909698, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3767662048
validation[          , genome 18388] predictions:    9870/  10000 (98.70%), best:    9877/10000 (98.77%), error:       421.95377, best error:       407.47644 on epoch:    65, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 294.1426391602s, input_fired_time: 7.6123852730, output_fired_time: 4.8725590706, propagate_forward_time: 105.3220825195, propagate_backward_time: 168.8262329102, weight_update_time: 0.3396973610, other_time: 7.5093688965
epoch time: 23.2029743195s, input_fired_time: 0.7974863648, output_fired_time: 0.0000000000, propagate_forward_time: 21.0375461578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3679409027
validation[          , genome 18388] predictions:    9868/  10000 (98.68%), best:    9877/10000 (98.77%), error:       438.99918, best error:       407.47644 on epoch:    65, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 295.4263000488s, input_fired_time: 7.6561627388, output_fired_time: 4.9002456665, propagate_forward_time: 105.7672195435, propagate_backward_time: 169.5603485107, weight_update_time: 0.3404925168, other_time: 7.5423431396
epoch time: 23.4473075867s, input_fired_time: 0.8101860285, output_fired_time: 0.0000000000, propagate_forward_time: 21.2537231445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3833980560
validation[          , genome 18388] predictions:    9697/  10000 (96.97%), best:    9877/10000 (98.77%), error:       954.99811, best error:       407.47644 on epoch:    65, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 296.1866455078s, input_fired_time: 7.6482644081, output_fired_time: 4.9026432037, propagate_forward_time: 105.9619140625, propagate_backward_time: 170.1120758057, weight_update_time: 0.3411328495, other_time: 7.5617523193
epoch time: 23.2435226440s, input_fired_time: 0.8001104593, output_fired_time: 0.0000000000, propagate_forward_time: 21.0699768066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3734359741
validation[          , genome 18388] predictions:    9835/  10000 (98.35%), best:    9877/10000 (98.77%), error:       503.30609, best error:       407.47644 on epoch:    65, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 296.5767211914s, input_fired_time: 7.6574554443, output_fired_time: 4.9256277084, propagate_forward_time: 106.2002334595, propagate_backward_time: 170.2156982422, weight_update_time: 0.3422364295, other_time: 7.5776977539
epoch time: 23.4359550476s, input_fired_time: 0.8002223372, output_fired_time: 0.0000000000, propagate_forward_time: 21.2524490356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3832836151
validation[          , genome 18388] predictions:    9881/  10000 (98.81%), best:    9877/10000 (98.77%), error:       457.66156, best error:       407.47644 on epoch:    65, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 296.6645812988s, input_fired_time: 7.6389188766, output_fired_time: 4.9224123955, propagate_forward_time: 106.2272567749, propagate_backward_time: 170.2954559326, weight_update_time: 0.3423393965, other_time: 7.5805206299
epoch time: 23.4461326599s, input_fired_time: 0.8029982448, output_fired_time: 0.0000000000, propagate_forward_time: 21.2551898956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3879451752
validation[          , genome 18388] predictions:    9871/  10000 (98.71%), best:    9877/10000 (98.77%), error:       454.47598, best error:       407.47644 on epoch:    65, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 297.4644775391s, input_fired_time: 7.6546812057, output_fired_time: 4.9288759232, propagate_forward_time: 106.5017929077, propagate_backward_time: 170.7881469727, weight_update_time: 0.3426743746, other_time: 7.5909729004
epoch time: 23.4474277496s, input_fired_time: 0.8098657131, output_fired_time: 0.0000000000, propagate_forward_time: 21.2530879974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3844738007
validation[          , genome 18388] predictions:    9847/  10000 (98.47%), best:    9877/10000 (98.77%), error:       482.72055, best error:       407.47644 on epoch:    65, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 296.6145629883s, input_fired_time: 7.6608872414, output_fired_time: 4.9157128334, propagate_forward_time: 106.2209167480, propagate_backward_time: 170.2315826416, weight_update_time: 0.3421659470, other_time: 7.5854644775
epoch time: 23.4408226013s, input_fired_time: 0.8036149144, output_fired_time: 0.0000000000, propagate_forward_time: 21.2524375916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3847694397
validation[          , genome 18388] predictions:    9851/  10000 (98.51%), best:    9877/10000 (98.77%), error:       491.64529, best error:       407.47644 on epoch:    65, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 296.6124267578s, input_fired_time: 7.6534881592, output_fired_time: 4.9140553474, propagate_forward_time: 106.2091522217, propagate_backward_time: 170.2611236572, weight_update_time: 0.3420814574, other_time: 7.5745849609
epoch time: 23.4872531891s, input_fired_time: 0.8054201007, output_fired_time: 0.0000000000, propagate_forward_time: 21.2893657684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3924674988
validation[          , genome 18388] predictions:    9864/  10000 (98.64%), best:    9877/10000 (98.77%), error:       466.19531, best error:       407.47644 on epoch:    65, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 298.0399475098s, input_fired_time: 7.6971483231, output_fired_time: 4.9420051575, propagate_forward_time: 106.7852172852, propagate_backward_time: 171.0001373291, weight_update_time: 0.3433920145, other_time: 7.6154327393
epoch time: 23.4369773865s, input_fired_time: 0.8047646880, output_fired_time: 0.0000000000, propagate_forward_time: 21.2503643036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3818492889
validation[          , genome 18388] predictions:    9867/  10000 (98.67%), best:    9877/10000 (98.77%), error:       442.22372, best error:       407.47644 on epoch:    65, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 297.3150634766s, input_fired_time: 7.6768751144, output_fired_time: 4.9387745857, propagate_forward_time: 106.4530944824, propagate_backward_time: 170.6520538330, weight_update_time: 0.3420445323, other_time: 7.5942535400
epoch time: 23.5450553894s, input_fired_time: 0.8134366274, output_fired_time: 0.0000000000, propagate_forward_time: 21.3416976929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3899211884
validation[          , genome 18388] predictions:    9860/  10000 (98.60%), best:    9877/10000 (98.77%), error:       462.83115, best error:       407.47644 on epoch:    65, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 296.8590087891s, input_fired_time: 7.6835088730, output_fired_time: 4.9329919815, propagate_forward_time: 106.2269058228, propagate_backward_time: 170.4466247559, weight_update_time: 0.3423965275, other_time: 7.5690002441
epoch time: 23.4437065125s, input_fired_time: 0.8138695955, output_fired_time: 0.0000000000, propagate_forward_time: 21.2496280670, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3802089691
validation[          , genome 18388] predictions:    9755/  10000 (97.55%), best:    9877/10000 (98.77%), error:       849.85083, best error:       407.47644 on epoch:    65, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 297.8630676270s, input_fired_time: 7.7093200684, output_fired_time: 4.9328579903, propagate_forward_time: 106.4867706299, propagate_backward_time: 171.1406860352, weight_update_time: 0.3425641954, other_time: 7.5934295654
epoch time: 23.5232963562s, input_fired_time: 0.8149722815, output_fired_time: 0.0000000000, propagate_forward_time: 21.3192405701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3890838623
validation[          , genome 18388] predictions:    9838/  10000 (98.38%), best:    9877/10000 (98.77%), error:       478.50797, best error:       407.47644 on epoch:    65, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 297.5008239746s, input_fired_time: 7.6760683060, output_fired_time: 4.9400796890, propagate_forward_time: 106.5006866455, propagate_backward_time: 170.7970733643, weight_update_time: 0.3417827189, other_time: 7.5869140625
epoch time: 23.4939117432s, input_fired_time: 0.8069433570, output_fired_time: 0.0000000000, propagate_forward_time: 21.2994422913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3875255585
validation[          , genome 18388] predictions:    9868/  10000 (98.68%), best:    9877/10000 (98.77%), error:       472.35379, best error:       407.47644 on epoch:    65, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 295.5344543457s, input_fired_time: 7.6348471642, output_fired_time: 4.9001255035, propagate_forward_time: 105.7956542969, propagate_backward_time: 169.6537475586, weight_update_time: 0.3397540152, other_time: 7.5500793457
epoch time: 23.2486934662s, input_fired_time: 0.8087957501, output_fired_time: 0.0000000000, propagate_forward_time: 21.0674400330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3724575043
validation[          , genome 18388] predictions:    9818/  10000 (98.18%), best:    9877/10000 (98.77%), error:       598.07257, best error:       407.47644 on epoch:    65, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 295.6142578125s, input_fired_time: 7.6506376266, output_fired_time: 4.9078187943, propagate_forward_time: 105.9979324341, propagate_backward_time: 169.5054016113, weight_update_time: 0.3398621976, other_time: 7.5524902344
epoch time: 22.8412151337s, input_fired_time: 0.8004118800, output_fired_time: 0.0000000000, propagate_forward_time: 20.6884269714, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3523769379
validation[          , genome 18388] predictions:    9860/  10000 (98.60%), best:    9877/10000 (98.77%), error:       443.93579, best error:       407.47644 on epoch:    65, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 294.1635131836s, input_fired_time: 7.6380753517, output_fired_time: 4.8850650787, propagate_forward_time: 105.2839202881, propagate_backward_time: 168.8525085449, weight_update_time: 0.3392087519, other_time: 7.5039520264
epoch time: 23.4467334747s, input_fired_time: 0.8153771162, output_fired_time: 0.0000000000, propagate_forward_time: 21.2525920868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3787651062
validation[          , genome 18388] predictions:    9855/  10000 (98.55%), best:    9877/10000 (98.77%), error:       483.71356, best error:       407.47644 on epoch:    65, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 296.8548889160s, input_fired_time: 7.7014536858, output_fired_time: 4.9299116135, propagate_forward_time: 106.2085266113, propagate_backward_time: 170.4636688232, weight_update_time: 0.3413643241, other_time: 7.5513458252
epoch time: 23.4477863312s, input_fired_time: 0.8163055778, output_fired_time: 0.0000000000, propagate_forward_time: 21.2522277832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3792533875
validation[          , genome 18388] predictions:    9873/  10000 (98.73%), best:    9877/10000 (98.77%), error:       441.27530, best error:       407.47644 on epoch:    65, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 296.6472167969s, input_fired_time: 7.6935167313, output_fired_time: 4.9298925400, propagate_forward_time: 106.1033782959, propagate_backward_time: 170.3703765869, weight_update_time: 0.3412543237, other_time: 7.5500488281
epoch time: 23.4411354065s, input_fired_time: 0.8136057854, output_fired_time: 0.0000000000, propagate_forward_time: 21.2510013580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3765277863
validation[          , genome 18388] predictions:    9863/  10000 (98.63%), best:    9877/10000 (98.77%), error:       436.51102, best error:       407.47644 on epoch:    65, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 297.2205505371s, input_fired_time: 7.7055759430, output_fired_time: 4.9496030807, propagate_forward_time: 106.2392654419, propagate_backward_time: 170.7575988770, weight_update_time: 0.3419883847, other_time: 7.5685119629
epoch time: 23.4610195160s, input_fired_time: 0.8152494431, output_fired_time: 0.0000000000, propagate_forward_time: 21.2610321045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3847389221
validation[          , genome 18388] predictions:    9849/  10000 (98.49%), best:    9877/10000 (98.77%), error:       474.52621, best error:       407.47644 on epoch:    65, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 296.6319885254s, input_fired_time: 7.6967864037, output_fired_time: 4.9176292419, propagate_forward_time: 106.1939697266, propagate_backward_time: 170.2641143799, weight_update_time: 0.3416198790, other_time: 7.5594940186
epoch time: 23.4486618042s, input_fired_time: 0.8153498769, output_fired_time: 0.0000000000, propagate_forward_time: 21.2535324097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3797798157
validation[          , genome 18388] predictions:    9844/  10000 (98.44%), best:    9877/10000 (98.77%), error:       510.58795, best error:       407.47644 on epoch:    65, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 296.4512939453s, input_fired_time: 7.6884088516, output_fired_time: 4.9097347260, propagate_forward_time: 106.1794204712, propagate_backward_time: 170.1179656982, weight_update_time: 0.3412828445, other_time: 7.5557708740
epoch time: 23.4361400604s, input_fired_time: 0.8173410296, output_fired_time: 0.0000000000, propagate_forward_time: 21.2433071136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3754920959
validation[          , genome 18388] predictions:    9868/  10000 (98.68%), best:    9877/10000 (98.77%), error:       473.08676, best error:       407.47644 on epoch:    65, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 296.8181152344s, input_fired_time: 7.6944446564, output_fired_time: 4.9129648209, propagate_forward_time: 106.2664260864, propagate_backward_time: 170.3796081543, weight_update_time: 0.3418048918, other_time: 7.5646667480
epoch time: 23.4394874573s, input_fired_time: 0.8132171631, output_fired_time: 0.0000000000, propagate_forward_time: 21.2492427826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3770275116
validation[          , genome 18388] predictions:    9838/  10000 (98.38%), best:    9877/10000 (98.77%), error:       523.14624, best error:       407.47644 on epoch:    65, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 296.0038452148s, input_fired_time: 7.6966242790, output_fired_time: 4.9005680084, propagate_forward_time: 106.0199203491, propagate_backward_time: 169.8398284912, weight_update_time: 0.3410978317, other_time: 7.5468902588
epoch time: 23.4462738037s, input_fired_time: 0.8167657256, output_fired_time: 0.0000000000, propagate_forward_time: 21.2407302856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3887786865
validation[          , genome 18388] predictions:    9863/  10000 (98.63%), best:    9877/10000 (98.77%), error:       458.65747, best error:       407.47644 on epoch:    65, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 296.4894714355s, input_fired_time: 7.7075424194, output_fired_time: 4.9156198502, propagate_forward_time: 106.1970367432, propagate_backward_time: 170.1092987061, weight_update_time: 0.3417590857, other_time: 7.5599670410
epoch time: 23.4583816528s, input_fired_time: 0.8182985187, output_fired_time: 0.0000000000, propagate_forward_time: 21.2567558289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3833274841
validation[          , genome 18388] predictions:    9872/  10000 (98.72%), best:    9877/10000 (98.77%), error:       432.36438, best error:       407.47644 on epoch:    65, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 3153.7866210938s, input_fired_time: 7.7202219963, output_fired_time: 4.9318680763, propagate_forward_time: 106.5687942505, propagate_backward_time: 3027.0417480469, weight_update_time: 0.3427861333, other_time: 7.5239257812
epoch time: 23.4581260681s, input_fired_time: 0.8175133467, output_fired_time: 0.0000000000, propagate_forward_time: 21.2566890717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3839244843
validation[          , genome 18388] predictions:    9866/  10000 (98.66%), best:    9877/10000 (98.77%), error:       456.67200, best error:       407.47644 on epoch:    65, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 296.9132080078s, input_fired_time: 7.7158622742, output_fired_time: 4.9340386391, propagate_forward_time: 106.1701507568, propagate_backward_time: 170.5109558105, weight_update_time: 0.3420482576, other_time: 7.5821990967
epoch time: 23.4833259583s, input_fired_time: 0.8198850155, output_fired_time: 0.0000000000, propagate_forward_time: 21.2719097137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3915309906
validation[          , genome 18388] predictions:    9862/  10000 (98.62%), best:    9877/10000 (98.77%), error:       464.53027, best error:       407.47644 on epoch:    65, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 296.4842529297s, input_fired_time: 7.7008829117, output_fired_time: 4.9229054451, propagate_forward_time: 105.9977264404, propagate_backward_time: 170.2849426270, weight_update_time: 0.3414969444, other_time: 7.5777740479
epoch time: 23.1639251709s, input_fired_time: 0.8076089621, output_fired_time: 0.0000000000, propagate_forward_time: 20.9861850739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3701305389
validation[          , genome 18388] predictions:    9862/  10000 (98.62%), best:    9877/10000 (98.77%), error:       449.38199, best error:       407.47644 on epoch:    65, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 294.7310180664s, input_fired_time: 7.6591649055, output_fired_time: 4.8875546455, propagate_forward_time: 105.5149307251, propagate_backward_time: 169.1131439209, weight_update_time: 0.3414844573, other_time: 7.5562286377
epoch time: 23.4583377838s, input_fired_time: 0.8182641864, output_fired_time: 0.0000000000, propagate_forward_time: 21.2544803619, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3855934143
validation[          , genome 18388] predictions:    9857/  10000 (98.57%), best:    9877/10000 (98.77%), error:       461.78244, best error:       407.47644 on epoch:    65, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 117.3330535889s, input_fired_time: 4.0575437546, output_fired_time: 0.0000000000, propagate_forward_time: 106.3020706177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9734420776
best training[          , genome 18388] predictions:   49972/  50000 (99.94%), best:    9877/10000 (98.77%), error:       287.67163, best error:       407.47644 on epoch:    65, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 23.4323444366s, input_fired_time: 0.7947342396, output_fired_time: 0.0000000000, propagate_forward_time: 21.2513923645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3862171173
   testing[          , genome 18388] predictions:    9885/  10000 (98.85%), best:    9877/10000 (98.77%), error:       356.20541, best error:       407.47644 on epoch:    65, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
21:11:01 (5626): called boinc_finish(0)

</stderr_txt>
]]>