Nameexact_genome_1517574602_58_18227_0
Workunit2990030
Created9 Feb 2018, 1:51:04 UTC
Sent9 Feb 2018, 2:29:53 UTC
Report deadline5 Mar 2018, 11:41:15 UTC
Received10 Feb 2018, 3:51:33 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID70684
Run time16 hours 5 min 13 sec
CPU time16 hours 5 min 12 sec
Validate stateInitial
Credit0.00
Device peak FLOPS3.04 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size170.94 MB
Peak swap size173.61 MB
Peak disk usage1.97 MB

Stderr output

<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
0000000000, other_time: 1.6515350342
validation[          , genome 18227] predictions:    9814/  10000 (98.14%), best:    9858/10000 (98.58%), error:       631.47333, best error:       569.58411 on epoch:     2, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 573.3217163086s, input_fired_time: 10.0538215637, output_fired_time: 10.8728790283, propagate_forward_time: 202.4004058838, propagate_backward_time: 340.1417236328, weight_update_time: 1.0948441029, other_time: 9.8529052734
epoch time: 47.8975601196s, input_fired_time: 1.1379626989, output_fired_time: 0.0000000000, propagate_forward_time: 44.9965591431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7630386353
validation[          , genome 18227] predictions:    9871/  10000 (98.71%), best:    9871/10000 (98.71%), error:       489.36554, best error:       489.36554 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 575.8792724609s, input_fired_time: 10.0701818466, output_fired_time: 10.9157409668, propagate_forward_time: 203.7774353027, propagate_backward_time: 341.3103027344, weight_update_time: 1.0984917879, other_time: 9.8055725098
epoch time: 41.0226593018s, input_fired_time: 1.0312912464, output_fired_time: 0.0000000000, propagate_forward_time: 38.2928695679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6984977722
validation[          , genome 18227] predictions:    9815/  10000 (98.15%), best:    9871/10000 (98.71%), error:       617.46057, best error:       489.36554 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 518.5867919922s, input_fired_time: 9.4301700592, output_fired_time: 9.7348833084, propagate_forward_time: 182.8219909668, propagate_backward_time: 306.9812316895, weight_update_time: 1.0495799780, other_time: 9.6184997559
epoch time: 34.8993568420s, input_fired_time: 0.9259772301, output_fired_time: 0.0000000000, propagate_forward_time: 32.3592453003, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6141357422
validation[          , genome 18227] predictions:    9827/  10000 (98.27%), best:    9871/10000 (98.71%), error:       554.45593, best error:       489.36554 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 515.6299438477s, input_fired_time: 9.4079713821, output_fired_time: 9.6882600784, propagate_forward_time: 181.5175476074, propagate_backward_time: 305.3782348633, weight_update_time: 1.0466814041, other_time: 9.6379394531
epoch time: 39.7595558167s, input_fired_time: 1.0113699436, output_fired_time: 0.0000000000, propagate_forward_time: 37.0444793701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7037048340
validation[          , genome 18227] predictions:    9740/  10000 (97.40%), best:    9871/10000 (98.71%), error:       818.58118, best error:       489.36554 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 628.0148315430s, input_fired_time: 10.7472953796, output_fired_time: 12.0287027359, propagate_forward_time: 222.4284515381, propagate_backward_time: 372.5541992188, weight_update_time: 1.1491445303, other_time: 10.2561645508
epoch time: 45.7944564819s, input_fired_time: 1.1137148142, output_fired_time: 0.0000000000, propagate_forward_time: 42.9079589844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7727813721
validation[          , genome 18227] predictions:    9848/  10000 (98.48%), best:    9871/10000 (98.71%), error:       527.80688, best error:       489.36554 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 533.4952392578s, input_fired_time: 9.6060981750, output_fired_time: 10.0361728668, propagate_forward_time: 188.5162811279, propagate_backward_time: 315.7763671875, weight_update_time: 1.0610744953, other_time: 9.5603027344
epoch time: 34.7003936768s, input_fired_time: 0.9305983186, output_fired_time: 0.0000000000, propagate_forward_time: 32.1603469849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6094474792
validation[          , genome 18227] predictions:    9845/  10000 (98.45%), best:    9871/10000 (98.71%), error:       524.46997, best error:       489.36554 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 569.3345336914s, input_fired_time: 10.0319519043, output_fired_time: 10.7680492401, propagate_forward_time: 200.9179382324, propagate_backward_time: 337.7534790039, weight_update_time: 1.0913860798, other_time: 9.8631286621
epoch time: 47.7876815796s, input_fired_time: 1.1420906782, output_fired_time: 0.0000000000, propagate_forward_time: 44.8788032532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7667884827
validation[          , genome 18227] predictions:    9832/  10000 (98.32%), best:    9871/10000 (98.71%), error:       536.75171, best error:       489.36554 on epoch:    15, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 577.6109619141s, input_fired_time: 10.1289520264, output_fired_time: 10.9563312531, propagate_forward_time: 204.3148956299, propagate_backward_time: 342.3583068848, weight_update_time: 1.1009758711, other_time: 9.8524475098
epoch time: 47.3525352478s, input_fired_time: 1.1351300478, output_fired_time: 0.0000000000, propagate_forward_time: 44.5191955566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6982078552
validation[          , genome 18227] predictions:    9743/  10000 (97.43%), best:    9871/10000 (98.71%), error:       823.90948, best error:       489.36554 on epoch:    15, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 552.4917602539s, input_fired_time: 9.8474540710, output_fired_time: 10.4561758041, propagate_forward_time: 195.0399475098, propagate_backward_time: 327.5389404297, weight_update_time: 1.0769646168, other_time: 9.6092224121
epoch time: 34.4941406250s, input_fired_time: 0.9329382777, output_fired_time: 0.0000000000, propagate_forward_time: 31.9603252411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6008777618
validation[          , genome 18227] predictions:    9827/  10000 (98.27%), best:    9871/10000 (98.71%), error:       594.27350, best error:       489.36554 on epoch:    15, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 554.3721313477s, input_fired_time: 9.8552789688, output_fired_time: 10.4743185043, propagate_forward_time: 195.8373870850, propagate_backward_time: 328.4952087402, weight_update_time: 1.0781081915, other_time: 9.7099304199
epoch time: 27.9908847809s, input_fired_time: 0.8215066791, output_fired_time: 0.0000000000, propagate_forward_time: 25.5948333740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5745449066
validation[          , genome 18227] predictions:    9844/  10000 (98.44%), best:    9871/10000 (98.71%), error:       525.15283, best error:       489.36554 on epoch:    15, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 534.5092163086s, input_fired_time: 9.6105747223, output_fired_time: 10.0663843155, propagate_forward_time: 188.8049621582, propagate_backward_time: 316.4320068359, weight_update_time: 1.0616130829, other_time: 9.5952453613
epoch time: 39.3404731750s, input_fired_time: 1.0097328424, output_fired_time: 0.0000000000, propagate_forward_time: 36.6816482544, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6490936279
validation[          , genome 18227] predictions:    9840/  10000 (98.40%), best:    9871/10000 (98.71%), error:       508.95395, best error:       489.36554 on epoch:    15, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 488.3321838379s, input_fired_time: 9.1091842651, output_fired_time: 9.0915365219, propagate_forward_time: 172.3026275635, propagate_backward_time: 288.4794921875, weight_update_time: 1.0201166868, other_time: 9.3493652344
epoch time: 27.7327404022s, input_fired_time: 0.8185091615, output_fired_time: 0.0000000000, propagate_forward_time: 25.3761405945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5380897522
validation[          , genome 18227] predictions:    9816/  10000 (98.16%), best:    9871/10000 (98.71%), error:       584.80011, best error:       489.36554 on epoch:    15, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 369.7660827637s, input_fired_time: 7.7557029724, output_fired_time: 6.6257758141, propagate_forward_time: 129.0318450928, propagate_backward_time: 217.5360260010, weight_update_time: 0.9119876623, other_time: 8.8167419434
epoch time: 28.4878158569s, input_fired_time: 0.8332727551, output_fired_time: 0.0000000000, propagate_forward_time: 26.0986366272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5559062958
validation[          , genome 18227] predictions:    9782/  10000 (97.82%), best:    9871/10000 (98.71%), error:       697.74921, best error:       489.36554 on epoch:    15, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 371.9730224609s, input_fired_time: 7.7972087860, output_fired_time: 6.6683831215, propagate_forward_time: 129.5518493652, propagate_backward_time: 219.1013488770, weight_update_time: 0.9155858159, other_time: 8.8542175293
epoch time: 28.1897201538s, input_fired_time: 0.8246321082, output_fired_time: 0.0000000000, propagate_forward_time: 25.8197097778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5453777313
validation[          , genome 18227] predictions:    9826/  10000 (98.26%), best:    9871/10000 (98.71%), error:       539.64838, best error:       489.36554 on epoch:    15, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 490.4370422363s, input_fired_time: 9.1919755936, output_fired_time: 9.1779994965, propagate_forward_time: 172.6436614990, propagate_backward_time: 289.8775024414, weight_update_time: 1.0262223482, other_time: 9.5458984375
epoch time: 38.2286338806s, input_fired_time: 0.9959787726, output_fired_time: 0.0000000000, propagate_forward_time: 35.5195655823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7130889893
validation[          , genome 18227] predictions:    9807/  10000 (98.07%), best:    9871/10000 (98.71%), error:       635.23444, best error:       489.36554 on epoch:    15, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 487.1586303711s, input_fired_time: 9.1487112045, output_fired_time: 9.1149406433, propagate_forward_time: 171.4762573242, propagate_backward_time: 287.8119201660, weight_update_time: 1.0271935463, other_time: 9.6068115234
epoch time: 47.7099876404s, input_fired_time: 1.1519333124, output_fired_time: 0.0000000000, propagate_forward_time: 44.8211135864, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7369422913
validation[          , genome 18227] predictions:    9852/  10000 (98.52%), best:    9852/10000 (98.52%), error:       476.64587, best error:       476.64587 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 586.8438110352s, input_fired_time: 10.2491092682, output_fired_time: 11.1471986771, propagate_forward_time: 207.6821746826, propagate_backward_time: 347.9568176270, weight_update_time: 1.1067872047, other_time: 9.8085021973
epoch time: 42.8631668091s, input_fired_time: 1.0722895861, output_fired_time: 0.0000000000, propagate_forward_time: 40.0603027344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7305755615
validation[          , genome 18227] predictions:    9828/  10000 (98.28%), best:    9852/10000 (98.52%), error:       534.96423, best error:       476.64587 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 540.2473754883s, input_fired_time: 9.7421255112, output_fired_time: 10.1981382370, propagate_forward_time: 190.8962860107, propagate_backward_time: 319.7232971191, weight_update_time: 1.0694576502, other_time: 9.6875305176
epoch time: 30.1968555450s, input_fired_time: 0.8661112785, output_fired_time: 0.0000000000, propagate_forward_time: 27.7092895508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6214542389
validation[          , genome 18227] predictions:    9817/  10000 (98.17%), best:    9852/10000 (98.52%), error:       534.47125, best error:       476.64587 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 562.9514770508s, input_fired_time: 10.0130538940, output_fired_time: 10.6921739578, propagate_forward_time: 198.8523712158, propagate_backward_time: 333.5242919922, weight_update_time: 1.0895254612, other_time: 9.8695678711
epoch time: 47.3479118347s, input_fired_time: 1.1460015774, output_fired_time: 0.0000000000, propagate_forward_time: 44.4288406372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7730712891
validation[          , genome 18227] predictions:    9833/  10000 (98.33%), best:    9852/10000 (98.52%), error:       546.36554, best error:       476.64587 on epoch:    30, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 552.6383666992s, input_fired_time: 9.8971996307, output_fired_time: 10.4506893158, propagate_forward_time: 195.1539306641, propagate_backward_time: 327.3200683594, weight_update_time: 1.0793746710, other_time: 9.8164672852
epoch time: 47.2289466858s, input_fired_time: 1.1361451149, output_fired_time: 0.0000000000, propagate_forward_time: 44.3878631592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7049369812
validation[          , genome 18227] predictions:    9868/  10000 (98.68%), best:    9868/10000 (98.68%), error:       456.23679, best error:       456.23679 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 503.9491882324s, input_fired_time: 9.3545007706, output_fired_time: 9.4326887131, propagate_forward_time: 177.3995819092, propagate_backward_time: 298.2094421387, weight_update_time: 1.0346138477, other_time: 9.5530090332
epoch time: 47.5977210999s, input_fired_time: 1.1533702612, output_fired_time: 0.0000000000, propagate_forward_time: 44.6811065674, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7632446289
validation[          , genome 18227] predictions:    9841/  10000 (98.41%), best:    9868/10000 (98.68%), error:       551.18652, best error:       456.23679 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 599.3574829102s, input_fired_time: 10.4348115921, output_fired_time: 11.4621362686, propagate_forward_time: 211.9833068848, propagate_backward_time: 355.4063110352, weight_update_time: 1.1281257868, other_time: 10.0708923340
epoch time: 47.5250358582s, input_fired_time: 1.1480406523, output_fired_time: 0.0000000000, propagate_forward_time: 44.6128845215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7641105652
validation[          , genome 18227] predictions:    9847/  10000 (98.47%), best:    9868/10000 (98.68%), error:       521.67285, best error:       456.23679 on epoch:    34, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 633.1724853516s, input_fired_time: 10.8407649994, output_fired_time: 12.1407594681, propagate_forward_time: 224.1950073242, propagate_backward_time: 375.8377685547, weight_update_time: 1.1480567455, other_time: 10.1582031250
epoch time: 47.7621154785s, input_fired_time: 1.1567018032, output_fired_time: 0.0000000000, propagate_forward_time: 44.8801193237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7252960205
validation[          , genome 18227] predictions:    9824/  10000 (98.24%), best:    9868/10000 (98.68%), error:       552.82025, best error:       456.23679 on epoch:    34, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 589.8682250977s, input_fired_time: 10.3767480850, output_fired_time: 11.2418298721, propagate_forward_time: 208.6912231445, propagate_backward_time: 349.4727478027, weight_update_time: 1.1141978502, other_time: 10.0856628418
epoch time: 29.8620948792s, input_fired_time: 0.8585330844, output_fired_time: 0.0000000000, propagate_forward_time: 27.4267272949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5768337250
validation[          , genome 18227] predictions:    9869/  10000 (98.69%), best:    9868/10000 (98.68%), error:       462.02884, best error:       456.23679 on epoch:    34, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 439.7489318848s, input_fired_time: 8.6050615311, output_fired_time: 8.0626630783, propagate_forward_time: 154.4920501709, propagate_backward_time: 259.4851989746, weight_update_time: 0.9745297432, other_time: 9.1039733887
epoch time: 30.9198970795s, input_fired_time: 0.8783414364, output_fired_time: 0.0000000000, propagate_forward_time: 28.4657115936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5758438110
validation[          , genome 18227] predictions:    9862/  10000 (98.62%), best:    9868/10000 (98.68%), error:       478.45834, best error:       456.23679 on epoch:    34, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 535.1043701172s, input_fired_time: 9.7148313522, output_fired_time: 10.0781097412, propagate_forward_time: 189.0349273682, propagate_backward_time: 316.6495056152, weight_update_time: 1.0634648800, other_time: 9.6269836426
epoch time: 47.9636573792s, input_fired_time: 1.1700173616, output_fired_time: 0.0000000000, propagate_forward_time: 45.0234603882, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7701797485
validation[          , genome 18227] predictions:    9733/  10000 (97.33%), best:    9868/10000 (98.68%), error:       863.89618, best error:       456.23679 on epoch:    34, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 570.5581054688s, input_fired_time: 10.1703186035, output_fired_time: 10.8524723053, propagate_forward_time: 201.9171752930, propagate_backward_time: 337.6175537109, weight_update_time: 1.0993248224, other_time: 10.0006103516
epoch time: 31.1367664337s, input_fired_time: 0.9054859281, output_fired_time: 0.0000000000, propagate_forward_time: 28.5513687134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6799125671
validation[          , genome 18227] predictions:    9853/  10000 (98.53%), best:    9868/10000 (98.68%), error:       468.79514, best error:       456.23679 on epoch:    34, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 522.4515991211s, input_fired_time: 9.5373020172, output_fired_time: 9.7993946075, propagate_forward_time: 184.1394500732, propagate_backward_time: 309.4118347168, weight_update_time: 1.0519192219, other_time: 9.5636291504
epoch time: 38.5063934326s, input_fired_time: 1.0065841675, output_fired_time: 0.0000000000, propagate_forward_time: 35.8411750793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6586341858
validation[          , genome 18227] predictions:    9869/  10000 (98.69%), best:    9868/10000 (98.68%), error:       462.23151, best error:       456.23679 on epoch:    34, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 535.4188232422s, input_fired_time: 9.6950139999, output_fired_time: 10.0852518082, propagate_forward_time: 188.8318939209, propagate_backward_time: 317.2128601074, weight_update_time: 1.0596507788, other_time: 9.5937805176
epoch time: 37.2236976624s, input_fired_time: 0.9735016227, output_fired_time: 0.0000000000, propagate_forward_time: 34.6280364990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6221580505
validation[          , genome 18227] predictions:    9871/  10000 (98.71%), best:    9871/10000 (98.71%), error:       445.81476, best error:       445.81476 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 508.3788146973s, input_fired_time: 9.4010362625, output_fired_time: 9.5342569351, propagate_forward_time: 179.2286834717, propagate_backward_time: 300.5962829590, weight_update_time: 1.0400747061, other_time: 9.6185607910
epoch time: 46.5851669312s, input_fired_time: 1.1387462616, output_fired_time: 0.0000000000, propagate_forward_time: 43.6945648193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7518539429
validation[          , genome 18227] predictions:    9830/  10000 (98.30%), best:    9871/10000 (98.71%), error:       522.25031, best error:       445.81476 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 536.2510986328s, input_fired_time: 9.6940279007, output_fired_time: 10.0824546814, propagate_forward_time: 189.5095367432, propagate_backward_time: 317.3505249023, weight_update_time: 1.0632851124, other_time: 9.6145629883
epoch time: 35.9029235840s, input_fired_time: 0.9589637518, output_fired_time: 0.0000000000, propagate_forward_time: 33.3277244568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6162338257
validation[          , genome 18227] predictions:    9857/  10000 (98.57%), best:    9871/10000 (98.71%), error:       465.01855, best error:       445.81476 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 504.9558105469s, input_fired_time: 9.3469314575, output_fired_time: 9.4211568832, propagate_forward_time: 178.4356079102, propagate_backward_time: 298.3130798340, weight_update_time: 1.0338885784, other_time: 9.4390563965
epoch time: 44.2018585205s, input_fired_time: 1.0953862667, output_fired_time: 0.0000000000, propagate_forward_time: 41.4070587158, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6994132996
validation[          , genome 18227] predictions:    9857/  10000 (98.57%), best:    9871/10000 (98.71%), error:       480.97470, best error:       445.81476 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 587.6104736328s, input_fired_time: 10.2855348587, output_fired_time: 11.1827459335, propagate_forward_time: 207.8020935059, propagate_backward_time: 348.4202270508, weight_update_time: 1.1099039316, other_time: 9.9198913574
epoch time: 42.9725303650s, input_fired_time: 1.0785074234, output_fired_time: 0.0000000000, propagate_forward_time: 40.2176017761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6764221191
validation[          , genome 18227] predictions:    9857/  10000 (98.57%), best:    9871/10000 (98.71%), error:       512.58752, best error:       445.81476 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 473.4356994629s, input_fired_time: 8.9937591553, output_fired_time: 8.7792921066, propagate_forward_time: 166.5255279541, propagate_backward_time: 279.6814270020, weight_update_time: 1.0090118647, other_time: 9.4557189941
epoch time: 37.0489044189s, input_fired_time: 0.9817836285, output_fired_time: 0.0000000000, propagate_forward_time: 34.4402236938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6268959045
validation[          , genome 18227] predictions:    9869/  10000 (98.69%), best:    9871/10000 (98.71%), error:       458.47577, best error:       445.81476 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 497.0758972168s, input_fired_time: 9.2740278244, output_fired_time: 9.2948532104, propagate_forward_time: 175.7054290771, propagate_backward_time: 293.3642883301, weight_update_time: 1.0263720751, other_time: 9.4372863770
epoch time: 47.2748527527s, input_fired_time: 1.1575284004, output_fired_time: 0.0000000000, propagate_forward_time: 44.3947029114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7226219177
validation[          , genome 18227] predictions:    9869/  10000 (98.69%), best:    9871/10000 (98.71%), error:       450.86502, best error:       445.81476 on epoch:    43, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 454.8317871094s, input_fired_time: 8.7978506088, output_fired_time: 8.3951721191, propagate_forward_time: 159.9644165039, propagate_backward_time: 268.4322509766, weight_update_time: 0.9901712537, other_time: 9.2420959473
epoch time: 28.0825824738s, input_fired_time: 0.8382784128, output_fired_time: 0.0000000000, propagate_forward_time: 25.6985473633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5457572937
validation[          , genome 18227] predictions:    9848/  10000 (98.48%), best:    9871/10000 (98.71%), error:       503.69330, best error:       445.81476 on epoch:    43, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 400.4596557617s, input_fired_time: 8.1844034195, output_fired_time: 7.2742204666, propagate_forward_time: 140.2785339355, propagate_backward_time: 235.7156524658, weight_update_time: 0.9397050142, other_time: 9.0068206787
epoch time: 28.0398693085s, input_fired_time: 0.8336653709, output_fired_time: 0.0000000000, propagate_forward_time: 25.6477966309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5584068298
validation[          , genome 18227] predictions:    9879/  10000 (98.79%), best:    9879/10000 (98.79%), error:       403.55115, best error:       403.55115 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 424.3064270020s, input_fired_time: 8.4826316833, output_fired_time: 7.7689776421, propagate_forward_time: 149.1201782227, propagate_backward_time: 249.7607727051, weight_update_time: 0.9622409940, other_time: 9.1738586426
epoch time: 47.6391830444s, input_fired_time: 1.1641664505, output_fired_time: 0.0000000000, propagate_forward_time: 44.7094116211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7656059265
validation[          , genome 18227] predictions:    9885/  10000 (98.85%), best:    9879/10000 (98.79%), error:       429.30765, best error:       403.55115 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 518.0379028320s, input_fired_time: 9.4958543777, output_fired_time: 9.6969766617, propagate_forward_time: 183.0380401611, propagate_backward_time: 306.3709716797, weight_update_time: 1.0492216349, other_time: 9.4360351562
epoch time: 42.9833221436s, input_fired_time: 1.0794913769, output_fired_time: 0.0000000000, propagate_forward_time: 40.2375869751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6662445068
validation[          , genome 18227] predictions:    9854/  10000 (98.54%), best:    9879/10000 (98.79%), error:       466.65704, best error:       403.55115 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 531.7197265625s, input_fired_time: 9.6649646759, output_fired_time: 9.9891452789, propagate_forward_time: 187.7208099365, propagate_backward_time: 314.8551330566, weight_update_time: 1.0559821129, other_time: 9.4896545410
epoch time: 46.7692184448s, input_fired_time: 1.1356794834, output_fired_time: 0.0000000000, propagate_forward_time: 43.9317283630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7018089294
validation[          , genome 18227] predictions:    9850/  10000 (98.50%), best:    9879/10000 (98.79%), error:       489.19031, best error:       403.55115 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 445.7810974121s, input_fired_time: 8.6833772659, output_fired_time: 8.2062110901, propagate_forward_time: 156.5152587891, propagate_backward_time: 263.2567138672, weight_update_time: 0.9786859155, other_time: 9.1195373535
epoch time: 43.7243614197s, input_fired_time: 1.1010732651, output_fired_time: 0.0000000000, propagate_forward_time: 40.9223365784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7009506226
validation[          , genome 18227] predictions:    9871/  10000 (98.71%), best:    9879/10000 (98.79%), error:       466.64651, best error:       403.55115 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 563.4520263672s, input_fired_time: 10.0407962799, output_fired_time: 10.7198333740, propagate_forward_time: 199.4368896484, propagate_backward_time: 333.5079956055, weight_update_time: 1.0891760588, other_time: 9.7465209961
epoch time: 39.9550247192s, input_fired_time: 1.0304912329, output_fired_time: 0.0000000000, propagate_forward_time: 37.2603988647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6641349792
validation[          , genome 18227] predictions:    9872/  10000 (98.72%), best:    9879/10000 (98.79%), error:       423.46811, best error:       403.55115 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 518.4204101562s, input_fired_time: 9.5454158783, output_fired_time: 9.7194576263, propagate_forward_time: 182.8717803955, propagate_backward_time: 306.7059020996, weight_update_time: 1.0480122566, other_time: 9.5778503418
epoch time: 34.2043876648s, input_fired_time: 0.9504140019, output_fired_time: 0.0000000000, propagate_forward_time: 31.5572719574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6967029572
validation[          , genome 18227] predictions:    9870/  10000 (98.70%), best:    9879/10000 (98.79%), error:       469.84473, best error:       403.55115 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 565.8790283203s, input_fired_time: 10.1096124649, output_fired_time: 10.7578678131, propagate_forward_time: 200.3101501465, propagate_backward_time: 334.7848815918, weight_update_time: 1.0947085619, other_time: 9.9165039062
epoch time: 47.1185531616s, input_fired_time: 1.1505131721, output_fired_time: 0.0000000000, propagate_forward_time: 44.2426872253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7253532410
validation[          , genome 18227] predictions:    9864/  10000 (98.64%), best:    9879/10000 (98.79%), error:       470.19971, best error:       403.55115 on epoch:    51, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 608.3961181641s, input_fired_time: 10.6157436371, output_fired_time: 11.6316375732, propagate_forward_time: 215.4096221924, propagate_backward_time: 360.6369018555, weight_update_time: 1.1288459301, other_time: 10.1022338867
epoch time: 46.1707229614s, input_fired_time: 1.1303961277, output_fired_time: 0.0000000000, propagate_forward_time: 43.2902832031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7500419617
validation[          , genome 18227] predictions:    9857/  10000 (98.57%), best:    9879/10000 (98.79%), error:       518.70581, best error:       403.55115 on epoch:    51, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 471.8042602539s, input_fired_time: 9.0870342255, output_fired_time: 8.8060560226, propagate_forward_time: 165.8154754639, propagate_backward_time: 278.3977050781, weight_update_time: 1.0115584135, other_time: 9.6979980469
epoch time: 47.7616119385s, input_fired_time: 1.1703346968, output_fired_time: 0.0000000000, propagate_forward_time: 44.8256988525, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7655792236
validation[          , genome 18227] predictions:    9855/  10000 (98.55%), best:    9879/10000 (98.79%), error:       511.31915, best error:       403.55115 on epoch:    51, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 607.9011230469s, input_fired_time: 10.5610589981, output_fired_time: 11.6057996750, propagate_forward_time: 215.5118103027, propagate_backward_time: 360.3032531738, weight_update_time: 1.1285507679, other_time: 9.9192504883
epoch time: 47.6953811646s, input_fired_time: 1.1674301624, output_fired_time: 0.0000000000, propagate_forward_time: 44.7579574585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7699928284
validation[          , genome 18227] predictions:    9870/  10000 (98.70%), best:    9879/10000 (98.79%), error:       432.31387, best error:       403.55115 on epoch:    51, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 548.1169433594s, input_fired_time: 9.8560991287, output_fired_time: 10.3579664230, propagate_forward_time: 193.5100555420, propagate_backward_time: 324.7490539551, weight_update_time: 1.0741225481, other_time: 9.6437683105
epoch time: 46.0791473389s, input_fired_time: 1.1387196779, output_fired_time: 0.0000000000, propagate_forward_time: 43.2214241028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7190017700
validation[          , genome 18227] predictions:    9880/  10000 (98.80%), best:    9879/10000 (98.79%), error:       418.67535, best error:       403.55115 on epoch:    51, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 555.3618164062s, input_fired_time: 9.9952640533, output_fired_time: 10.5436954498, propagate_forward_time: 196.2708282471, propagate_backward_time: 328.6229248047, weight_update_time: 1.0867259502, other_time: 9.9291381836
epoch time: 33.9058990479s, input_fired_time: 0.9481327534, output_fired_time: 0.0000000000, propagate_forward_time: 31.2502479553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7075195312
validation[          , genome 18227] predictions:    9870/  10000 (98.70%), best:    9879/10000 (98.79%), error:       431.62177, best error:       403.55115 on epoch:    51, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 429.7335205078s, input_fired_time: 8.6095886230, output_fired_time: 7.9402446747, propagate_forward_time: 150.4022369385, propagate_backward_time: 253.1469573975, weight_update_time: 0.9759163260, other_time: 9.6344757080
epoch time: 28.5511417389s, input_fired_time: 0.8608402014, output_fired_time: 0.0000000000, propagate_forward_time: 26.0343837738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6559181213
validation[          , genome 18227] predictions:    9883/  10000 (98.83%), best:    9879/10000 (98.79%), error:       414.54532, best error:       403.55115 on epoch:    51, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 509.1080627441s, input_fired_time: 9.4865398407, output_fired_time: 9.5628738403, propagate_forward_time: 179.0448303223, propagate_backward_time: 301.1773071289, weight_update_time: 1.0462869406, other_time: 9.8365173340
epoch time: 47.8719635010s, input_fired_time: 1.1762112379, output_fired_time: 0.0000000000, propagate_forward_time: 44.9111900330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7845611572
validation[          , genome 18227] predictions:    9870/  10000 (98.70%), best:    9879/10000 (98.79%), error:       409.23328, best error:       403.55115 on epoch:    51, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 544.2919311523s, input_fired_time: 9.9050512314, output_fired_time: 10.3035669327, propagate_forward_time: 192.2409973145, propagate_backward_time: 321.9449462891, weight_update_time: 1.0751045942, other_time: 9.8973693848
epoch time: 41.4897537231s, input_fired_time: 1.0672795773, output_fired_time: 0.0000000000, propagate_forward_time: 38.6808891296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7415847778
validation[          , genome 18227] predictions:    9885/  10000 (98.85%), best:    9879/10000 (98.79%), error:       433.42578, best error:       403.55115 on epoch:    51, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 569.9834594727s, input_fired_time: 10.1712503433, output_fired_time: 10.8297729492, propagate_forward_time: 201.7225341797, propagate_backward_time: 337.3833312988, weight_update_time: 1.0962233543, other_time: 9.8765563965
epoch time: 33.6100502014s, input_fired_time: 0.9422556162, output_fired_time: 0.0000000000, propagate_forward_time: 30.9822139740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6855792999
validation[          , genome 18227] predictions:    9789/  10000 (97.89%), best:    9879/10000 (98.79%), error:       749.14056, best error:       403.55115 on epoch:    51, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 492.3328857422s, input_fired_time: 9.3455085754, output_fired_time: 9.2103309631, propagate_forward_time: 173.3095245361, propagate_backward_time: 290.7330932617, weight_update_time: 1.0299338102, other_time: 9.7344360352
epoch time: 40.5210304260s, input_fired_time: 1.0533660650, output_fired_time: 0.0000000000, propagate_forward_time: 37.7480697632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7195930481
validation[          , genome 18227] predictions:    9878/  10000 (98.78%), best:    9879/10000 (98.79%), error:       441.71539, best error:       403.55115 on epoch:    51, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 633.2621459961s, input_fired_time: 10.9460763931, output_fired_time: 12.1467151642, propagate_forward_time: 224.4690856934, propagate_backward_time: 375.4450073242, weight_update_time: 1.1541558504, other_time: 10.2552185059
epoch time: 47.5867462158s, input_fired_time: 1.1689651012, output_fired_time: 0.0000000000, propagate_forward_time: 44.6348724365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7829093933
validation[          , genome 18227] predictions:    9886/  10000 (98.86%), best:    9879/10000 (98.79%), error:       412.11145, best error:       403.55115 on epoch:    51, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 611.7919921875s, input_fired_time: 10.6810808182, output_fired_time: 11.7163524628, propagate_forward_time: 216.7665405273, propagate_backward_time: 362.4518432617, weight_update_time: 1.1365940571, other_time: 10.1761474609
epoch time: 27.9781227112s, input_fired_time: 0.8504455090, output_fired_time: 0.0000000000, propagate_forward_time: 25.4941158295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6335620880
validation[          , genome 18227] predictions:    9834/  10000 (98.34%), best:    9879/10000 (98.79%), error:       520.30133, best error:       403.55115 on epoch:    51, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 603.8522949219s, input_fired_time: 10.6080389023, output_fired_time: 11.5538692474, propagate_forward_time: 213.7626190186, propagate_backward_time: 357.8089294434, weight_update_time: 1.1271873713, other_time: 10.1188049316
epoch time: 47.8654747009s, input_fired_time: 1.1724898815, output_fired_time: 0.0000000000, propagate_forward_time: 44.9198913574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7730941772
validation[          , genome 18227] predictions:    9858/  10000 (98.58%), best:    9879/10000 (98.79%), error:       470.95905, best error:       403.55115 on epoch:    51, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 550.2506103516s, input_fired_time: 9.9294300079, output_fired_time: 10.4190845490, propagate_forward_time: 194.2686920166, propagate_backward_time: 325.7652893066, weight_update_time: 1.0811179876, other_time: 9.8681335449
epoch time: 47.8540725708s, input_fired_time: 1.1764565706, output_fired_time: 0.0000000000, propagate_forward_time: 44.9180030823, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7596130371
validation[          , genome 18227] predictions:    9883/  10000 (98.83%), best:    9879/10000 (98.79%), error:       416.70657, best error:       403.55115 on epoch:    51, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 483.0108032227s, input_fired_time: 9.1975240707, output_fired_time: 8.9827661514, propagate_forward_time: 170.1366424561, propagate_backward_time: 285.1690673828, weight_update_time: 1.0156069994, other_time: 9.5248413086
epoch time: 29.3294010162s, input_fired_time: 0.8699704409, output_fired_time: 0.0000000000, propagate_forward_time: 26.8836688995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5757617950
validation[          , genome 18227] predictions:    9878/  10000 (98.78%), best:    9879/10000 (98.79%), error:       422.92548, best error:       403.55115 on epoch:    51, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 538.7708129883s, input_fired_time: 9.8020257950, output_fired_time: 10.1623744965, propagate_forward_time: 190.2182312012, propagate_backward_time: 318.9378662109, weight_update_time: 1.0621672869, other_time: 9.6503601074
epoch time: 46.7647171021s, input_fired_time: 1.1598439217, output_fired_time: 0.0000000000, propagate_forward_time: 43.8655548096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7393188477
validation[          , genome 18227] predictions:    9887/  10000 (98.87%), best:    9879/10000 (98.79%), error:       407.00330, best error:       403.55115 on epoch:    51, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 508.7464294434s, input_fired_time: 9.4703083038, output_fired_time: 9.5386266708, propagate_forward_time: 179.9509582520, propagate_backward_time: 300.2967224121, weight_update_time: 1.0398836136, other_time: 9.4898071289
epoch time: 46.2868041992s, input_fired_time: 1.1354099512, output_fired_time: 0.0000000000, propagate_forward_time: 43.4532775879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6981163025
validation[          , genome 18227] predictions:    9869/  10000 (98.69%), best:    9879/10000 (98.79%), error:       434.48331, best error:       403.55115 on epoch:    51, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 574.5975952148s, input_fired_time: 10.2061243057, output_fired_time: 10.9267568588, propagate_forward_time: 203.0759735107, propagate_backward_time: 340.6139526367, weight_update_time: 1.0953257084, other_time: 9.7747802734
epoch time: 33.0275840759s, input_fired_time: 0.9258563519, output_fired_time: 0.0000000000, propagate_forward_time: 30.4896736145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6120529175
validation[          , genome 18227] predictions:    9883/  10000 (98.83%), best:    9879/10000 (98.79%), error:       424.24438, best error:       403.55115 on epoch:    51, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 538.0387573242s, input_fired_time: 9.7854413986, output_fired_time: 10.1325359344, propagate_forward_time: 190.1440277100, propagate_backward_time: 318.3080139160, weight_update_time: 1.0627999306, other_time: 9.6687316895
epoch time: 47.9212188721s, input_fired_time: 1.1764012575, output_fired_time: 0.0000000000, propagate_forward_time: 45.0010032654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7438125610
validation[          , genome 18227] predictions:    9887/  10000 (98.87%), best:    9879/10000 (98.79%), error:       412.46790, best error:       403.55115 on epoch:    51, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 578.5880737305s, input_fired_time: 10.2223806381, output_fired_time: 10.9558305740, propagate_forward_time: 204.9909362793, propagate_backward_time: 342.6726379395, weight_update_time: 1.0997362137, other_time: 9.7463378906
epoch time: 46.9924201965s, input_fired_time: 1.1464499235, output_fired_time: 0.0000000000, propagate_forward_time: 44.1383132935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7076568604
validation[          , genome 18227] predictions:    9877/  10000 (98.77%), best:    9879/10000 (98.79%), error:       415.69507, best error:       403.55115 on epoch:    51, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 618.9367675781s, input_fired_time: 10.7469778061, output_fired_time: 11.8513450623, propagate_forward_time: 219.1418457031, propagate_backward_time: 367.0623779297, weight_update_time: 1.1391397715, other_time: 10.1342773438
epoch time: 47.4315528870s, input_fired_time: 1.1681417227, output_fired_time: 0.0000000000, propagate_forward_time: 44.5101394653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7532730103
validation[          , genome 18227] predictions:    9895/  10000 (98.95%), best:    9879/10000 (98.79%), error:       409.28281, best error:       403.55115 on epoch:    51, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 528.5197753906s, input_fired_time: 9.7198066711, output_fired_time: 9.9510459900, propagate_forward_time: 186.6453857422, propagate_backward_time: 312.4910583496, weight_update_time: 1.0578975677, other_time: 9.7124938965
epoch time: 28.2878627777s, input_fired_time: 0.8513892293, output_fired_time: 0.0000000000, propagate_forward_time: 25.8581027985, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5783710480
validation[          , genome 18227] predictions:    9894/  10000 (98.94%), best:    9894/10000 (98.94%), error:       390.00763, best error:       390.00763 on epoch:    80, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 595.2646484375s, input_fired_time: 10.4641914368, output_fired_time: 11.3477430344, propagate_forward_time: 210.7445373535, propagate_backward_time: 352.7380676270, weight_update_time: 1.1174079180, other_time: 9.9701538086
epoch time: 47.7640190125s, input_fired_time: 1.1782981157, output_fired_time: 0.0000000000, propagate_forward_time: 44.8039360046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7817840576
validation[          , genome 18227] predictions:    9882/  10000 (98.82%), best:    9894/10000 (98.94%), error:       417.98898, best error:       390.00763 on epoch:    80, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 581.1641845703s, input_fired_time: 10.3292970657, output_fired_time: 11.0370540619, propagate_forward_time: 205.7235717773, propagate_backward_time: 344.1306762695, weight_update_time: 1.1072636843, other_time: 9.9436035156
epoch time: 47.3722534180s, input_fired_time: 1.1664336920, output_fired_time: 0.0000000000, propagate_forward_time: 44.4389953613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7668228149
validation[          , genome 18227] predictions:    9860/  10000 (98.60%), best:    9894/10000 (98.94%), error:       463.68738, best error:       390.00763 on epoch:    80, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 477.0708312988s, input_fired_time: 9.1654767990, output_fired_time: 8.8872346878, propagate_forward_time: 167.7793884277, propagate_backward_time: 281.5459899902, weight_update_time: 1.0178756714, other_time: 9.6927490234
epoch time: 35.1732559204s, input_fired_time: 0.9704726338, output_fired_time: 0.0000000000, propagate_forward_time: 32.5174865723, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6852951050
validation[          , genome 18227] predictions:    9881/  10000 (98.81%), best:    9894/10000 (98.94%), error:       442.80826, best error:       390.00763 on epoch:    80, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 481.0213317871s, input_fired_time: 9.1496400833, output_fired_time: 8.9834117889, propagate_forward_time: 169.4411163330, propagate_backward_time: 283.9110717773, weight_update_time: 1.0196826458, other_time: 9.5361328125
epoch time: 47.7122116089s, input_fired_time: 1.1742649078, output_fired_time: 0.0000000000, propagate_forward_time: 44.7792854309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7586631775
validation[          , genome 18227] predictions:    9889/  10000 (98.89%), best:    9889/10000 (98.89%), error:       388.62009, best error:       388.62009 on epoch:    84, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 491.2134399414s, input_fired_time: 9.3314456940, output_fired_time: 9.2081365585, propagate_forward_time: 172.9495239258, propagate_backward_time: 290.0005493164, weight_update_time: 1.0307292938, other_time: 9.7237854004
epoch time: 47.0300712585s, input_fired_time: 1.1579757929, output_fired_time: 0.0000000000, propagate_forward_time: 44.1159133911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7561836243
validation[          , genome 18227] predictions:    9875/  10000 (98.75%), best:    9889/10000 (98.89%), error:       444.16440, best error:       388.62009 on epoch:    84, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 610.7285766602s, input_fired_time: 10.6876087189, output_fired_time: 11.7031688690, propagate_forward_time: 216.4350585938, propagate_backward_time: 361.7640380859, weight_update_time: 1.1354204416, other_time: 10.1386718750
epoch time: 47.7807540894s, input_fired_time: 1.1753585339, output_fired_time: 0.0000000000, propagate_forward_time: 44.8386917114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7667045593
validation[          , genome 18227] predictions:    9892/  10000 (98.92%), best:    9889/10000 (98.89%), error:       394.28986, best error:       388.62009 on epoch:    84, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 511.4999389648s, input_fired_time: 9.5169887543, output_fired_time: 9.5908355713, propagate_forward_time: 180.5289001465, propagate_backward_time: 302.3071594238, weight_update_time: 1.0433870554, other_time: 9.5560302734
epoch time: 47.7685241699s, input_fired_time: 1.1724905968, output_fired_time: 0.0000000000, propagate_forward_time: 44.8454132080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7506217957
validation[          , genome 18227] predictions:    9887/  10000 (98.87%), best:    9889/10000 (98.89%), error:       401.79648, best error:       388.62009 on epoch:    84, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 512.7910766602s, input_fired_time: 9.5281553268, output_fired_time: 9.6509113312, propagate_forward_time: 181.0100555420, propagate_backward_time: 303.0148925781, weight_update_time: 1.0458518267, other_time: 9.5870361328
epoch time: 41.7505149841s, input_fired_time: 1.0776145458, output_fired_time: 0.0000000000, propagate_forward_time: 38.9498634338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7230377197
validation[          , genome 18227] predictions:    9891/  10000 (98.91%), best:    9889/10000 (98.89%), error:       401.58044, best error:       388.62009 on epoch:    84, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 478.8305664062s, input_fired_time: 9.2047080994, output_fired_time: 8.9606714249, propagate_forward_time: 168.7702789307, propagate_backward_time: 282.2681884766, weight_update_time: 1.0191208124, other_time: 9.6267089844
epoch time: 35.5753631592s, input_fired_time: 0.9805362225, output_fired_time: 0.0000000000, propagate_forward_time: 32.8999710083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6948547363
validation[          , genome 18227] predictions:    9885/  10000 (98.85%), best:    9889/10000 (98.89%), error:       412.68555, best error:       388.62009 on epoch:    84, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 515.0120239258s, input_fired_time: 9.5660657883, output_fired_time: 9.6879167557, propagate_forward_time: 181.9456939697, propagate_backward_time: 304.1397094727, weight_update_time: 1.0489162207, other_time: 9.6726074219
epoch time: 47.4622154236s, input_fired_time: 1.1683363914, output_fired_time: 0.0000000000, propagate_forward_time: 44.5661087036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7277717590
validation[          , genome 18227] predictions:    9883/  10000 (98.83%), best:    9889/10000 (98.89%), error:       404.83823, best error:       388.62009 on epoch:    84, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 606.1605224609s, input_fired_time: 10.5877008438, output_fired_time: 11.5814352036, propagate_forward_time: 215.1302642822, propagate_backward_time: 358.9645996094, weight_update_time: 1.1216003895, other_time: 9.8965454102
epoch time: 40.2478904724s, input_fired_time: 1.0421707630, output_fired_time: 0.0000000000, propagate_forward_time: 37.5640029907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6417160034
validation[          , genome 18227] predictions:    9876/  10000 (98.76%), best:    9889/10000 (98.89%), error:       422.14853, best error:       388.62009 on epoch:    84, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 545.9956665039s, input_fired_time: 9.8771400452, output_fired_time: 10.2870111465, propagate_forward_time: 192.8876037598, propagate_backward_time: 323.3113708496, weight_update_time: 1.0733839273, other_time: 9.6325683594
epoch time: 31.4830017090s, input_fired_time: 0.9074583054, output_fired_time: 0.0000000000, propagate_forward_time: 28.9869785309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5885639191
validation[          , genome 18227] predictions:    9882/  10000 (98.82%), best:    9889/10000 (98.89%), error:       406.28415, best error:       388.62009 on epoch:    84, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 514.5661010742s, input_fired_time: 9.5569772720, output_fired_time: 9.6695575714, propagate_forward_time: 181.6685638428, propagate_backward_time: 304.1240234375, weight_update_time: 1.0441668034, other_time: 9.5469970703
epoch time: 28.2140483856s, input_fired_time: 0.8507769704, output_fired_time: 0.0000000000, propagate_forward_time: 25.8090419769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5542297363
validation[          , genome 18227] predictions:    9875/  10000 (98.75%), best:    9889/10000 (98.89%), error:       412.03360, best error:       388.62009 on epoch:    84, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 542.4910888672s, input_fired_time: 9.8738155365, output_fired_time: 10.2195138931, propagate_forward_time: 191.8095397949, propagate_backward_time: 320.8620910645, weight_update_time: 1.0688649416, other_time: 9.7260742188
epoch time: 42.3708915710s, input_fired_time: 1.0912599564, output_fired_time: 0.0000000000, propagate_forward_time: 39.5463676453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7332649231
validation[          , genome 18227] predictions:    9884/  10000 (98.84%), best:    9889/10000 (98.89%), error:       405.69772, best error:       388.62009 on epoch:    84, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 489.9237060547s, input_fired_time: 9.2941131592, output_fired_time: 9.1798124313, propagate_forward_time: 172.2614898682, propagate_backward_time: 289.5354309082, weight_update_time: 1.0261573792, other_time: 9.6528625488
epoch time: 42.2560195923s, input_fired_time: 1.0892418623, output_fired_time: 0.0000000000, propagate_forward_time: 39.4483947754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7183837891
validation[          , genome 18227] predictions:    9886/  10000 (98.86%), best:    9889/10000 (98.89%), error:       416.88205, best error:       388.62009 on epoch:    84, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 482.2571411133s, input_fired_time: 9.2171440125, output_fired_time: 9.0013093948, propagate_forward_time: 169.7746887207, propagate_backward_time: 284.6430358887, weight_update_time: 1.0218110085, other_time: 9.6209716797
epoch time: 30.5046405792s, input_fired_time: 0.8999059796, output_fired_time: 0.0000000000, propagate_forward_time: 27.9270095825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6777248383
validation[          , genome 18227] predictions:    9872/  10000 (98.72%), best:    9889/10000 (98.89%), error:       433.52271, best error:       388.62009 on epoch:    84, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 463.6319885254s, input_fired_time: 9.0195140839, output_fired_time: 8.6271696091, propagate_forward_time: 162.9290618896, propagate_backward_time: 273.4076232910, weight_update_time: 1.0085675716, other_time: 9.6486511230
epoch time: 45.3134346008s, input_fired_time: 1.1451417208, output_fired_time: 0.0000000000, propagate_forward_time: 42.3940734863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7742195129
validation[          , genome 18227] predictions:    9868/  10000 (98.68%), best:    9889/10000 (98.89%), error:       448.44394, best error:       388.62009 on epoch:    84, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 462.3914184570s, input_fired_time: 9.0199422836, output_fired_time: 8.6193885803, propagate_forward_time: 162.9600830078, propagate_backward_time: 272.2292785645, weight_update_time: 1.0061748028, other_time: 9.5627441406
epoch time: 36.8776741028s, input_fired_time: 1.0017706156, output_fired_time: 0.0000000000, propagate_forward_time: 34.1753387451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7005653381
validation[          , genome 18227] predictions:    9886/  10000 (98.86%), best:    9889/10000 (98.89%), error:       400.97656, best error:       388.62009 on epoch:    84, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 448.5184326172s, input_fired_time: 8.8876838684, output_fired_time: 8.3256626129, propagate_forward_time: 157.6550140381, propagate_backward_time: 264.0750427246, weight_update_time: 0.9932911396, other_time: 9.5750427246
epoch time: 31.7263050079s, input_fired_time: 0.9203498960, output_fired_time: 0.0000000000, propagate_forward_time: 29.1412715912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6646842957
validation[          , genome 18227] predictions:    9877/  10000 (98.77%), best:    9889/10000 (98.89%), error:       419.49136, best error:       388.62009 on epoch:    84, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 518.2498168945s, input_fired_time: 9.6506586075, output_fired_time: 9.7741985321, propagate_forward_time: 182.9683227539, propagate_backward_time: 306.1091003418, weight_update_time: 1.0542569160, other_time: 9.7475280762
epoch time: 47.6464347839s, input_fired_time: 1.1835567951, output_fired_time: 0.0000000000, propagate_forward_time: 44.6838798523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7789993286
validation[          , genome 18227] predictions:    9885/  10000 (98.85%), best:    9889/10000 (98.89%), error:       394.60190, best error:       388.62009 on epoch:    84, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 215.1430053711s, input_fired_time: 5.5295920372, output_fired_time: 0.0000000000, propagate_forward_time: 200.8736877441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.7397308350
best training[          , genome 18227] predictions:   49993/  50000 (99.99%), best:    9889/10000 (98.89%), error:       212.04117, best error:       388.62009 on epoch:    84, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 35.1373977661s, input_fired_time: 0.9511523247, output_fired_time: 0.0000000000, propagate_forward_time: 32.5178756714, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6683692932
   testing[          , genome 18227] predictions:    9880/  10000 (98.80%), best:    9889/10000 (98.89%), error:       379.00989, best error:       388.62009 on epoch:    84, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
02:50:58 (14836): called boinc_finish(0)

</stderr_txt>
]]>