Nameexact_genome_1518178202_47_18409_0
Workunit2992974
Created9 Feb 2018, 21:32:37 UTC
Sent9 Feb 2018, 22:04:33 UTC
Report deadline14 Apr 2018, 21:01:15 UTC
Received13 Feb 2018, 11:59:33 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID60433
Run time23 hours 4 min 20 sec
CPU time22 hours 22 min 6 sec
Validate stateInitial
Credit0.00
Device peak FLOPS4.62 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size151.34 MB
Peak swap size4,396.42 MB
Peak disk usage4.23 MB

Stderr output

<core_client_version>7.8.6</core_client_version>
<![CDATA[
<stderr_txt>
361, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0866203308
validation[          , genome 18409] predictions:    9833/  10000 (98.33%), best:    9866/10000 (98.66%), error:       571.86066, best error:       426.45892 on epoch:    10, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 847.8975830078s, input_fired_time: 7.0307016373, output_fired_time: 4.7865118980, propagate_forward_time: 250.4952697754, propagate_backward_time: 579.3107910156, weight_update_time: 0.6400588155, other_time: 6.2742919922
epoch time: 49.2743873596s, input_fired_time: 0.8851552010, output_fired_time: 0.0000000000, propagate_forward_time: 47.3259429932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0632896423
validation[          , genome 18409] predictions:    9787/  10000 (97.87%), best:    9866/10000 (98.66%), error:       670.25562, best error:       426.45892 on epoch:    10, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 856.4010009766s, input_fired_time: 8.0561466217, output_fired_time: 5.7829356194, propagate_forward_time: 248.0128326416, propagate_backward_time: 587.3045043945, weight_update_time: 0.6288577318, other_time: 7.2445678711
epoch time: 50.2654190063s, input_fired_time: 1.8869494200, output_fired_time: 0.0000000000, propagate_forward_time: 47.2925605774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0859107971
validation[          , genome 18409] predictions:    9816/  10000 (98.16%), best:    9866/10000 (98.66%), error:       579.23596, best error:       426.45892 on epoch:    10, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 850.5450439453s, input_fired_time: 8.0308284760, output_fired_time: 4.7730073929, propagate_forward_time: 242.6052856445, propagate_backward_time: 588.9155883789, weight_update_time: 0.6251745820, other_time: 6.2203369141
epoch time: 53.3947296143s, input_fired_time: 0.9002456665, output_fired_time: 0.0000000000, propagate_forward_time: 51.4004516602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0940322876
validation[          , genome 18409] predictions:    9834/  10000 (98.34%), best:    9866/10000 (98.66%), error:       482.80429, best error:       426.45892 on epoch:    10, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 850.6066284180s, input_fired_time: 8.0645866394, output_fired_time: 4.8370280266, propagate_forward_time: 249.8051605225, propagate_backward_time: 580.6658935547, weight_update_time: 1.6309808493, other_time: 7.2339477539
epoch time: 50.7407035828s, input_fired_time: 0.8803317547, output_fired_time: 0.0000000000, propagate_forward_time: 48.7786254883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0817451477
validation[          , genome 18409] predictions:    9836/  10000 (98.36%), best:    9866/10000 (98.66%), error:       515.43616, best error:       426.45892 on epoch:    10, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 858.2360839844s, input_fired_time: 8.0727472305, output_fired_time: 5.8279743195, propagate_forward_time: 254.8047332764, propagate_backward_time: 582.2777099609, weight_update_time: 0.6267395616, other_time: 7.2528686523
epoch time: 54.8050727844s, input_fired_time: 0.9019289017, output_fired_time: 0.0000000000, propagate_forward_time: 52.7942314148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1089134216
validation[          , genome 18409] predictions:    9822/  10000 (98.22%), best:    9866/10000 (98.66%), error:       525.12640, best error:       426.45892 on epoch:    10, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 856.3694458008s, input_fired_time: 7.0385155678, output_fired_time: 4.7966780663, propagate_forward_time: 253.2348480225, propagate_backward_time: 585.0560302734, weight_update_time: 0.6282033920, other_time: 6.2433471680
epoch time: 52.0166015625s, input_fired_time: 0.8920217752, output_fired_time: 0.0000000000, propagate_forward_time: 50.0295791626, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0950012207
validation[          , genome 18409] predictions:    9837/  10000 (98.37%), best:    9866/10000 (98.66%), error:       529.15717, best error:       426.45892 on epoch:    10, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 859.3070068359s, input_fired_time: 11.0878067017, output_fired_time: 5.8246030807, propagate_forward_time: 248.2371673584, propagate_backward_time: 585.8675537109, weight_update_time: 0.6299516559, other_time: 8.2898559570
epoch time: 52.9101104736s, input_fired_time: 0.8937844634, output_fired_time: 0.0000000000, propagate_forward_time: 50.9266548157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0896720886
validation[          , genome 18409] predictions:    9855/  10000 (98.55%), best:    9866/10000 (98.66%), error:       443.87741, best error:       426.45892 on epoch:    10, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 847.8778076172s, input_fired_time: 7.0530161858, output_fired_time: 5.7837824821, propagate_forward_time: 251.3892211914, propagate_backward_time: 577.4048461914, weight_update_time: 0.6272823811, other_time: 6.2469482422
epoch time: 52.6447906494s, input_fired_time: 0.9055480361, output_fired_time: 0.0000000000, propagate_forward_time: 50.6401939392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0990486145
validation[          , genome 18409] predictions:    9865/  10000 (98.65%), best:    9865/10000 (98.65%), error:       423.49954, best error:       423.49954 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 860.0589599609s, input_fired_time: 8.0608863831, output_fired_time: 5.8118648529, propagate_forward_time: 251.9405212402, propagate_backward_time: 585.9862670898, weight_update_time: 0.6286470890, other_time: 8.2593383789
epoch time: 52.8979644775s, input_fired_time: 0.8941037059, output_fired_time: 0.0000000000, propagate_forward_time: 50.9314422607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0724182129
validation[          , genome 18409] predictions:    9854/  10000 (98.54%), best:    9865/10000 (98.65%), error:       479.14734, best error:       423.49954 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 859.5418701172s, input_fired_time: 8.0729074478, output_fired_time: 4.8045787811, propagate_forward_time: 244.8543701172, propagate_backward_time: 595.5574340820, weight_update_time: 0.6308177114, other_time: 6.2525634766
epoch time: 51.1923599243s, input_fired_time: 0.8891394138, output_fired_time: 0.0000000000, propagate_forward_time: 49.2227287292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0804901123
validation[          , genome 18409] predictions:    9874/  10000 (98.74%), best:    9865/10000 (98.65%), error:       439.98962, best error:       423.49954 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 846.5344238281s, input_fired_time: 7.0687789917, output_fired_time: 4.8049669266, propagate_forward_time: 251.5810699463, propagate_backward_time: 576.8265380859, weight_update_time: 0.6280726194, other_time: 6.2530517578
epoch time: 51.6209259033s, input_fired_time: 0.8927256465, output_fired_time: 0.0000000000, propagate_forward_time: 49.6470298767, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0811691284
validation[          , genome 18409] predictions:    9872/  10000 (98.72%), best:    9872/10000 (98.72%), error:       415.63980, best error:       415.63980 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 863.6746826172s, input_fired_time: 9.0860433578, output_fired_time: 4.8014783859, propagate_forward_time: 257.2135925293, propagate_backward_time: 586.3303222656, weight_update_time: 0.6330432296, other_time: 6.2432861328
epoch time: 53.7373466492s, input_fired_time: 1.8974004984, output_fired_time: 0.0000000000, propagate_forward_time: 50.7627677917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0771789551
validation[          , genome 18409] predictions:    9836/  10000 (98.36%), best:    9872/10000 (98.72%), error:       508.23547, best error:       415.63980 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 855.6050415039s, input_fired_time: 7.0643548965, output_fired_time: 4.7956290245, propagate_forward_time: 242.9420928955, propagate_backward_time: 591.5542602539, weight_update_time: 2.6342587471, other_time: 9.2487182617
epoch time: 52.6876335144s, input_fired_time: 0.8970991969, output_fired_time: 0.0000000000, propagate_forward_time: 50.7172470093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0732879639
validation[          , genome 18409] predictions:    9853/  10000 (98.53%), best:    9872/10000 (98.72%), error:       424.47861, best error:       415.63980 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 855.7847900391s, input_fired_time: 9.1086063385, output_fired_time: 7.8302192688, propagate_forward_time: 249.5220642090, propagate_backward_time: 582.0674438477, weight_update_time: 0.6332126856, other_time: 7.2565307617
epoch time: 53.9841270447s, input_fired_time: 1.9133512974, output_fired_time: 0.0000000000, propagate_forward_time: 50.9880065918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0827674866
validation[          , genome 18409] predictions:    9871/  10000 (98.71%), best:    9872/10000 (98.72%), error:       430.45187, best error:       415.63980 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 857.8302001953s, input_fired_time: 8.0900335312, output_fired_time: 8.8071298599, propagate_forward_time: 243.6038970947, propagate_backward_time: 591.0785522461, weight_update_time: 0.6282306314, other_time: 6.2506103516
epoch time: 52.5938529968s, input_fired_time: 0.8974177837, output_fired_time: 0.0000000000, propagate_forward_time: 50.6141662598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0822677612
validation[          , genome 18409] predictions:    9866/  10000 (98.66%), best:    9866/10000 (98.66%), error:       401.08859, best error:       401.08859 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 853.2729492188s, input_fired_time: 9.1027345657, output_fired_time: 8.8320207596, propagate_forward_time: 252.0267181396, propagate_backward_time: 577.0376586914, weight_update_time: 0.6319535375, other_time: 6.2738037109
epoch time: 55.6952552795s, input_fired_time: 0.9128968716, output_fired_time: 0.0000000000, propagate_forward_time: 53.6762008667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1061592102
validation[          , genome 18409] predictions:    9871/  10000 (98.71%), best:    9866/10000 (98.66%), error:       407.07129, best error:       401.08859 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 858.4078369141s, input_fired_time: 8.1073255539, output_fired_time: 5.7915992737, propagate_forward_time: 250.4906921387, propagate_backward_time: 587.7520141602, weight_update_time: 0.6281080842, other_time: 6.2661743164
epoch time: 52.4577369690s, input_fired_time: 0.8956854343, output_fired_time: 0.0000000000, propagate_forward_time: 50.4787750244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0832748413
validation[          , genome 18409] predictions:    9879/  10000 (98.79%), best:    9866/10000 (98.66%), error:       408.22479, best error:       401.08859 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 852.7734375000s, input_fired_time: 9.0867738724, output_fired_time: 4.8035936356, propagate_forward_time: 248.4770202637, propagate_backward_time: 584.1744384766, weight_update_time: 0.6308173537, other_time: 6.2315673828
epoch time: 53.6138572693s, input_fired_time: 0.9144352674, output_fired_time: 0.0000000000, propagate_forward_time: 50.5762290955, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1231918335
validation[          , genome 18409] predictions:    9859/  10000 (98.59%), best:    9866/10000 (98.66%), error:       433.65137, best error:       401.08859 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 853.7578735352s, input_fired_time: 7.0774931908, output_fired_time: 5.8079762459, propagate_forward_time: 250.2453155518, propagate_backward_time: 584.3707275391, weight_update_time: 0.6342316866, other_time: 6.2563476562
epoch time: 51.6836967468s, input_fired_time: 0.8963326216, output_fired_time: 0.0000000000, propagate_forward_time: 47.6766853333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1106796265
validation[          , genome 18409] predictions:    9866/  10000 (98.66%), best:    9866/10000 (98.66%), error:       458.32770, best error:       401.08859 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 849.8229370117s, input_fired_time: 9.0976400375, output_fired_time: 4.7966551781, propagate_forward_time: 254.2756347656, propagate_backward_time: 574.3617553711, weight_update_time: 0.6379408836, other_time: 7.2912597656
epoch time: 51.5307197571s, input_fired_time: 0.8986352682, output_fired_time: 0.0000000000, propagate_forward_time: 49.5518722534, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0802116394
validation[          , genome 18409] predictions:    9849/  10000 (98.49%), best:    9866/10000 (98.66%), error:       482.89047, best error:       401.08859 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 858.7614746094s, input_fired_time: 7.1096329689, output_fired_time: 5.8040690422, propagate_forward_time: 259.5106506348, propagate_backward_time: 580.0386352539, weight_update_time: 0.6347402334, other_time: 6.2985229492
epoch time: 49.6873588562s, input_fired_time: 1.8951015472, output_fired_time: 0.0000000000, propagate_forward_time: 46.7081756592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0840835571
validation[          , genome 18409] predictions:    9889/  10000 (98.89%), best:    9889/10000 (98.89%), error:       360.26978, best error:       360.26978 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 869.6013183594s, input_fired_time: 8.1078233719, output_fired_time: 4.8703427315, propagate_forward_time: 253.0641174316, propagate_backward_time: 596.2398681641, weight_update_time: 0.6366618276, other_time: 7.3190917969
epoch time: 51.3292350769s, input_fired_time: 0.8980029225, output_fired_time: 0.0000000000, propagate_forward_time: 47.3390541077, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0921783447
validation[          , genome 18409] predictions:    9845/  10000 (98.45%), best:    9889/10000 (98.89%), error:       489.92184, best error:       360.26978 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 856.5158081055s, input_fired_time: 9.1081628799, output_fired_time: 4.8286886215, propagate_forward_time: 252.1916351318, propagate_backward_time: 583.1109008789, weight_update_time: 0.6329910755, other_time: 7.2764282227
epoch time: 53.4462165833s, input_fired_time: 0.9015544057, output_fired_time: 0.0000000000, propagate_forward_time: 51.4695358276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0751266479
validation[          , genome 18409] predictions:    9866/  10000 (98.66%), best:    9889/10000 (98.89%), error:       438.67758, best error:       360.26978 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 857.4634399414s, input_fired_time: 7.1168370247, output_fired_time: 4.8104724884, propagate_forward_time: 244.5794525146, propagate_backward_time: 594.6839599609, weight_update_time: 0.6363866329, other_time: 6.2727050781
epoch time: 53.8093566895s, input_fired_time: 0.9022327065, output_fired_time: 0.0000000000, propagate_forward_time: 51.8222885132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0848350525
validation[          , genome 18409] predictions:    9890/  10000 (98.90%), best:    9889/10000 (98.89%), error:       381.84991, best error:       360.26978 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 853.7484741211s, input_fired_time: 9.1239309311, output_fired_time: 6.7955241203, propagate_forward_time: 244.0794067383, propagate_backward_time: 584.4758911133, weight_update_time: 1.6408421993, other_time: 9.2737426758
epoch time: 51.3974533081s, input_fired_time: 0.9090559483, output_fired_time: 0.0000000000, propagate_forward_time: 48.3928108215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0955848694
validation[          , genome 18409] predictions:    9886/  10000 (98.86%), best:    9886/10000 (98.86%), error:       336.31009, best error:       336.31009 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 866.4650268555s, input_fired_time: 9.1322059631, output_fired_time: 4.7892217636, propagate_forward_time: 247.6844482422, propagate_backward_time: 598.5797729492, weight_update_time: 0.6294456124, other_time: 6.2793579102
epoch time: 53.8210754395s, input_fired_time: 0.9126698971, output_fired_time: 0.0000000000, propagate_forward_time: 51.8050651550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1033401489
validation[          , genome 18409] predictions:    9883/  10000 (98.83%), best:    9886/10000 (98.86%), error:       376.42535, best error:       336.31009 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 865.2827758789s, input_fired_time: 9.1120977402, output_fired_time: 4.8086290359, propagate_forward_time: 252.5394439697, propagate_backward_time: 592.5296630859, weight_update_time: 0.6380465627, other_time: 6.2929077148
epoch time: 51.1271743774s, input_fired_time: 1.9093235731, output_fired_time: 0.0000000000, propagate_forward_time: 48.1423950195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0754547119
validation[          , genome 18409] predictions:    9858/  10000 (98.58%), best:    9886/10000 (98.86%), error:       432.12753, best error:       336.31009 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 852.7584838867s, input_fired_time: 7.1107454300, output_fired_time: 4.7915124893, propagate_forward_time: 246.9117889404, propagate_backward_time: 587.7055664062, weight_update_time: 0.6315025091, other_time: 6.2388916016
epoch time: 51.8518142700s, input_fired_time: 0.9058329463, output_fired_time: 0.0000000000, propagate_forward_time: 49.8659973145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0799827576
validation[          , genome 18409] predictions:    9894/  10000 (98.94%), best:    9886/10000 (98.86%), error:       337.76694, best error:       336.31009 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 851.2971801758s, input_fired_time: 11.1526422501, output_fired_time: 4.8076553345, propagate_forward_time: 249.7884063721, propagate_backward_time: 578.2708129883, weight_update_time: 0.6343791485, other_time: 7.2776489258
epoch time: 50.4811668396s, input_fired_time: 0.9114495516, output_fired_time: 0.0000000000, propagate_forward_time: 48.4873962402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0823211670
validation[          , genome 18409] predictions:    9896/  10000 (98.96%), best:    9886/10000 (98.86%), error:       348.71231, best error:       336.31009 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 850.7282104492s, input_fired_time: 9.1145582199, output_fired_time: 4.7739834785, propagate_forward_time: 248.1891174316, propagate_backward_time: 580.4199218750, weight_update_time: 0.6250932217, other_time: 8.2305908203
epoch time: 50.7589492798s, input_fired_time: 0.9117249846, output_fired_time: 0.0000000000, propagate_forward_time: 47.7544364929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0927886963
validation[          , genome 18409] predictions:    9883/  10000 (98.83%), best:    9886/10000 (98.86%), error:       363.30453, best error:       336.31009 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 858.9271240234s, input_fired_time: 9.1272172928, output_fired_time: 4.7866244316, propagate_forward_time: 250.1080780029, propagate_backward_time: 587.6647338867, weight_update_time: 0.6260779500, other_time: 7.2404785156
epoch time: 50.2156791687s, input_fired_time: 0.9031847119, output_fired_time: 0.0000000000, propagate_forward_time: 48.2347602844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0777359009
validation[          , genome 18409] predictions:    9865/  10000 (98.65%), best:    9886/10000 (98.86%), error:       421.16956, best error:       336.31009 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 866.8433227539s, input_fired_time: 8.1364421844, output_fired_time: 5.7984476089, propagate_forward_time: 258.5325927734, propagate_backward_time: 588.0951538086, weight_update_time: 0.6318632960, other_time: 6.2807006836
epoch time: 53.6329460144s, input_fired_time: 0.9102633595, output_fired_time: 0.0000000000, propagate_forward_time: 51.6188316345, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1038513184
validation[          , genome 18409] predictions:    9897/  10000 (98.97%), best:    9897/10000 (98.97%), error:       326.82581, best error:       326.82581 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 854.5452270508s, input_fired_time: 9.1377782822, output_fired_time: 5.7914910316, propagate_forward_time: 249.0885925293, propagate_backward_time: 584.2635498047, weight_update_time: 0.6343096495, other_time: 6.2637939453
epoch time: 52.5816307068s, input_fired_time: 0.9059889317, output_fired_time: 0.0000000000, propagate_forward_time: 50.5903244019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0853157043
validation[          , genome 18409] predictions:    9899/  10000 (98.99%), best:    9897/10000 (98.97%), error:       333.08780, best error:       326.82581 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 854.5599975586s, input_fired_time: 7.1265196800, output_fired_time: 4.7931666374, propagate_forward_time: 245.6707000732, propagate_backward_time: 587.6783447266, weight_update_time: 2.6427092552, other_time: 9.2912597656
epoch time: 51.9589729309s, input_fired_time: 0.9078262448, output_fired_time: 0.0000000000, propagate_forward_time: 49.9629631042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0881843567
validation[          , genome 18409] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       305.55322, best error:       305.55322 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 858.3906860352s, input_fired_time: 10.1471691132, output_fired_time: 4.8041925430, propagate_forward_time: 247.3962707520, propagate_backward_time: 587.8013916016, weight_update_time: 0.6296046972, other_time: 8.2416992188
epoch time: 51.8516578674s, input_fired_time: 0.9106928110, output_fired_time: 0.0000000000, propagate_forward_time: 49.8596687317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0812950134
validation[          , genome 18409] predictions:    9875/  10000 (98.75%), best:    9906/10000 (99.06%), error:       435.38022, best error:       305.55322 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 861.6535644531s, input_fired_time: 7.1448307037, output_fired_time: 4.8100104332, propagate_forward_time: 255.4329681396, propagate_backward_time: 588.0274047852, weight_update_time: 0.6280448437, other_time: 6.2383422852
epoch time: 54.8050689697s, input_fired_time: 0.9082439542, output_fired_time: 0.0000000000, propagate_forward_time: 51.8075370789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0892868042
validation[          , genome 18409] predictions:    9918/  10000 (99.18%), best:    9918/10000 (99.18%), error:       290.50864, best error:       290.50864 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 863.6168823242s, input_fired_time: 10.1838541031, output_fired_time: 4.7983436584, propagate_forward_time: 252.9837646484, propagate_backward_time: 588.3023681641, weight_update_time: 0.6418024898, other_time: 7.3485717773
epoch time: 52.3973159790s, input_fired_time: 0.9029272795, output_fired_time: 0.0000000000, propagate_forward_time: 50.4063491821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0880393982
validation[          , genome 18409] predictions:    9901/  10000 (99.01%), best:    9918/10000 (99.18%), error:       328.80637, best error:       290.50864 on epoch:    50, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 845.8532104492s, input_fired_time: 8.1352558136, output_fired_time: 5.7765188217, propagate_forward_time: 243.6795043945, propagate_backward_time: 580.0062255859, weight_update_time: 0.6301670074, other_time: 8.2557373047
epoch time: 50.1107978821s, input_fired_time: 0.8989986777, output_fired_time: 0.0000000000, propagate_forward_time: 48.1372413635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0745582581
validation[          , genome 18409] predictions:    9908/  10000 (99.08%), best:    9908/10000 (99.08%), error:       287.75986, best error:       287.75986 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 860.2558593750s, input_fired_time: 7.1605381966, output_fired_time: 6.8161950111, propagate_forward_time: 244.6634368896, propagate_backward_time: 593.3306274414, weight_update_time: 0.6374447346, other_time: 8.2850341797
epoch time: 52.6257896423s, input_fired_time: 0.9107762575, output_fired_time: 0.0000000000, propagate_forward_time: 50.6454200745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0695915222
validation[          , genome 18409] predictions:    9891/  10000 (98.91%), best:    9908/10000 (99.08%), error:       330.86658, best error:       287.75986 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 860.7844238281s, input_fired_time: 7.1516222954, output_fired_time: 4.7976770401, propagate_forward_time: 248.0023651123, propagate_backward_time: 594.5718383789, weight_update_time: 0.6283525825, other_time: 6.2609252930
epoch time: 51.3649711609s, input_fired_time: 0.9088256955, output_fired_time: 0.0000000000, propagate_forward_time: 49.3870277405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0691184998
validation[          , genome 18409] predictions:    9891/  10000 (98.91%), best:    9908/10000 (99.08%), error:       335.38550, best error:       287.75986 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 863.1181640625s, input_fired_time: 8.1482019424, output_fired_time: 5.7903385162, propagate_forward_time: 252.0300140381, propagate_backward_time: 590.8350830078, weight_update_time: 0.6426622272, other_time: 6.3145141602
epoch time: 51.2655143738s, input_fired_time: 0.9231672883, output_fired_time: 0.0000000000, propagate_forward_time: 49.2565231323, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0858230591
validation[          , genome 18409] predictions:    9900/  10000 (99.00%), best:    9908/10000 (99.08%), error:       311.00143, best error:       287.75986 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 839.2157592773s, input_fired_time: 8.1394624710, output_fired_time: 4.7969465256, propagate_forward_time: 244.2272338867, propagate_backward_time: 574.8122558594, weight_update_time: 0.6251959205, other_time: 7.2398681641
epoch time: 50.7697448730s, input_fired_time: 0.9041776657, output_fired_time: 0.0000000000, propagate_forward_time: 48.7897109985, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0758552551
validation[          , genome 18409] predictions:    9905/  10000 (99.05%), best:    9908/10000 (99.08%), error:       318.34164, best error:       287.75986 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 870.9482421875s, input_fired_time: 9.1983833313, output_fired_time: 4.8248023987, propagate_forward_time: 255.6378326416, propagate_backward_time: 593.9919433594, weight_update_time: 0.6337672472, other_time: 7.2952880859
epoch time: 50.6938819885s, input_fired_time: 0.9083368182, output_fired_time: 0.0000000000, propagate_forward_time: 48.7014045715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0841407776
validation[          , genome 18409] predictions:    9903/  10000 (99.03%), best:    9908/10000 (99.08%), error:       298.34653, best error:       287.75986 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 843.1846313477s, input_fired_time: 10.1233949661, output_fired_time: 4.7538795471, propagate_forward_time: 237.2654724121, propagate_backward_time: 581.7867431641, weight_update_time: 0.6266470551, other_time: 9.2551269531
epoch time: 52.4018058777s, input_fired_time: 0.9098332524, output_fired_time: 0.0000000000, propagate_forward_time: 50.4056091309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0863647461
validation[          , genome 18409] predictions:    9916/  10000 (99.16%), best:    9908/10000 (99.08%), error:       305.10086, best error:       287.75986 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 862.5263671875s, input_fired_time: 12.1794252396, output_fired_time: 4.8279047012, propagate_forward_time: 255.6373596191, propagate_backward_time: 580.6099853516, weight_update_time: 0.6325870156, other_time: 9.2717285156
epoch time: 55.3385238647s, input_fired_time: 1.9357172251, output_fired_time: 0.0000000000, propagate_forward_time: 52.2948951721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1079101562
validation[          , genome 18409] predictions:    9917/  10000 (99.17%), best:    9917/10000 (99.17%), error:       284.34650, best error:       284.34650 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 859.1925048828s, input_fired_time: 8.1520709991, output_fired_time: 5.8293676376, propagate_forward_time: 252.2063751221, propagate_backward_time: 585.7120361328, weight_update_time: 0.6375139952, other_time: 7.2926635742
epoch time: 52.8817138672s, input_fired_time: 0.9105372429, output_fired_time: 0.0000000000, propagate_forward_time: 49.8883819580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0827941895
validation[          , genome 18409] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       292.68042, best error:       284.34650 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 858.0637207031s, input_fired_time: 8.1844158173, output_fired_time: 6.8359985352, propagate_forward_time: 243.1717224121, propagate_backward_time: 593.5776367188, weight_update_time: 0.6391147375, other_time: 6.2939453125
epoch time: 53.4683456421s, input_fired_time: 0.9202880263, output_fired_time: 0.0000000000, propagate_forward_time: 51.4505805969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0974769592
validation[          , genome 18409] predictions:    9903/  10000 (99.03%), best:    9917/10000 (99.17%), error:       316.32599, best error:       284.34650 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 859.0364990234s, input_fired_time: 8.1547374725, output_fired_time: 6.8178825378, propagate_forward_time: 241.8118133545, propagate_backward_time: 594.9849243164, weight_update_time: 0.6284496784, other_time: 7.2671508789
epoch time: 52.8226165771s, input_fired_time: 0.9090119600, output_fired_time: 0.0000000000, propagate_forward_time: 50.8290214539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0845832825
validation[          , genome 18409] predictions:    9869/  10000 (98.69%), best:    9917/10000 (99.17%), error:       423.29041, best error:       284.34650 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 853.5434570312s, input_fired_time: 7.1367740631, output_fired_time: 5.7777800560, propagate_forward_time: 248.4653778076, propagate_backward_time: 584.9083862305, weight_update_time: 0.6384574771, other_time: 7.2551269531
epoch time: 52.4044570923s, input_fired_time: 0.9064233899, output_fired_time: 0.0000000000, propagate_forward_time: 50.4282302856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0698051453
validation[          , genome 18409] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       290.10034, best error:       284.34650 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 862.8735351562s, input_fired_time: 7.1530890465, output_fired_time: 5.8100166321, propagate_forward_time: 255.3262939453, propagate_backward_time: 587.3464965820, weight_update_time: 0.6287567019, other_time: 7.2376708984
epoch time: 51.1224441528s, input_fired_time: 1.9291112423, output_fired_time: 0.0000000000, propagate_forward_time: 48.1225891113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0707435608
validation[          , genome 18409] predictions:    9906/  10000 (99.06%), best:    9917/10000 (99.17%), error:       296.47675, best error:       284.34650 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 847.7915649414s, input_fired_time: 8.1484766006, output_fired_time: 6.8103237152, propagate_forward_time: 253.1403961182, propagate_backward_time: 573.4999389648, weight_update_time: 0.6282547712, other_time: 6.1924438477
epoch time: 52.0396080017s, input_fired_time: 0.9040147066, output_fired_time: 0.0000000000, propagate_forward_time: 50.0544052124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0811882019
validation[          , genome 18409] predictions:    9899/  10000 (98.99%), best:    9917/10000 (99.17%), error:       322.58655, best error:       284.34650 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 853.8342285156s, input_fired_time: 9.1591024399, output_fired_time: 4.7914075851, propagate_forward_time: 241.0422363281, propagate_backward_time: 592.6000976562, weight_update_time: 0.6348547935, other_time: 6.2413940430
epoch time: 52.2158203125s, input_fired_time: 0.9146067500, output_fired_time: 0.0000000000, propagate_forward_time: 50.2112655640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0899467468
validation[          , genome 18409] predictions:    9911/  10000 (99.11%), best:    9917/10000 (99.17%), error:       296.62692, best error:       284.34650 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 865.9792480469s, input_fired_time: 8.1810245514, output_fired_time: 4.8146257401, propagate_forward_time: 265.6077880859, propagate_backward_time: 581.1310424805, weight_update_time: 0.6323524117, other_time: 6.2447509766
epoch time: 52.0028800964s, input_fired_time: 0.9181681871, output_fired_time: 0.0000000000, propagate_forward_time: 49.9917144775, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0929985046
validation[          , genome 18409] predictions:    9874/  10000 (98.74%), best:    9917/10000 (99.17%), error:       361.28256, best error:       284.34650 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 854.2053833008s, input_fired_time: 9.1892328262, output_fired_time: 4.8110637665, propagate_forward_time: 254.1521453857, propagate_backward_time: 578.8205566406, weight_update_time: 0.6321334839, other_time: 7.2324218750
epoch time: 51.7907600403s, input_fired_time: 0.9142854810, output_fired_time: 0.0000000000, propagate_forward_time: 49.7952957153, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0811805725
validation[          , genome 18409] predictions:    9898/  10000 (98.98%), best:    9917/10000 (99.17%), error:       308.65326, best error:       284.34650 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 862.7446899414s, input_fired_time: 9.1686773300, output_fired_time: 7.7970080376, propagate_forward_time: 254.1513977051, propagate_backward_time: 585.4185791016, weight_update_time: 0.6235954165, other_time: 6.2089843750
epoch time: 53.3065719604s, input_fired_time: 0.9196714163, output_fired_time: 0.0000000000, propagate_forward_time: 51.2968750000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0900268555
validation[          , genome 18409] predictions:    9920/  10000 (99.20%), best:    9920/10000 (99.20%), error:       279.74011, best error:       279.74011 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 857.4382934570s, input_fired_time: 10.1612167358, output_fired_time: 5.7886085510, propagate_forward_time: 238.2856292725, propagate_backward_time: 595.9321899414, weight_update_time: 1.6411265135, other_time: 7.2706298828
epoch time: 52.9052047729s, input_fired_time: 0.9109970927, output_fired_time: 0.0000000000, propagate_forward_time: 50.9113616943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0828475952
validation[          , genome 18409] predictions:    9902/  10000 (99.02%), best:    9920/10000 (99.20%), error:       299.28735, best error:       279.74011 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 856.1370849609s, input_fired_time: 8.1638479233, output_fired_time: 5.7690811157, propagate_forward_time: 245.0347900391, propagate_backward_time: 590.9448242188, weight_update_time: 0.6234710217, other_time: 6.2245483398
epoch time: 55.0059204102s, input_fired_time: 0.9167139530, output_fired_time: 0.0000000000, propagate_forward_time: 53.0106086731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0785980225
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9920/10000 (99.20%), error:       283.57169, best error:       279.74011 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 860.8741455078s, input_fired_time: 12.1923933029, output_fired_time: 5.7794342041, propagate_forward_time: 245.8168640137, propagate_backward_time: 590.8846435547, weight_update_time: 0.6229722500, other_time: 6.2008056641
epoch time: 50.7655105591s, input_fired_time: 0.9161787033, output_fired_time: 0.0000000000, propagate_forward_time: 48.7579460144, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0913848877
validation[          , genome 18409] predictions:    9905/  10000 (99.05%), best:    9920/10000 (99.20%), error:       309.33746, best error:       279.74011 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 862.1724853516s, input_fired_time: 10.1704597473, output_fired_time: 7.8100223541, propagate_forward_time: 243.1550903320, propagate_backward_time: 593.7836914062, weight_update_time: 0.6257174015, other_time: 7.2532348633
epoch time: 52.1237373352s, input_fired_time: 0.9196575284, output_fired_time: 0.0000000000, propagate_forward_time: 50.1145477295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0895309448
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9920/10000 (99.20%), error:       285.21570, best error:       279.74011 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 860.0899047852s, input_fired_time: 11.1751499176, output_fired_time: 4.7851619720, propagate_forward_time: 263.9215393066, propagate_backward_time: 573.9671630859, weight_update_time: 0.6321988702, other_time: 6.2408447266
epoch time: 54.0216369629s, input_fired_time: 0.9141923189, output_fired_time: 0.0000000000, propagate_forward_time: 52.0179557800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0894889832
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9920/10000 (99.20%), error:       284.01736, best error:       279.74011 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 853.6287231445s, input_fired_time: 7.1643304825, output_fired_time: 5.7969264984, propagate_forward_time: 239.9793701172, propagate_backward_time: 590.4388427734, weight_update_time: 0.6261261702, other_time: 10.2492675781
epoch time: 49.8146705627s, input_fired_time: 1.9015541077, output_fired_time: 0.0000000000, propagate_forward_time: 46.8304138184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0827026367
validation[          , genome 18409] predictions:    9911/  10000 (99.11%), best:    9920/10000 (99.20%), error:       304.88507, best error:       279.74011 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 843.8274536133s, input_fired_time: 8.1489133835, output_fired_time: 4.7697720528, propagate_forward_time: 242.2663269043, propagate_backward_time: 582.4263916016, weight_update_time: 0.6267327666, other_time: 6.2160644531
epoch time: 54.4879264832s, input_fired_time: 0.9229020476, output_fired_time: 0.0000000000, propagate_forward_time: 52.4695892334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0954360962
validation[          , genome 18409] predictions:    9920/  10000 (99.20%), best:    9920/10000 (99.20%), error:       283.76608, best error:       279.74011 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 857.5382080078s, input_fired_time: 7.1721529961, output_fired_time: 5.7833194733, propagate_forward_time: 248.0127258301, propagate_backward_time: 590.3607788086, weight_update_time: 0.6256223321, other_time: 6.2091674805
epoch time: 55.6146507263s, input_fired_time: 0.9211013913, output_fired_time: 0.0000000000, propagate_forward_time: 53.6042022705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0893478394
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9915/10000 (99.15%), error:       275.92480, best error:       275.92480 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 850.7526245117s, input_fired_time: 8.1446275711, output_fired_time: 5.7559771538, propagate_forward_time: 242.8350067139, propagate_backward_time: 585.8356323242, weight_update_time: 0.6223735809, other_time: 8.1813354492
epoch time: 51.4979095459s, input_fired_time: 0.9163463116, output_fired_time: 0.0000000000, propagate_forward_time: 49.5038185120, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0777435303
validation[          , genome 18409] predictions:    9922/  10000 (99.22%), best:    9922/10000 (99.22%), error:       272.60867, best error:       272.60867 on epoch:    78, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 858.2013549805s, input_fired_time: 9.1568326950, output_fired_time: 5.7978487015, propagate_forward_time: 252.3740997314, propagate_backward_time: 583.6464843750, weight_update_time: 0.6295204163, other_time: 7.2260742188
epoch time: 51.2813568115s, input_fired_time: 0.9136359096, output_fired_time: 0.0000000000, propagate_forward_time: 47.2934837341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0742378235
validation[          , genome 18409] predictions:    9906/  10000 (99.06%), best:    9922/10000 (99.22%), error:       305.91980, best error:       272.60867 on epoch:    78, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 849.3217773438s, input_fired_time: 10.1679630280, output_fired_time: 4.7660145760, propagate_forward_time: 245.2241058350, propagate_backward_time: 579.9641723633, weight_update_time: 0.6264599562, other_time: 9.1995239258
epoch time: 51.8492622375s, input_fired_time: 0.9149639606, output_fired_time: 0.0000000000, propagate_forward_time: 49.8576431274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0766563416
validation[          , genome 18409] predictions:    9917/  10000 (99.17%), best:    9922/10000 (99.22%), error:       277.83182, best error:       272.60867 on epoch:    78, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 848.6638183594s, input_fired_time: 8.1667938232, output_fired_time: 4.7791404724, propagate_forward_time: 244.4725799561, propagate_backward_time: 584.0257568359, weight_update_time: 0.6247783899, other_time: 7.2195434570
epoch time: 54.7428131104s, input_fired_time: 0.9274206758, output_fired_time: 0.0000000000, propagate_forward_time: 52.7113685608, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1040229797
validation[          , genome 18409] predictions:    9921/  10000 (99.21%), best:    9922/10000 (99.22%), error:       276.58151, best error:       272.60867 on epoch:    78, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 852.3406372070s, input_fired_time: 7.1575636864, output_fired_time: 4.7692580223, propagate_forward_time: 250.4952392578, propagate_backward_time: 583.6853027344, weight_update_time: 0.6300958395, other_time: 6.2332153320
epoch time: 51.8411102295s, input_fired_time: 0.9096683860, output_fired_time: 0.0000000000, propagate_forward_time: 49.8596153259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0718269348
validation[          , genome 18409] predictions:    9919/  10000 (99.19%), best:    9922/10000 (99.22%), error:       292.08417, best error:       272.60867 on epoch:    78, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 864.1303100586s, input_fired_time: 7.1826529503, output_fired_time: 4.7852234840, propagate_forward_time: 250.2122955322, propagate_backward_time: 595.6921386719, weight_update_time: 0.6357197165, other_time: 6.2579956055
epoch time: 50.4078102112s, input_fired_time: 0.9142947793, output_fired_time: 0.0000000000, propagate_forward_time: 48.4237480164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0697669983
validation[          , genome 18409] predictions:    9917/  10000 (99.17%), best:    9922/10000 (99.22%), error:       279.90921, best error:       272.60867 on epoch:    78, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 857.1077880859s, input_fired_time: 7.1575737000, output_fired_time: 4.7710313797, propagate_forward_time: 252.8304138184, propagate_backward_time: 586.1065673828, weight_update_time: 0.6326265335, other_time: 6.2421875000
epoch time: 50.7812652588s, input_fired_time: 0.9150362015, output_fired_time: 0.0000000000, propagate_forward_time: 48.7849884033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0812416077
validation[          , genome 18409] predictions:    9920/  10000 (99.20%), best:    9922/10000 (99.22%), error:       274.79993, best error:       272.60867 on epoch:    78, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 860.3549804688s, input_fired_time: 7.1838498116, output_fired_time: 4.7691969872, propagate_forward_time: 255.6589050293, propagate_backward_time: 583.4942626953, weight_update_time: 1.6257171631, other_time: 9.2487792969
epoch time: 50.8697052002s, input_fired_time: 0.9180058241, output_fired_time: 0.0000000000, propagate_forward_time: 48.8661231995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0855751038
validation[          , genome 18409] predictions:    9916/  10000 (99.16%), best:    9922/10000 (99.22%), error:       278.92294, best error:       272.60867 on epoch:    78, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 854.9609985352s, input_fired_time: 8.1780920029, output_fired_time: 4.7695140839, propagate_forward_time: 258.8527832031, propagate_backward_time: 576.9531250000, weight_update_time: 0.6239924431, other_time: 6.2074584961
epoch time: 53.2414207458s, input_fired_time: 0.9200814366, output_fired_time: 0.0000000000, propagate_forward_time: 51.2260437012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0952949524
validation[          , genome 18409] predictions:    9914/  10000 (99.14%), best:    9922/10000 (99.22%), error:       275.61496, best error:       272.60867 on epoch:    78, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 866.0302124023s, input_fired_time: 8.1892671585, output_fired_time: 4.8025112152, propagate_forward_time: 248.7654571533, propagate_backward_time: 596.0026855469, weight_update_time: 0.6366181374, other_time: 8.2703247070
epoch time: 56.4873504639s, input_fired_time: 0.9271755219, output_fired_time: 0.0000000000, propagate_forward_time: 54.4661369324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0940361023
validation[          , genome 18409] predictions:    9907/  10000 (99.07%), best:    9922/10000 (99.22%), error:       282.47031, best error:       272.60867 on epoch:    78, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 852.5867309570s, input_fired_time: 9.1765518188, output_fired_time: 4.8183879852, propagate_forward_time: 247.5758361816, propagate_backward_time: 584.7661743164, weight_update_time: 0.6320325732, other_time: 6.2498168945
epoch time: 55.5610694885s, input_fired_time: 0.9232238531, output_fired_time: 0.0000000000, propagate_forward_time: 53.5385360718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0993080139
validation[          , genome 18409] predictions:    9921/  10000 (99.21%), best:    9922/10000 (99.22%), error:       280.75208, best error:       272.60867 on epoch:    78, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 864.7888793945s, input_fired_time: 7.1883583069, output_fired_time: 6.8381056786, propagate_forward_time: 256.3894653320, propagate_backward_time: 586.1121215820, weight_update_time: 0.6343489289, other_time: 8.2608032227
epoch time: 52.9545974731s, input_fired_time: 0.9197036624, output_fired_time: 0.0000000000, propagate_forward_time: 50.9515914917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0833015442
validation[          , genome 18409] predictions:    9914/  10000 (99.14%), best:    9922/10000 (99.22%), error:       273.56113, best error:       272.60867 on epoch:    78, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 858.3062744141s, input_fired_time: 8.1633882523, output_fired_time: 4.7869305611, propagate_forward_time: 251.6621856689, propagate_backward_time: 586.4837646484, weight_update_time: 0.6225152612, other_time: 7.2100219727
epoch time: 50.5730667114s, input_fired_time: 0.9154901505, output_fired_time: 0.0000000000, propagate_forward_time: 48.5795211792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0780563354
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9922/10000 (99.22%), error:       289.17075, best error:       272.60867 on epoch:    78, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 864.9943237305s, input_fired_time: 9.2254848480, output_fired_time: 4.8041472435, propagate_forward_time: 260.3861083984, propagate_backward_time: 584.3287963867, weight_update_time: 0.6307016611, other_time: 6.2498168945
epoch time: 51.7716903687s, input_fired_time: 2.9282045364, output_fired_time: 0.0000000000, propagate_forward_time: 47.7390861511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1044006348
validation[          , genome 18409] predictions:    9916/  10000 (99.16%), best:    9922/10000 (99.22%), error:       281.67874, best error:       272.60867 on epoch:    78, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 854.2464599609s, input_fired_time: 7.1677722931, output_fired_time: 5.7837786674, propagate_forward_time: 255.5434722900, propagate_backward_time: 579.5301513672, weight_update_time: 0.6279194355, other_time: 6.2213134766
epoch time: 52.2489509583s, input_fired_time: 0.9240924716, output_fired_time: 0.0000000000, propagate_forward_time: 50.2368278503, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0880317688
validation[          , genome 18409] predictions:    9923/  10000 (99.23%), best:    9922/10000 (99.22%), error:       283.83124, best error:       272.60867 on epoch:    78, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 869.5929565430s, input_fired_time: 8.1942672729, output_fired_time: 5.8116221428, propagate_forward_time: 253.2063446045, propagate_backward_time: 594.1228637695, weight_update_time: 0.6296619177, other_time: 8.2578125000
epoch time: 52.9741249084s, input_fired_time: 0.9166807532, output_fired_time: 0.0000000000, propagate_forward_time: 50.9885864258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0688591003
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9922/10000 (99.22%), error:       279.88394, best error:       272.60867 on epoch:    78, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 857.8223266602s, input_fired_time: 7.1943340302, output_fired_time: 4.7752661705, propagate_forward_time: 250.7137145996, propagate_backward_time: 588.8957519531, weight_update_time: 0.6319028139, other_time: 6.2432861328
epoch time: 52.7127380371s, input_fired_time: 0.9181349277, output_fired_time: 0.0000000000, propagate_forward_time: 50.7003021240, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0942993164
validation[          , genome 18409] predictions:    9920/  10000 (99.20%), best:    9922/10000 (99.22%), error:       276.58624, best error:       272.60867 on epoch:    78, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 870.3571777344s, input_fired_time: 8.1887979507, output_fired_time: 4.8412594795, propagate_forward_time: 248.9984741211, propagate_backward_time: 602.0840454102, weight_update_time: 0.6338103414, other_time: 6.2446289062
epoch time: 50.5888404846s, input_fired_time: 0.9194471240, output_fired_time: 0.0000000000, propagate_forward_time: 48.5926513672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0767402649
validation[          , genome 18409] predictions:    9916/  10000 (99.16%), best:    9922/10000 (99.22%), error:       281.12064, best error:       272.60867 on epoch:    78, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 856.0582885742s, input_fired_time: 7.1826763153, output_fired_time: 4.7913484573, propagate_forward_time: 244.5548553467, propagate_backward_time: 590.2654418945, weight_update_time: 1.6387242079, other_time: 9.2639770508
epoch time: 52.1169853210s, input_fired_time: 0.9202182293, output_fired_time: 0.0000000000, propagate_forward_time: 50.1181755066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0785903931
validation[          , genome 18409] predictions:    9918/  10000 (99.18%), best:    9922/10000 (99.22%), error:       283.23953, best error:       272.60867 on epoch:    78, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 851.4656982422s, input_fired_time: 10.2015991211, output_fired_time: 4.7969074249, propagate_forward_time: 237.3841400146, propagate_backward_time: 592.8589477539, weight_update_time: 0.6302931905, other_time: 6.2240600586
epoch time: 52.9534339905s, input_fired_time: 0.9213215113, output_fired_time: 0.0000000000, propagate_forward_time: 50.9534530640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0786590576
validation[          , genome 18409] predictions:    9917/  10000 (99.17%), best:    9922/10000 (99.22%), error:       281.37946, best error:       272.60867 on epoch:    78, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 868.8734741211s, input_fired_time: 8.2020530701, output_fired_time: 4.8316230774, propagate_forward_time: 254.3429565430, propagate_backward_time: 594.2346801758, weight_update_time: 0.6356705427, other_time: 7.2622070312
epoch time: 51.7271156311s, input_fired_time: 2.9259486198, output_fired_time: 0.0000000000, propagate_forward_time: 47.7136268616, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0875396729
validation[          , genome 18409] predictions:    9920/  10000 (99.20%), best:    9922/10000 (99.22%), error:       280.80151, best error:       272.60867 on epoch:    78, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 869.2973022461s, input_fired_time: 10.2145404816, output_fired_time: 6.8121919632, propagate_forward_time: 251.9305725098, propagate_backward_time: 594.0989990234, weight_update_time: 0.6300630569, other_time: 6.2409667969
epoch time: 56.8022613525s, input_fired_time: 0.9326313734, output_fired_time: 0.0000000000, propagate_forward_time: 54.7795295715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0900993347
validation[          , genome 18409] predictions:    9915/  10000 (99.15%), best:    9922/10000 (99.22%), error:       282.65543, best error:       272.60867 on epoch:    78, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 853.6411132812s, input_fired_time: 12.1961822510, output_fired_time: 4.7731399536, propagate_forward_time: 254.4327087402, propagate_backward_time: 575.9972534180, weight_update_time: 0.6354717612, other_time: 6.2418823242
epoch time: 54.2774772644s, input_fired_time: 0.9205030799, output_fired_time: 0.0000000000, propagate_forward_time: 51.2653732300, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0916023254
validation[          , genome 18409] predictions:    9917/  10000 (99.17%), best:    9922/10000 (99.22%), error:       281.55920, best error:       272.60867 on epoch:    78, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 263.7462158203s, input_fired_time: 4.6230573654, output_fired_time: 0.0000000000, propagate_forward_time: 251.6637725830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4593963623
best training[          , genome 18409] predictions:   50000/  50000 (100.00%), best:    9922/10000 (99.22%), error:        92.04437, best error:       272.60867 on epoch:    78, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 53.7344589233s, input_fired_time: 0.9173066020, output_fired_time: 0.0000000000, propagate_forward_time: 51.7346000671, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.0825538635
   testing[          , genome 18409] predictions:    9913/  10000 (99.13%), best:    9922/10000 (99.22%), error:       275.28644, best error:       272.60867 on epoch:    78, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:02:32 (76443): called boinc_finish(0)

</stderr_txt>
]]>