Nameexact_genome_1518178202_60_18354_1
Workunit2991597
Created9 Feb 2018, 13:10:49 UTC
Sent9 Feb 2018, 13:21:36 UTC
Report deadline11 Mar 2018, 9:56:09 UTC
Received10 Feb 2018, 17:55:19 UTC
Server stateOver
OutcomeValidate error
Client stateDone
Exit status0 (0x0)
Computer ID55108
Run time20 hours 39 min 32 sec
CPU time20 hours 17 min 31 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS2.93 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size180.28 MB
Peak swap size183.67 MB
Peak disk usage4.51 MB

Stderr output

<core_client_version>7.8.2</core_client_version>
<![CDATA[
<stderr_txt>
put_fired_time: 1.8680446148, output_fired_time: 0.0000000000, propagate_forward_time: 53.3987121582, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8871192932
validation[          , genome 18354] predictions:    9835/  10000 (98.35%), best:    9835/10000 (98.35%), error:       522.13849, best error:       522.13849 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 725.0449218750s, input_fired_time: 16.2578773499, output_fired_time: 16.6653385162, propagate_forward_time: 271.3770751953, propagate_backward_time: 404.9025573730, weight_update_time: 0.5511543751, other_time: 15.8420715332
epoch time: 58.2704238892s, input_fired_time: 1.8927433491, output_fired_time: 0.0000000000, propagate_forward_time: 53.5986480713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7790336609
validation[          , genome 18354] predictions:    9733/  10000 (97.33%), best:    9835/10000 (98.35%), error:       820.93542, best error:       522.13849 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 732.2662353516s, input_fired_time: 15.3182029724, output_fired_time: 17.7314796448, propagate_forward_time: 272.3346557617, propagate_backward_time: 411.6211547852, weight_update_time: 0.5647225380, other_time: 15.2607421875
epoch time: 58.4476585388s, input_fired_time: 1.8907072544, output_fired_time: 0.0000000000, propagate_forward_time: 53.6801681519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8767814636
validation[          , genome 18354] predictions:    9835/  10000 (98.35%), best:    9835/10000 (98.35%), error:       575.69055, best error:       522.13849 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 731.1343383789s, input_fired_time: 15.2571773529, output_fired_time: 18.7358970642, propagate_forward_time: 270.1838989258, propagate_backward_time: 411.6795043945, weight_update_time: 0.5396424532, other_time: 15.2778320313
epoch time: 57.9321174622s, input_fired_time: 1.8776612282, output_fired_time: 0.0000000000, propagate_forward_time: 53.3000984192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7543563843
validation[          , genome 18354] predictions:    9820/  10000 (98.20%), best:    9835/10000 (98.35%), error:       556.03107, best error:       522.13849 on epoch:    15, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 712.2415161133s, input_fired_time: 15.9796142578, output_fired_time: 16.2639789581, propagate_forward_time: 260.6921691895, propagate_backward_time: 404.1020507813, weight_update_time: 0.5386327505, other_time: 15.2037048340
epoch time: 58.2315483093s, input_fired_time: 1.8829858303, output_fired_time: 0.0000000000, propagate_forward_time: 52.4836883545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8648757935
validation[          , genome 18354] predictions:    9832/  10000 (98.32%), best:    9835/10000 (98.35%), error:       558.02185, best error:       522.13849 on epoch:    15, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 714.2026977539s, input_fired_time: 15.9769544601, output_fired_time: 16.2192478180, propagate_forward_time: 268.6423034668, propagate_backward_time: 397.4832458496, weight_update_time: 0.5396106839, other_time: 15.8809814453
epoch time: 58.1587753296s, input_fired_time: 1.8761647940, output_fired_time: 0.0000000000, propagate_forward_time: 53.4956398010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7869720459
validation[          , genome 18354] predictions:    9830/  10000 (98.30%), best:    9835/10000 (98.35%), error:       587.12805, best error:       522.13849 on epoch:    15, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 716.6160278320s, input_fired_time: 15.0607442856, output_fired_time: 17.3813819885, propagate_forward_time: 266.8643188477, propagate_backward_time: 401.6242065430, weight_update_time: 0.5392276645, other_time: 15.6853637695
epoch time: 58.1739692688s, input_fired_time: 1.8642239571, output_fired_time: 0.0000000000, propagate_forward_time: 53.5875663757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7221794128
validation[          , genome 18354] predictions:    9840/  10000 (98.40%), best:    9835/10000 (98.35%), error:       528.12421, best error:       522.13849 on epoch:    15, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 724.7125854492s, input_fired_time: 16.4011421204, output_fired_time: 16.4171066284, propagate_forward_time: 266.9981994629, propagate_backward_time: 410.0313720703, weight_update_time: 0.5457734466, other_time: 14.8647766113
epoch time: 61.3799514771s, input_fired_time: 2.0619213581, output_fired_time: 0.0000000000, propagate_forward_time: 56.1067237854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2113075256
validation[          , genome 18354] predictions:    9850/  10000 (98.50%), best:    9850/10000 (98.50%), error:       488.36389, best error:       488.36389 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 730.0069580078s, input_fired_time: 15.2825317383, output_fired_time: 18.5435352325, propagate_forward_time: 269.1915893555, propagate_backward_time: 408.9515380859, weight_update_time: 0.5497283936, other_time: 18.0377807617
epoch time: 57.3446998596s, input_fired_time: 1.9750118256, output_fired_time: 0.0000000000, propagate_forward_time: 51.5406684875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8290214539
validation[          , genome 18354] predictions:    9838/  10000 (98.38%), best:    9850/10000 (98.50%), error:       536.52234, best error:       488.36389 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 716.0817260742s, input_fired_time: 15.9216079712, output_fired_time: 18.1758384705, propagate_forward_time: 266.1824340820, propagate_backward_time: 401.1235351563, weight_update_time: 0.5541970730, other_time: 14.6782836914
epoch time: 59.5108566284s, input_fired_time: 1.9102978706, output_fired_time: 0.0000000000, propagate_forward_time: 53.7958946228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8046646118
validation[          , genome 18354] predictions:    9827/  10000 (98.27%), best:    9850/10000 (98.50%), error:       562.17554, best error:       488.36389 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 735.7694091797s, input_fired_time: 17.4945335388, output_fired_time: 17.6336002350, propagate_forward_time: 271.5815429688, propagate_backward_time: 412.3424072266, weight_update_time: 0.5483575463, other_time: 16.7173461914
epoch time: 64.8245620728s, input_fired_time: 3.0618755817, output_fired_time: 0.0000000000, propagate_forward_time: 58.7727584839, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9899291992
validation[          , genome 18354] predictions:    9797/  10000 (97.97%), best:    9850/10000 (98.50%), error:       656.29462, best error:       488.36389 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 727.1231079102s, input_fired_time: 16.4007034302, output_fired_time: 19.4329624176, propagate_forward_time: 265.3976745605, propagate_backward_time: 409.9645690918, weight_update_time: 0.5449481606, other_time: 15.9271850586
epoch time: 57.8864974976s, input_fired_time: 1.8833575249, output_fired_time: 0.0000000000, propagate_forward_time: 53.2307243347, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7724151611
validation[          , genome 18354] predictions:    9812/  10000 (98.12%), best:    9850/10000 (98.50%), error:       580.38159, best error:       488.36389 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 714.1066284180s, input_fired_time: 14.9900550842, output_fired_time: 17.1750793457, propagate_forward_time: 264.7179260254, propagate_backward_time: 401.5197753906, weight_update_time: 0.5380061269, other_time: 15.7038269043
epoch time: 57.7637214661s, input_fired_time: 1.8697205782, output_fired_time: 0.0000000000, propagate_forward_time: 52.0116539001, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8823471069
validation[          , genome 18354] predictions:    9839/  10000 (98.39%), best:    9850/10000 (98.50%), error:       531.08801, best error:       488.36389 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 724.2766723633s, input_fired_time: 15.0933675766, output_fired_time: 17.6491470337, propagate_forward_time: 270.2982177734, propagate_backward_time: 405.2975158691, weight_update_time: 0.5389474034, other_time: 15.9383850098
epoch time: 57.4473075867s, input_fired_time: 1.8692368269, output_fired_time: 0.0000000000, propagate_forward_time: 52.7958183289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7822532654
validation[          , genome 18354] predictions:    9846/  10000 (98.46%), best:    9850/10000 (98.50%), error:       497.86716, best error:       488.36389 on epoch:    22, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 724.6515502930s, input_fired_time: 16.4770259857, output_fired_time: 17.3973922729, propagate_forward_time: 263.6137695313, propagate_backward_time: 410.2512512207, weight_update_time: 0.5452060699, other_time: 16.9120788574
epoch time: 58.3077507019s, input_fired_time: 1.8791255951, output_fired_time: 0.0000000000, propagate_forward_time: 53.6613082886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7673187256
validation[          , genome 18354] predictions:    9844/  10000 (98.44%), best:    9850/10000 (98.50%), error:       531.30542, best error:       488.36389 on epoch:    22, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 712.8469238281s, input_fired_time: 16.0178222656, output_fired_time: 17.2429428101, propagate_forward_time: 261.6369323730, propagate_backward_time: 401.2966308594, weight_update_time: 0.5397984385, other_time: 16.6526184082
epoch time: 58.6352500916s, input_fired_time: 1.8874348402, output_fired_time: 0.0000000000, propagate_forward_time: 54.0058288574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7419853210
validation[          , genome 18354] predictions:    9836/  10000 (98.36%), best:    9850/10000 (98.50%), error:       516.73444, best error:       488.36389 on epoch:    22, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 718.5748901367s, input_fired_time: 15.9806127548, output_fired_time: 17.2887325287, propagate_forward_time: 268.4833984375, propagate_backward_time: 401.9693298340, weight_update_time: 0.5411040187, other_time: 14.8528137207
epoch time: 57.7742385864s, input_fired_time: 1.8711330891, output_fired_time: 0.0000000000, propagate_forward_time: 52.1947860718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7083206177
validation[          , genome 18354] predictions:    9874/  10000 (98.74%), best:    9874/10000 (98.74%), error:       432.87897, best error:       432.87897 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 729.2297363281s, input_fired_time: 18.4320697784, output_fired_time: 16.6219272614, propagate_forward_time: 272.4790649414, propagate_backward_time: 403.2518920898, weight_update_time: 0.5582507253, other_time: 18.4447631836
epoch time: 57.9548492432s, input_fired_time: 2.8603453636, output_fired_time: 0.0000000000, propagate_forward_time: 52.2528762817, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8416290283
validation[          , genome 18354] predictions:    9792/  10000 (97.92%), best:    9874/10000 (98.74%), error:       682.49487, best error:       432.87897 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 751.7019042969s, input_fired_time: 15.8423795700, output_fired_time: 17.1763134003, propagate_forward_time: 281.2077941895, propagate_backward_time: 422.1734008789, weight_update_time: 0.5739778280, other_time: 15.3019714355
epoch time: 58.2969856262s, input_fired_time: 1.8924936056, output_fired_time: 0.0000000000, propagate_forward_time: 53.5538368225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8506546021
validation[          , genome 18354] predictions:    9868/  10000 (98.68%), best:    9874/10000 (98.74%), error:       452.59702, best error:       432.87897 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 728.4454345703s, input_fired_time: 15.5391502380, output_fired_time: 17.6641502380, propagate_forward_time: 268.7826232910, propagate_backward_time: 411.3297119141, weight_update_time: 0.5527680516, other_time: 15.1298522949
epoch time: 64.5468597412s, input_fired_time: 2.1029181480, output_fired_time: 0.0000000000, propagate_forward_time: 59.3642501831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0796928406
validation[          , genome 18354] predictions:    9850/  10000 (98.50%), best:    9874/10000 (98.74%), error:       484.96628, best error:       432.87897 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 728.0941162109s, input_fired_time: 15.3474884033, output_fired_time: 17.4843063354, propagate_forward_time: 270.6415710449, propagate_backward_time: 407.6069946289, weight_update_time: 0.5487644672, other_time: 17.0137634277
epoch time: 58.0475616455s, input_fired_time: 1.8782516718, output_fired_time: 0.0000000000, propagate_forward_time: 52.3835334778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7857780457
validation[          , genome 18354] predictions:    9859/  10000 (98.59%), best:    9874/10000 (98.74%), error:       449.27246, best error:       432.87897 on epoch:    31, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 735.8565063477s, input_fired_time: 16.4767780304, output_fired_time: 17.6107540131, propagate_forward_time: 270.9038391113, propagate_backward_time: 415.1821289063, weight_update_time: 0.5445466042, other_time: 15.6829528809
epoch time: 57.9955978394s, input_fired_time: 1.8649511337, output_fired_time: 0.0000000000, propagate_forward_time: 53.4353141785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6953315735
validation[          , genome 18354] predictions:    9821/  10000 (98.21%), best:    9874/10000 (98.74%), error:       621.86395, best error:       432.87897 on epoch:    31, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 732.0198364258s, input_fired_time: 15.3211793900, output_fired_time: 18.8767375946, propagate_forward_time: 269.5473632813, propagate_backward_time: 410.1360778809, weight_update_time: 0.5510652065, other_time: 18.1385192871
epoch time: 59.5002632141s, input_fired_time: 1.9097867012, output_fired_time: 0.0000000000, propagate_forward_time: 53.2526283264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3378486633
validation[          , genome 18354] predictions:    9852/  10000 (98.52%), best:    9874/10000 (98.74%), error:       486.83746, best error:       432.87897 on epoch:    31, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 713.2641601563s, input_fired_time: 16.1546039581, output_fired_time: 18.3491191864, propagate_forward_time: 268.5860900879, propagate_backward_time: 394.4572753906, weight_update_time: 0.5380945206, other_time: 15.7170715332
epoch time: 56.0684471130s, input_fired_time: 1.8565592766, output_fired_time: 0.0000000000, propagate_forward_time: 51.4394302368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7724571228
validation[          , genome 18354] predictions:    9828/  10000 (98.28%), best:    9874/10000 (98.74%), error:       506.59146, best error:       432.87897 on epoch:    31, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 718.0295410156s, input_fired_time: 16.2268123627, output_fired_time: 16.2534122467, propagate_forward_time: 270.8720703125, propagate_backward_time: 399.9107055664, weight_update_time: 0.5505710840, other_time: 14.7665405273
epoch time: 57.7904052734s, input_fired_time: 1.8706047535, output_fired_time: 0.0000000000, propagate_forward_time: 52.0850830078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8347167969
validation[          , genome 18354] predictions:    9853/  10000 (98.53%), best:    9874/10000 (98.74%), error:       481.76840, best error:       432.87897 on epoch:    31, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 728.9517822266s, input_fired_time: 16.5203056335, output_fired_time: 17.4816551208, propagate_forward_time: 271.1838684082, propagate_backward_time: 407.8074340820, weight_update_time: 0.5604597926, other_time: 15.9585266113
epoch time: 56.9397735596s, input_fired_time: 1.8736722469, output_fired_time: 0.0000000000, propagate_forward_time: 52.3196449280, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7464561462
validation[          , genome 18354] predictions:    9814/  10000 (98.14%), best:    9874/10000 (98.74%), error:       600.44763, best error:       432.87897 on epoch:    31, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 709.4625244141s, input_fired_time: 16.0633621216, output_fired_time: 16.1994400024, propagate_forward_time: 266.5796203613, propagate_backward_time: 395.0681152344, weight_update_time: 0.5359643698, other_time: 15.5519714355
epoch time: 61.3595237732s, input_fired_time: 1.9714857340, output_fired_time: 0.0000000000, propagate_forward_time: 56.4665184021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9215202332
validation[          , genome 18354] predictions:    9872/  10000 (98.72%), best:    9872/10000 (98.72%), error:       418.41266, best error:       418.41266 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 715.8989868164s, input_fired_time: 16.2146511078, output_fired_time: 16.2693691254, propagate_forward_time: 266.3062438965, propagate_backward_time: 401.3347167969, weight_update_time: 0.5410400629, other_time: 15.7740173340
epoch time: 58.5976257324s, input_fired_time: 1.8985444307, output_fired_time: 0.0000000000, propagate_forward_time: 53.8886413574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8104400635
validation[          , genome 18354] predictions:    9809/  10000 (98.09%), best:    9872/10000 (98.72%), error:       609.74628, best error:       418.41266 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 719.3611450195s, input_fired_time: 17.3149337769, output_fired_time: 16.6047534943, propagate_forward_time: 272.0735168457, propagate_backward_time: 398.3563232422, weight_update_time: 0.5525165200, other_time: 15.0116271973
epoch time: 58.1148910522s, input_fired_time: 1.8920112848, output_fired_time: 0.0000000000, propagate_forward_time: 53.3909530640, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8319282532
validation[          , genome 18354] predictions:    9868/  10000 (98.68%), best:    9872/10000 (98.72%), error:       432.84491, best error:       418.41266 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 740.2986450195s, input_fired_time: 15.5950479507, output_fired_time: 18.8016662598, propagate_forward_time: 279.8721923828, propagate_backward_time: 410.6903991699, weight_update_time: 0.5619203448, other_time: 15.3393859863
epoch time: 57.0957641602s, input_fired_time: 1.8833372593, output_fired_time: 0.0000000000, propagate_forward_time: 52.4241027832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7883224487
validation[          , genome 18354] predictions:    9851/  10000 (98.51%), best:    9872/10000 (98.72%), error:       476.43625, best error:       418.41266 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 734.2898559570s, input_fired_time: 15.5189037323, output_fired_time: 16.8457965851, propagate_forward_time: 277.3182983398, propagate_backward_time: 408.2842407227, weight_update_time: 0.5666531324, other_time: 16.3225708008
epoch time: 57.5874404907s, input_fired_time: 1.8702310324, output_fired_time: 0.0000000000, propagate_forward_time: 51.9386558533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7785530090
validation[          , genome 18354] predictions:    9857/  10000 (98.57%), best:    9872/10000 (98.72%), error:       484.04861, best error:       418.41266 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 699.4817504883s, input_fired_time: 15.9626283646, output_fired_time: 16.0861091614, propagate_forward_time: 260.5183410645, propagate_backward_time: 391.3325805664, weight_update_time: 0.5380080938, other_time: 15.5820617676
epoch time: 56.2724342346s, input_fired_time: 1.8553370237, output_fired_time: 0.0000000000, propagate_forward_time: 51.6577033997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7593955994
validation[          , genome 18354] predictions:    9848/  10000 (98.48%), best:    9872/10000 (98.72%), error:       514.85187, best error:       418.41266 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 698.4418334961s, input_fired_time: 14.8227939606, output_fired_time: 16.9401512146, propagate_forward_time: 259.8170776367, propagate_backward_time: 392.4147949219, weight_update_time: 0.5435352325, other_time: 14.4470214844
epoch time: 57.7003974915s, input_fired_time: 1.8940101862, output_fired_time: 0.0000000000, propagate_forward_time: 52.0006332397, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8057556152
validation[          , genome 18354] predictions:    9857/  10000 (98.57%), best:    9872/10000 (98.72%), error:       465.13562, best error:       418.41266 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 698.5211791992s, input_fired_time: 14.8740425110, output_fired_time: 16.9659271240, propagate_forward_time: 263.3347778320, propagate_backward_time: 388.6467590332, weight_update_time: 0.5398437381, other_time: 14.6996765137
epoch time: 55.3792877197s, input_fired_time: 1.8465478420, output_fired_time: 0.0000000000, propagate_forward_time: 50.8090248108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7237167358
validation[          , genome 18354] predictions:    9874/  10000 (98.74%), best:    9872/10000 (98.72%), error:       432.49850, best error:       418.41266 on epoch:    41, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 697.5702514648s, input_fired_time: 15.8993721008, output_fired_time: 17.0014686584, propagate_forward_time: 264.0451660156, propagate_backward_time: 386.1399230957, weight_update_time: 0.5333639383, other_time: 14.4843444824
epoch time: 56.8081016541s, input_fired_time: 1.8706511259, output_fired_time: 0.0000000000, propagate_forward_time: 52.1410903931, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7963600159
validation[          , genome 18354] predictions:    9864/  10000 (98.64%), best:    9872/10000 (98.72%), error:       431.47437, best error:       418.41266 on epoch:    41, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 696.9446411133s, input_fired_time: 14.8824157715, output_fired_time: 15.8583707809, propagate_forward_time: 260.3507690430, propagate_backward_time: 391.2077636719, weight_update_time: 0.5518692136, other_time: 14.6453247070
epoch time: 65.1755981445s, input_fired_time: 2.1208350658, output_fired_time: 0.0000000000, propagate_forward_time: 60.0446662903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0100975037
validation[          , genome 18354] predictions:    9870/  10000 (98.70%), best:    9872/10000 (98.72%), error:       429.58096, best error:       418.41266 on epoch:    41, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 708.0159301758s, input_fired_time: 16.1687812805, output_fired_time: 18.2740783691, propagate_forward_time: 265.6514587402, propagate_backward_time: 390.0849304199, weight_update_time: 0.5410062671, other_time: 17.8367309570
epoch time: 57.4069099426s, input_fired_time: 1.8675208092, output_fired_time: 0.0000000000, propagate_forward_time: 51.7678565979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7715339661
validation[          , genome 18354] predictions:    9847/  10000 (98.47%), best:    9872/10000 (98.72%), error:       494.99643, best error:       418.41266 on epoch:    41, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 693.9619140625s, input_fired_time: 15.9063835144, output_fired_time: 15.9763879776, propagate_forward_time: 265.2045593262, propagate_backward_time: 382.2498474121, weight_update_time: 0.5383275747, other_time: 14.6247558594
epoch time: 60.0972824097s, input_fired_time: 1.9342665672, output_fired_time: 0.0000000000, propagate_forward_time: 55.3055725098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8574447632
validation[          , genome 18354] predictions:    9872/  10000 (98.72%), best:    9872/10000 (98.72%), error:       416.79913, best error:       416.79913 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 699.9793701172s, input_fired_time: 15.9701490402, output_fired_time: 15.9522972107, propagate_forward_time: 261.5623168945, propagate_backward_time: 388.5896911621, weight_update_time: 0.5474931598, other_time: 17.9049377441
epoch time: 56.8718795776s, input_fired_time: 1.8570035696, output_fired_time: 0.0000000000, propagate_forward_time: 52.2927818298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7220954895
validation[          , genome 18354] predictions:    9809/  10000 (98.09%), best:    9872/10000 (98.72%), error:       567.83582, best error:       416.79913 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 697.9605712891s, input_fired_time: 14.8719997406, output_fired_time: 16.0761203766, propagate_forward_time: 259.0594482422, propagate_backward_time: 392.2261047363, weight_update_time: 0.5421172976, other_time: 15.7268981934
epoch time: 57.2074737549s, input_fired_time: 1.8727210760, output_fired_time: 0.0000000000, propagate_forward_time: 52.5953598022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7393913269
validation[          , genome 18354] predictions:    9877/  10000 (98.77%), best:    9877/10000 (98.77%), error:       416.33585, best error:       416.33585 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 699.9312133789s, input_fired_time: 16.0117130280, output_fired_time: 20.1570110321, propagate_forward_time: 259.0285644531, propagate_backward_time: 390.2671813965, weight_update_time: 0.5480533838, other_time: 14.4667663574
epoch time: 56.2463531494s, input_fired_time: 1.8402441740, output_fired_time: 0.0000000000, propagate_forward_time: 51.7264823914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6796264648
validation[          , genome 18354] predictions:    9872/  10000 (98.72%), best:    9877/10000 (98.77%), error:       453.87027, best error:       416.33585 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 705.0917358398s, input_fired_time: 16.9179744720, output_fired_time: 16.2291679382, propagate_forward_time: 256.9180297852, propagate_backward_time: 399.3668212891, weight_update_time: 0.5411008596, other_time: 15.6597290039
epoch time: 59.6691169739s, input_fired_time: 2.9674355984, output_fired_time: 0.0000000000, propagate_forward_time: 53.7805519104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9211311340
validation[          , genome 18354] predictions:    9883/  10000 (98.83%), best:    9877/10000 (98.77%), error:       434.45593, best error:       416.33585 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 697.1248168945s, input_fired_time: 15.6100015640, output_fired_time: 18.1479930878, propagate_forward_time: 260.7448425293, propagate_backward_time: 387.1688232422, weight_update_time: 0.5334916115, other_time: 15.4531555176
epoch time: 59.2094268799s, input_fired_time: 2.9022028446, output_fired_time: 0.0000000000, propagate_forward_time: 53.4696960449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8375282288
validation[          , genome 18354] predictions:    9875/  10000 (98.75%), best:    9875/10000 (98.75%), error:       398.36584, best error:       398.36584 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 708.5086059570s, input_fired_time: 15.1252965927, output_fired_time: 16.3114528656, propagate_forward_time: 271.1734313965, propagate_backward_time: 390.2931823730, weight_update_time: 0.5412814021, other_time: 15.6052246094
epoch time: 56.1557197571s, input_fired_time: 1.8408845663, output_fired_time: 0.0000000000, propagate_forward_time: 51.6667213440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6481132507
validation[          , genome 18354] predictions:    9883/  10000 (98.83%), best:    9875/10000 (98.75%), error:       412.57999, best error:       398.36584 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 707.2053222656s, input_fired_time: 15.0970497131, output_fired_time: 16.1808280945, propagate_forward_time: 265.0610961914, propagate_backward_time: 396.0738830566, weight_update_time: 0.5460801125, other_time: 14.7924499512
epoch time: 59.5769767761s, input_fired_time: 1.9418081045, output_fired_time: 0.0000000000, propagate_forward_time: 54.7416458130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8935241699
validation[          , genome 18354] predictions:    9866/  10000 (98.66%), best:    9875/10000 (98.75%), error:       463.49374, best error:       398.36584 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 707.6804809570s, input_fired_time: 16.0862655640, output_fired_time: 19.2425003052, propagate_forward_time: 265.6300964355, propagate_backward_time: 391.1244201660, weight_update_time: 0.5565122962, other_time: 15.5972290039
epoch time: 58.7589378357s, input_fired_time: 1.8959261179, output_fired_time: 0.0000000000, propagate_forward_time: 53.9518852234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9111251831
validation[          , genome 18354] predictions:    9887/  10000 (98.87%), best:    9887/10000 (98.87%), error:       394.75113, best error:       394.75113 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 699.1041259766s, input_fired_time: 15.9550609589, output_fired_time: 16.1444187164, propagate_forward_time: 259.2724609375, propagate_backward_time: 392.0469360352, weight_update_time: 0.5420384407, other_time: 15.6852416992
epoch time: 55.3119926453s, input_fired_time: 1.8526445627, output_fired_time: 0.0000000000, propagate_forward_time: 50.7353401184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7240066528
validation[          , genome 18354] predictions:    9314/  10000 (93.14%), best:    9887/10000 (98.87%), error:      2198.41626, best error:       394.75113 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

resetting weights to those on epoch: 60
epoch time: 691.0513916016s, input_fired_time: 14.7674093246, output_fired_time: 16.8873386383, propagate_forward_time: 261.2611999512, propagate_backward_time: 382.8195190430, weight_update_time: 0.5350977182, other_time: 15.3159484863
epoch time: 56.7742500305s, input_fired_time: 1.8600790501, output_fired_time: 0.0000000000, propagate_forward_time: 52.1935997009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7205696106
validation[          , genome 18354] predictions:    9871/  10000 (98.71%), best:    9887/10000 (98.87%), error:       402.16165, best error:       394.75113 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 689.4522705078s, input_fired_time: 15.7404603958, output_fired_time: 15.8754844666, propagate_forward_time: 258.9135437012, propagate_backward_time: 384.5994262695, weight_update_time: 0.5334598422, other_time: 14.3233337402
epoch time: 58.6697959900s, input_fired_time: 1.9134210348, output_fired_time: 0.0000000000, propagate_forward_time: 54.0899009705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6664733887
validation[          , genome 18354] predictions:    9882/  10000 (98.82%), best:    9887/10000 (98.87%), error:       396.38849, best error:       394.75113 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 717.4916381836s, input_fired_time: 16.2606849670, output_fired_time: 16.5078296661, propagate_forward_time: 273.6003112793, propagate_backward_time: 396.4328613281, weight_update_time: 0.5513067842, other_time: 14.6899719238
epoch time: 65.3670425415s, input_fired_time: 2.1053912640, output_fired_time: 0.0000000000, propagate_forward_time: 60.1123237610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1493263245
validation[          , genome 18354] predictions:    9888/  10000 (98.88%), best:    9887/10000 (98.87%), error:       412.21036, best error:       394.75113 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 696.6884155273s, input_fired_time: 15.9335985184, output_fired_time: 16.9666576385, propagate_forward_time: 261.9411010742, propagate_backward_time: 387.2288513184, weight_update_time: 0.5388998985, other_time: 14.6181945801
epoch time: 56.5333518982s, input_fired_time: 1.8386185169, output_fired_time: 0.0000000000, propagate_forward_time: 51.0637702942, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6309623718
validation[          , genome 18354] predictions:    9884/  10000 (98.84%), best:    9887/10000 (98.87%), error:       422.04480, best error:       394.75113 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 692.8662109375s, input_fired_time: 14.8766994476, output_fired_time: 16.8204517365, propagate_forward_time: 260.5737915039, propagate_backward_time: 386.2269592285, weight_update_time: 0.5582183599, other_time: 14.3683166504
epoch time: 55.0833320618s, input_fired_time: 1.8353799582, output_fired_time: 0.0000000000, propagate_forward_time: 50.5841560364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6637954712
validation[          , genome 18354] predictions:    9881/  10000 (98.81%), best:    9887/10000 (98.87%), error:       399.69473, best error:       394.75113 on epoch:    60, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 701.9590454102s, input_fired_time: 18.0845565796, output_fired_time: 18.1912040710, propagate_forward_time: 260.2801208496, propagate_backward_time: 390.7453918457, weight_update_time: 0.5350834131, other_time: 14.6577758789
epoch time: 54.8189888000s, input_fired_time: 1.8226709366, output_fired_time: 0.0000000000, propagate_forward_time: 49.2759780884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7203407288
validation[          , genome 18354] predictions:    9889/  10000 (98.89%), best:    9887/10000 (98.87%), error:       407.04196, best error:       394.75113 on epoch:    60, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 687.4674072266s, input_fired_time: 15.7918806076, output_fired_time: 17.4551601410, propagate_forward_time: 258.4411926270, propagate_backward_time: 380.4595336914, weight_update_time: 0.5290110707, other_time: 15.3196716309
epoch time: 58.7998390198s, input_fired_time: 1.9214222431, output_fired_time: 0.0000000000, propagate_forward_time: 54.1492614746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7291564941
validation[          , genome 18354] predictions:    9871/  10000 (98.71%), best:    9887/10000 (98.87%), error:       416.67068, best error:       394.75113 on epoch:    60, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 691.8086547852s, input_fired_time: 16.8291034698, output_fired_time: 19.0878028870, propagate_forward_time: 252.1043090820, propagate_backward_time: 389.2453308105, weight_update_time: 0.5367619395, other_time: 14.5420837402
epoch time: 56.7559204102s, input_fired_time: 1.8498319387, output_fired_time: 0.0000000000, propagate_forward_time: 51.1914176941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7146720886
validation[          , genome 18354] predictions:    9881/  10000 (98.81%), best:    9887/10000 (98.87%), error:       400.72366, best error:       394.75113 on epoch:    60, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 697.4723510742s, input_fired_time: 15.8656787872, output_fired_time: 16.9558334351, propagate_forward_time: 254.6368255615, propagate_backward_time: 394.4549865723, weight_update_time: 0.5360183120, other_time: 15.5590515137
epoch time: 56.6029663086s, input_fired_time: 1.8473178148, output_fired_time: 0.0000000000, propagate_forward_time: 52.0693664551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6862831116
validation[          , genome 18354] predictions:    9862/  10000 (98.62%), best:    9887/10000 (98.87%), error:       443.30798, best error:       394.75113 on epoch:    60, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 689.0781860352s, input_fired_time: 17.8609237671, output_fired_time: 15.8358917236, propagate_forward_time: 261.6096496582, propagate_backward_time: 378.3017578125, weight_update_time: 0.5276884437, other_time: 15.4700012207
epoch time: 56.4221153259s, input_fired_time: 1.8442659378, output_fired_time: 0.0000000000, propagate_forward_time: 51.9160156250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6618347168
validation[          , genome 18354] predictions:    9874/  10000 (98.74%), best:    9887/10000 (98.87%), error:       444.25671, best error:       394.75113 on epoch:    60, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 716.1122436523s, input_fired_time: 16.3652763367, output_fired_time: 18.5873260498, propagate_forward_time: 264.9227905273, propagate_backward_time: 399.3436889648, weight_update_time: 0.5528273582, other_time: 16.8931274414
epoch time: 56.7993545532s, input_fired_time: 2.8376390934, output_fired_time: 0.0000000000, propagate_forward_time: 51.2809143066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6808013916
validation[          , genome 18354] predictions:    9867/  10000 (98.67%), best:    9887/10000 (98.87%), error:       437.86996, best error:       394.75113 on epoch:    60, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 703.7667236328s, input_fired_time: 16.0544948578, output_fired_time: 16.1753082275, propagate_forward_time: 263.0076904297, propagate_backward_time: 392.8865661621, weight_update_time: 0.5458871126, other_time: 15.6426696777
epoch time: 56.5021629333s, input_fired_time: 2.8179600239, output_fired_time: 0.0000000000, propagate_forward_time: 50.9802169800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7039871216
validation[          , genome 18354] predictions:    9884/  10000 (98.84%), best:    9887/10000 (98.87%), error:       405.78595, best error:       394.75113 on epoch:    60, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 704.6195068359s, input_fired_time: 16.2223091125, output_fired_time: 17.2446956635, propagate_forward_time: 264.7697448730, propagate_backward_time: 390.6965637207, weight_update_time: 0.5404952168, other_time: 15.6862182617
epoch time: 56.4143753052s, input_fired_time: 1.8578861952, output_fired_time: 0.0000000000, propagate_forward_time: 51.8435440063, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7129440308
validation[          , genome 18354] predictions:    9859/  10000 (98.59%), best:    9887/10000 (98.87%), error:       468.96878, best error:       394.75113 on epoch:    60, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 693.6372070313s, input_fired_time: 15.8025321960, output_fired_time: 16.8927173615, propagate_forward_time: 255.8555603027, propagate_backward_time: 389.5656127930, weight_update_time: 0.5381305218, other_time: 15.5207824707
epoch time: 59.0829544067s, input_fired_time: 1.9507031441, output_fired_time: 0.0000000000, propagate_forward_time: 53.3153533936, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8168983459
validation[          , genome 18354] predictions:    9861/  10000 (98.61%), best:    9887/10000 (98.87%), error:       439.92792, best error:       394.75113 on epoch:    60, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 701.1693725586s, input_fired_time: 15.0567522049, output_fired_time: 16.1104087830, propagate_forward_time: 263.6083374023, propagate_backward_time: 390.8243408203, weight_update_time: 0.5474601388, other_time: 15.5695190430
epoch time: 56.7564506531s, input_fired_time: 1.8539516926, output_fired_time: 0.0000000000, propagate_forward_time: 52.2411270142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6613731384
validation[          , genome 18354] predictions:    9884/  10000 (98.84%), best:    9887/10000 (98.87%), error:       407.14682, best error:       394.75113 on epoch:    60, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 700.5217285156s, input_fired_time: 15.9386272430, output_fired_time: 17.0569648743, propagate_forward_time: 258.0747070313, propagate_backward_time: 393.7734985352, weight_update_time: 0.5393818617, other_time: 15.6779785156
epoch time: 56.5901527405s, input_fired_time: 1.8626366854, output_fired_time: 0.0000000000, propagate_forward_time: 52.0628776550, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6646385193
validation[          , genome 18354] predictions:    9883/  10000 (98.83%), best:    9887/10000 (98.87%), error:       407.36887, best error:       394.75113 on epoch:    60, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 700.6030883789s, input_fired_time: 15.9476222992, output_fired_time: 17.2829990387, propagate_forward_time: 260.1792297363, propagate_backward_time: 391.5312805176, weight_update_time: 0.5373972654, other_time: 15.6619262695
epoch time: 56.6982383728s, input_fired_time: 2.8206241131, output_fired_time: 0.0000000000, propagate_forward_time: 50.1305694580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7470436096
validation[          , genome 18354] predictions:    9883/  10000 (98.83%), best:    9887/10000 (98.87%), error:       407.30710, best error:       394.75113 on epoch:    60, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 692.3369750977s, input_fired_time: 17.4585247040, output_fired_time: 15.9110488892, propagate_forward_time: 263.4294128418, propagate_backward_time: 380.1287841797, weight_update_time: 0.5350784063, other_time: 15.4092102051
epoch time: 55.4836807251s, input_fired_time: 1.8460507393, output_fired_time: 0.0000000000, propagate_forward_time: 50.9409179688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6967124939
validation[          , genome 18354] predictions:    9887/  10000 (98.87%), best:    9887/10000 (98.87%), error:       412.71442, best error:       394.75113 on epoch:    60, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 691.1565551758s, input_fired_time: 14.8556938171, output_fired_time: 15.7952852249, propagate_forward_time: 253.4482421875, propagate_backward_time: 392.5905456543, weight_update_time: 0.5376304388, other_time: 14.4667663574
epoch time: 56.5310897827s, input_fired_time: 1.8640084267, output_fired_time: 0.0000000000, propagate_forward_time: 51.9039649963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7631149292
validation[          , genome 18354] predictions:    9880/  10000 (98.80%), best:    9887/10000 (98.87%), error:       427.95972, best error:       394.75113 on epoch:    60, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 706.6331176758s, input_fired_time: 15.1660776138, output_fired_time: 16.2902030945, propagate_forward_time: 270.4505615234, propagate_backward_time: 387.2352294922, weight_update_time: 0.5362331867, other_time: 17.4910278320
epoch time: 56.0523948669s, input_fired_time: 1.8393020630, output_fired_time: 0.0000000000, propagate_forward_time: 51.5200424194, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6930503845
validation[          , genome 18354] predictions:    9879/  10000 (98.79%), best:    9887/10000 (98.87%), error:       438.51447, best error:       394.75113 on epoch:    60, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 707.2403564453s, input_fired_time: 17.1037940979, output_fired_time: 16.1246585846, propagate_forward_time: 264.2403259277, propagate_backward_time: 392.8402099609, weight_update_time: 0.5458381772, other_time: 16.9313659668
epoch time: 56.1476593018s, input_fired_time: 1.8392455578, output_fired_time: 0.0000000000, propagate_forward_time: 50.6769409180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6314735413
validation[          , genome 18354] predictions:    9859/  10000 (98.59%), best:    9887/10000 (98.87%), error:       441.35904, best error:       394.75113 on epoch:    60, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 707.2207641602s, input_fired_time: 15.2354898453, output_fired_time: 17.2319393158, propagate_forward_time: 265.6316223145, propagate_backward_time: 392.3327331543, weight_update_time: 0.5435172915, other_time: 16.7890014648
epoch time: 57.1277198792s, input_fired_time: 1.8753621578, output_fired_time: 0.0000000000, propagate_forward_time: 52.4442672729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8080902100
validation[          , genome 18354] predictions:    9872/  10000 (98.72%), best:    9887/10000 (98.87%), error:       466.53394, best error:       394.75113 on epoch:    60, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 691.7829589844s, input_fired_time: 15.8284835815, output_fired_time: 15.8645381927, propagate_forward_time: 258.6246032715, propagate_backward_time: 386.9652099609, weight_update_time: 0.5409455895, other_time: 14.5000915527
epoch time: 56.2962913513s, input_fired_time: 1.8474701643, output_fired_time: 0.0000000000, propagate_forward_time: 51.7483558655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7004661560
validation[          , genome 18354] predictions:    9881/  10000 (98.81%), best:    9887/10000 (98.87%), error:       429.76471, best error:       394.75113 on epoch:    60, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 695.0859985352s, input_fired_time: 15.8543310165, output_fired_time: 16.0228271484, propagate_forward_time: 255.7319030762, propagate_backward_time: 392.9622192383, weight_update_time: 0.5423257351, other_time: 14.5147399902
epoch time: 55.2951698303s, input_fired_time: 1.8531830311, output_fired_time: 0.0000000000, propagate_forward_time: 50.7304649353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7115211487
validation[          , genome 18354] predictions:    9881/  10000 (98.81%), best:    9887/10000 (98.87%), error:       421.75482, best error:       394.75113 on epoch:    60, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 702.0027465820s, input_fired_time: 15.0555963516, output_fired_time: 16.0556182861, propagate_forward_time: 264.1287841797, propagate_backward_time: 392.1643676758, weight_update_time: 0.5380015969, other_time: 14.5983886719
epoch time: 57.9262123108s, input_fired_time: 1.9087725878, output_fired_time: 0.0000000000, propagate_forward_time: 53.2591094971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7583312988
validation[          , genome 18354] predictions:    9872/  10000 (98.72%), best:    9887/10000 (98.87%), error:       423.27985, best error:       394.75113 on epoch:    60, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 699.2608032227s, input_fired_time: 16.0735511780, output_fired_time: 18.0607013702, propagate_forward_time: 263.5293273926, propagate_backward_time: 387.0273437500, weight_update_time: 0.5395882726, other_time: 14.5698547363
epoch time: 60.5245399475s, input_fired_time: 2.9692008495, output_fired_time: 0.0000000000, propagate_forward_time: 54.6694374084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8859024048
validation[          , genome 18354] predictions:    9882/  10000 (98.82%), best:    9887/10000 (98.87%), error:       427.24551, best error:       394.75113 on epoch:    60, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 703.4962768555s, input_fired_time: 15.2047042847, output_fired_time: 17.2155132294, propagate_forward_time: 272.0787963867, propagate_backward_time: 384.3714294434, weight_update_time: 0.5495684147, other_time: 14.6258239746
epoch time: 58.4975242615s, input_fired_time: 1.9072593451, output_fired_time: 0.0000000000, propagate_forward_time: 53.7942314148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7960319519
validation[          , genome 18354] predictions:    9877/  10000 (98.77%), best:    9887/10000 (98.87%), error:       445.68680, best error:       394.75113 on epoch:    60, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 713.0109863281s, input_fired_time: 15.2594156265, output_fired_time: 16.2752456665, propagate_forward_time: 267.6206970215, propagate_backward_time: 398.0539855957, weight_update_time: 0.5388247967, other_time: 15.8016357422
epoch time: 56.4046401978s, input_fired_time: 1.8566242456, output_fired_time: 0.0000000000, propagate_forward_time: 51.8542480469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6937675476
validation[          , genome 18354] predictions:    9862/  10000 (98.62%), best:    9887/10000 (98.87%), error:       472.68115, best error:       394.75113 on epoch:    60, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 695.2763061523s, input_fired_time: 16.0445098877, output_fired_time: 15.9170722961, propagate_forward_time: 260.5111083984, propagate_backward_time: 387.1900024414, weight_update_time: 0.5363224149, other_time: 15.6136474609
epoch time: 55.3952407837s, input_fired_time: 2.8455424309, output_fired_time: 0.0000000000, propagate_forward_time: 48.8839073181, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6657905579
validation[          , genome 18354] predictions:    9882/  10000 (98.82%), best:    9887/10000 (98.87%), error:       422.14590, best error:       394.75113 on epoch:    60, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 690.8179321289s, input_fired_time: 14.8831481934, output_fired_time: 16.8170948029, propagate_forward_time: 260.7655334473, propagate_backward_time: 384.0125732422, weight_update_time: 0.5322490335, other_time: 14.3396301270
epoch time: 56.5683250427s, input_fired_time: 1.8706737757, output_fired_time: 0.0000000000, propagate_forward_time: 50.9484062195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7492446899
validation[          , genome 18354] predictions:    9888/  10000 (98.88%), best:    9887/10000 (98.87%), error:       410.15936, best error:       394.75113 on epoch:    60, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 686.4130859375s, input_fired_time: 14.7803125381, output_fired_time: 15.8239097595, propagate_forward_time: 255.0112457275, propagate_backward_time: 386.3963623047, weight_update_time: 0.5327844024, other_time: 14.4012451172
epoch time: 60.0095977783s, input_fired_time: 1.9310731888, output_fired_time: 0.0000000000, propagate_forward_time: 54.2817840576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7967414856
validation[          , genome 18354] predictions:    9881/  10000 (98.81%), best:    9887/10000 (98.87%), error:       406.90570, best error:       394.75113 on epoch:    60, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 691.0394287109s, input_fired_time: 17.7144451141, output_fired_time: 15.8132019043, propagate_forward_time: 262.6613159180, propagate_backward_time: 380.3740844727, weight_update_time: 0.5362825394, other_time: 14.4764404297
epoch time: 60.4199066162s, input_fired_time: 2.0132472515, output_fired_time: 0.0000000000, propagate_forward_time: 55.3690605164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0375976563
validation[          , genome 18354] predictions:    9882/  10000 (98.82%), best:    9887/10000 (98.87%), error:       431.65506, best error:       394.75113 on epoch:    60, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 693.6166381836s, input_fired_time: 14.9589872360, output_fired_time: 16.9849472046, propagate_forward_time: 262.2908325195, propagate_backward_time: 384.8372192383, weight_update_time: 0.5413823724, other_time: 14.5446777344
epoch time: 56.3857116699s, input_fired_time: 1.8516837358, output_fired_time: 0.0000000000, propagate_forward_time: 51.8520622253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6819648743
validation[          , genome 18354] predictions:    9877/  10000 (98.77%), best:    9887/10000 (98.87%), error:       413.25574, best error:       394.75113 on epoch:    60, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 699.6253662109s, input_fired_time: 15.9593191147, output_fired_time: 18.1816844940, propagate_forward_time: 262.4074401855, propagate_backward_time: 388.5778198242, weight_update_time: 0.5383800864, other_time: 14.4991149902
epoch time: 56.3264427185s, input_fired_time: 1.8573035002, output_fired_time: 0.0000000000, propagate_forward_time: 51.7826728821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6864662170
validation[          , genome 18354] predictions:    9879/  10000 (98.79%), best:    9887/10000 (98.87%), error:       432.45828, best error:       394.75113 on epoch:    60, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 703.6595458984s, input_fired_time: 15.0713834763, output_fired_time: 17.0335865021, propagate_forward_time: 261.7960815430, propagate_backward_time: 393.0527343750, weight_update_time: 0.5419224501, other_time: 16.7057495117
epoch time: 60.1210327148s, input_fired_time: 1.9382327795, output_fired_time: 0.0000000000, propagate_forward_time: 55.4367904663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7460098267
validation[          , genome 18354] predictions:    9870/  10000 (98.70%), best:    9887/10000 (98.87%), error:       435.56601, best error:       394.75113 on epoch:    60, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 707.8106689453s, input_fired_time: 16.2120952606, output_fired_time: 16.1300048828, propagate_forward_time: 268.3078613281, propagate_backward_time: 392.4527282715, weight_update_time: 0.5581346154, other_time: 14.7079772949
epoch time: 56.8612060547s, input_fired_time: 1.8946627378, output_fired_time: 0.0000000000, propagate_forward_time: 52.1303558350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8361892700
validation[          , genome 18354] predictions:    9877/  10000 (98.77%), best:    9887/10000 (98.87%), error:       427.05243, best error:       394.75113 on epoch:    60, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 711.8248291016s, input_fired_time: 16.3646907806, output_fired_time: 18.3549594879, propagate_forward_time: 276.8854064941, propagate_backward_time: 385.4010009766, weight_update_time: 0.5438647866, other_time: 14.8187561035
epoch time: 56.8450012207s, input_fired_time: 1.8477004766, output_fired_time: 0.0000000000, propagate_forward_time: 52.2898368835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7074623108
validation[          , genome 18354] predictions:    9880/  10000 (98.80%), best:    9887/10000 (98.87%), error:       426.16867, best error:       394.75113 on epoch:    60, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 711.9619750977s, input_fired_time: 15.3562736511, output_fired_time: 16.1946201324, propagate_forward_time: 267.6984863281, propagate_backward_time: 396.9912719727, weight_update_time: 0.5440337658, other_time: 15.7213134766
epoch time: 56.4085578918s, input_fired_time: 1.8555533886, output_fired_time: 0.0000000000, propagate_forward_time: 51.8514671326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7015380859
validation[          , genome 18354] predictions:    9876/  10000 (98.76%), best:    9887/10000 (98.87%), error:       437.26642, best error:       394.75113 on epoch:    60, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 704.1504516602s, input_fired_time: 16.2167129517, output_fired_time: 16.2172451019, propagate_forward_time: 264.7355651855, propagate_backward_time: 391.2738952637, weight_update_time: 0.5522238612, other_time: 15.7070312500
epoch time: 56.7190666199s, input_fired_time: 1.8666756153, output_fired_time: 0.0000000000, propagate_forward_time: 52.1398887634, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7125015259
validation[          , genome 18354] predictions:    9880/  10000 (98.80%), best:    9887/10000 (98.87%), error:       435.71921, best error:       394.75113 on epoch:    60, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 282.7207641602s, input_fired_time: 9.2661342621, output_fired_time: 0.0000000000, propagate_forward_time: 259.6364746094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.8181457520
best training[          , genome 18354] predictions:   49940/  50000 (99.88%), best:    9887/10000 (98.87%), error:       360.34372, best error:       394.75113 on epoch:    60, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 56.0297088623s, input_fired_time: 1.8231619596, output_fired_time: 0.0000000000, propagate_forward_time: 51.5473670959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6591796875
   testing[          , genome 18354] predictions:    9883/  10000 (98.83%), best:    9887/10000 (98.87%), error:       355.61038, best error:       394.75113 on epoch:    60, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
18:54:28 (10528): called boinc_finish(0)

</stderr_txt>
]]>