Nameexact_genome_1542069603_186_5790_1
Workunit4086002
Created13 Nov 2018, 11:55:29 UTC
Sent13 Nov 2018, 12:25:46 UTC
Report deadline15 Jan 2019, 21:47:44 UTC
Received17 Nov 2018, 12:29:25 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID75310
Run time23 hours 57 min 30 sec
CPU time23 hours 57 min 8 sec
Validate stateValid
Credit15,847.57
Device peak FLOPS3.28 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size520.34 MB
Peak swap size522.91 MB
Peak disk usage4.36 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
 10000 (56.31%), best:    5878/10000 (58.78%), error:     12568.24316, best error:     11995.99023 on epoch:    13, epoch:   14/100, mu: 0.7577249408, learning_rate: 0.0010614321, weight_decay: 0.0002813434

epoch time: 792.3289184570s, input_fired_time: 12.8767757416, output_fired_time: 3.7116520405, propagate_forward_time: 314.4850463867, propagate_backward_time: 450.8789672852, weight_update_time: 0.2555433214, other_time: 10.3764648438
epoch time: 65.6337509155s, input_fired_time: 0.6940399408, output_fired_time: 0.0000000000, propagate_forward_time: 63.3089027405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6308097839
validation[          , genome  5790] predictions:    5825/  10000 (58.25%), best:    5878/10000 (58.78%), error:     12040.85938, best error:     11995.99023 on epoch:    13, epoch:   15/100, mu: 0.7693284750, learning_rate: 0.0009928242, weight_decay: 0.0002677880

epoch time: 792.1170654297s, input_fired_time: 12.8678750992, output_fired_time: 3.6889715195, propagate_forward_time: 315.1080932617, propagate_backward_time: 450.0489196777, weight_update_time: 0.2602069080, other_time: 10.4032287598
epoch time: 65.2777786255s, input_fired_time: 0.7046040893, output_fired_time: 0.0000000000, propagate_forward_time: 62.9532165527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6199569702
validation[          , genome  5790] predictions:    5945/  10000 (59.45%), best:    5945/10000 (59.45%), error:     11836.11816, best error:     11836.11816 on epoch:    16, epoch:   16/100, mu: 0.7803523540, learning_rate: 0.0009286510, weight_decay: 0.0002548857

epoch time: 791.8326416016s, input_fired_time: 12.8842382431, output_fired_time: 3.6949801445, propagate_forward_time: 314.3830566406, propagate_backward_time: 450.3597106934, weight_update_time: 0.2592234910, other_time: 10.5106506348
epoch time: 65.6727676392s, input_fired_time: 0.7095869184, output_fired_time: 0.0000000000, propagate_forward_time: 63.3390579224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6241226196
validation[          , genome  5790] predictions:    5858/  10000 (58.58%), best:    5945/10000 (59.45%), error:     12020.08496, best error:     11836.11816 on epoch:    16, epoch:   17/100, mu: 0.7908254862, learning_rate: 0.0008686257, weight_decay: 0.0002426051

epoch time: 797.0049438477s, input_fired_time: 12.9072370529, output_fired_time: 3.7192056179, propagate_forward_time: 316.2194824219, propagate_backward_time: 453.6423339844, weight_update_time: 0.2637419999, other_time: 10.5167236328
epoch time: 65.8319015503s, input_fired_time: 0.7013520598, output_fired_time: 0.0000000000, propagate_forward_time: 63.4771614075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6533851624
validation[          , genome  5790] predictions:    5823/  10000 (58.23%), best:    5945/10000 (59.45%), error:     11943.19141, best error:     11836.11816 on epoch:    16, epoch:   18/100, mu: 0.8007754683, learning_rate: 0.0008124803, weight_decay: 0.0002309162

epoch time: 792.8566894531s, input_fired_time: 12.9398918152, output_fired_time: 3.7033920288, propagate_forward_time: 314.4678039551, propagate_backward_time: 451.2751770020, weight_update_time: 0.2592534423, other_time: 10.4704589844
epoch time: 65.3818817139s, input_fired_time: 0.6998130083, output_fired_time: 0.0000000000, propagate_forward_time: 63.0625457764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6195220947
validation[          , genome  5790] predictions:    5776/  10000 (57.76%), best:    5945/10000 (59.45%), error:     12153.94922, best error:     11836.11816 on epoch:    16, epoch:   19/100, mu: 0.8102283478, learning_rate: 0.0007599639, weight_decay: 0.0002197904

epoch time: 798.8103027344s, input_fired_time: 12.9726848602, output_fired_time: 3.7189910412, propagate_forward_time: 317.7044677734, propagate_backward_time: 453.9303283691, weight_update_time: 0.2586468458, other_time: 10.4838562012
epoch time: 65.7686004639s, input_fired_time: 0.7092899680, output_fired_time: 0.0000000000, propagate_forward_time: 63.4069976807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6523132324
validation[          , genome  5790] predictions:    5833/  10000 (58.33%), best:    5945/10000 (59.45%), error:     12019.31934, best error:     11836.11816 on epoch:    16, epoch:   20/100, mu: 0.8192090392, learning_rate: 0.0007108421, weight_decay: 0.0002092007

epoch time: 787.1412963867s, input_fired_time: 12.8761348724, output_fired_time: 3.6802494526, propagate_forward_time: 312.2766418457, propagate_backward_time: 447.9878540039, weight_update_time: 0.2543822825, other_time: 10.3204040527
epoch time: 65.5335235596s, input_fired_time: 0.7029448152, output_fired_time: 0.0000000000, propagate_forward_time: 63.1824874878, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6480941772
validation[          , genome  5790] predictions:    5876/  10000 (58.76%), best:    5945/10000 (59.45%), error:     11919.63965, best error:     11836.11816 on epoch:    16, epoch:   21/100, mu: 0.8277410865, learning_rate: 0.0006648953, weight_decay: 0.0001991212

epoch time: 1990.2230224609s, input_fired_time: 12.9020814896, output_fired_time: 3.7065012455, propagate_forward_time: 1510.5422363281, propagate_backward_time: 452.5685729980, weight_update_time: 0.2603115737, other_time: 10.5035705566
epoch time: 65.0501785278s, input_fired_time: 0.7009987235, output_fired_time: 0.0000000000, propagate_forward_time: 62.7288017273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6203804016
validation[          , genome  5790] predictions:    5852/  10000 (58.52%), best:    5945/10000 (59.45%), error:     11956.15820, best error:     11836.11816 on epoch:    16, epoch:   22/100, mu: 0.8358469009, learning_rate: 0.0006219185, weight_decay: 0.0001895274

epoch time: 795.7791748047s, input_fired_time: 12.9950151443, output_fired_time: 3.7234175205, propagate_forward_time: 315.0125122070, propagate_backward_time: 453.5977783203, weight_update_time: 0.2574010789, other_time: 10.4505004883
epoch time: 67.5748825073s, input_fired_time: 0.7155070901, output_fired_time: 0.0000000000, propagate_forward_time: 65.1862411499, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6731338501
validation[          , genome  5790] predictions:    5859/  10000 (58.59%), best:    5945/10000 (59.45%), error:     11905.47656, best error:     11836.11816 on epoch:    16, epoch:   23/100, mu: 0.8435477614, learning_rate: 0.0005817195, weight_decay: 0.0001803958

epoch time: 793.1030273438s, input_fired_time: 12.9542617798, output_fired_time: 3.7111766338, propagate_forward_time: 315.5551452637, propagate_backward_time: 450.3475646973, weight_update_time: 0.2583868206, other_time: 10.5348510742
epoch time: 64.9713134766s, input_fired_time: 0.7041152120, output_fired_time: 0.0000000000, propagate_forward_time: 62.6640968323, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6030998230
validation[          , genome  5790] predictions:    5971/  10000 (59.71%), best:    5971/10000 (59.71%), error:     11745.72168, best error:     11745.72168 on epoch:    24, epoch:   24/100, mu: 0.8508639336, learning_rate: 0.0005441189, weight_decay: 0.0001717041

epoch time: 795.3067016602s, input_fired_time: 12.9668493271, output_fired_time: 3.7382934093, propagate_forward_time: 315.2713012695, propagate_backward_time: 452.8490905762, weight_update_time: 0.2569645643, other_time: 10.4811706543
epoch time: 65.6389694214s, input_fired_time: 0.7043182254, output_fired_time: 0.0000000000, propagate_forward_time: 63.3105125427, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6241416931
validation[          , genome  5790] predictions:    6011/  10000 (60.11%), best:    6011/10000 (60.11%), error:     11602.98047, best error:     11602.98047 on epoch:    25, epoch:   25/100, mu: 0.8578146100, learning_rate: 0.0005089486, weight_decay: 0.0001634313

epoch time: 790.0169677734s, input_fired_time: 12.9694671631, output_fired_time: 3.6808104515, propagate_forward_time: 313.5696411133, propagate_backward_time: 449.4011230469, weight_update_time: 0.2561824620, other_time: 10.3959350586
epoch time: 65.7678527832s, input_fired_time: 0.7181802988, output_fired_time: 0.0000000000, propagate_forward_time: 63.4159965515, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6336784363
validation[          , genome  5790] predictions:    5986/  10000 (59.86%), best:    6011/10000 (60.11%), error:     11693.77832, best error:     11602.98047 on epoch:    25, epoch:   26/100, mu: 0.8644180298, learning_rate: 0.0004760517, weight_decay: 0.0001555570

epoch time: 794.6721191406s, input_fired_time: 12.9689245224, output_fired_time: 3.7182319164, propagate_forward_time: 315.5904541016, propagate_backward_time: 451.9778442383, weight_update_time: 0.2574344277, other_time: 10.4166259766
epoch time: 65.5760421753s, input_fired_time: 0.7088013887, output_fired_time: 0.0000000000, propagate_forward_time: 63.2306861877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6365547180
validation[          , genome  5790] predictions:    6000/  10000 (60.00%), best:    6011/10000 (60.11%), error:     11607.69922, best error:     11602.98047 on epoch:    25, epoch:   27/100, mu: 0.8706915975, learning_rate: 0.0004452811, weight_decay: 0.0001480621

epoch time: 793.5295410156s, input_fired_time: 12.9599428177, output_fired_time: 3.7082386017, propagate_forward_time: 314.8857727051, propagate_backward_time: 451.5477294922, weight_update_time: 0.2585487068, other_time: 10.4278259277
epoch time: 65.2013320923s, input_fired_time: 0.7150354385, output_fired_time: 0.0000000000, propagate_forward_time: 62.8501892090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6361083984
validation[          , genome  5790] predictions:    5966/  10000 (59.66%), best:    6011/10000 (60.11%), error:     11836.21875, best error:     11602.98047 on epoch:    25, epoch:   28/100, mu: 0.8766517639, learning_rate: 0.0004164995, weight_decay: 0.0001409283

epoch time: 790.7564697266s, input_fired_time: 12.9800672531, output_fired_time: 3.6948454380, propagate_forward_time: 313.5848693848, propagate_backward_time: 450.0300598145, weight_update_time: 0.2582180202, other_time: 10.4666748047
epoch time: 65.8424453735s, input_fired_time: 0.7087461352, output_fired_time: 0.0000000000, propagate_forward_time: 63.5058822632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6278152466
validation[          , genome  5790] predictions:    6005/  10000 (60.05%), best:    6005/10000 (60.05%), error:     11570.83008, best error:     11570.83008 on epoch:    29, epoch:   29/100, mu: 0.8823142052, learning_rate: 0.0003895782, weight_decay: 0.0001341383

epoch time: 796.7551879883s, input_fired_time: 13.0063295364, output_fired_time: 3.7429585457, propagate_forward_time: 315.9281005859, propagate_backward_time: 453.5221862793, weight_update_time: 0.2628224790, other_time: 10.5555725098
epoch time: 65.8665771484s, input_fired_time: 0.7230755091, output_fired_time: 0.0000000000, propagate_forward_time: 63.5183296204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6251716614
validation[          , genome  5790] predictions:    6082/  10000 (60.82%), best:    6082/10000 (60.82%), error:     11305.95898, best error:     11305.95898 on epoch:    30, epoch:   30/100, mu: 0.8876937628, learning_rate: 0.0003643970, weight_decay: 0.0001276754

epoch time: 807.6074218750s, input_fired_time: 13.0583190918, output_fired_time: 3.7555921078, propagate_forward_time: 322.0735473633, propagate_backward_time: 458.2527465820, weight_update_time: 0.2606970370, other_time: 10.4671630859
epoch time: 66.1569366455s, input_fired_time: 0.7295023203, output_fired_time: 0.0000000000, propagate_forward_time: 63.7728004456, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6546363831
validation[          , genome  5790] predictions:    5977/  10000 (59.77%), best:    6082/10000 (60.82%), error:     11610.68945, best error:     11305.95898 on epoch:    30, epoch:   31/100, mu: 0.8928045630, learning_rate: 0.0003408434, weight_decay: 0.0001215238

epoch time: 790.4797973633s, input_fired_time: 12.9654417038, output_fired_time: 3.6961765289, propagate_forward_time: 312.9123229980, propagate_backward_time: 450.5245056152, weight_update_time: 0.2566510439, other_time: 10.3813476562
epoch time: 65.9847488403s, input_fired_time: 0.7236477137, output_fired_time: 0.0000000000, propagate_forward_time: 63.6130828857, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6480178833
validation[          , genome  5790] predictions:    5997/  10000 (59.97%), best:    6082/10000 (60.82%), error:     11564.47168, best error:     11305.95898 on epoch:    30, epoch:   32/100, mu: 0.8976600766, learning_rate: 0.0003188123, weight_decay: 0.0001156687

epoch time: 792.4539794922s, input_fired_time: 12.9894218445, output_fired_time: 3.7149918079, propagate_forward_time: 314.5845947266, propagate_backward_time: 450.8118591309, weight_update_time: 0.2548654974, other_time: 10.3531188965
epoch time: 1969.8072509766s, input_fired_time: 0.7213737965, output_fired_time: 0.0000000000, propagate_forward_time: 1967.4475097656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6384277344
validation[          , genome  5790] predictions:    5977/  10000 (59.77%), best:    6082/10000 (60.82%), error:     11812.67480, best error:     11305.95898 on epoch:    30, epoch:   33/100, mu: 0.9022729993, learning_rate: 0.0002982052, weight_decay: 0.0001100957

epoch time: 790.7039794922s, input_fired_time: 12.9970645905, output_fired_time: 3.6899902821, propagate_forward_time: 313.7019653320, propagate_backward_time: 449.9452209473, weight_update_time: 0.2557752132, other_time: 10.3697204590
epoch time: 65.6061401367s, input_fired_time: 0.7382814884, output_fired_time: 0.0000000000, propagate_forward_time: 63.2411155701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6267433167
validation[          , genome  5790] predictions:    5996/  10000 (59.96%), best:    6082/10000 (60.82%), error:     11527.83008, best error:     11305.95898 on epoch:    30, epoch:   34/100, mu: 0.9066554904, learning_rate: 0.0002789301, weight_decay: 0.0001047912

epoch time: 797.8740844727s, input_fired_time: 13.0066919327, output_fired_time: 3.7296168804, propagate_forward_time: 315.6613464355, propagate_backward_time: 454.9703063965, weight_update_time: 0.2601664066, other_time: 10.5061035156
epoch time: 65.8965835571s, input_fired_time: 0.7296811938, output_fired_time: 0.0000000000, propagate_forward_time: 63.5199432373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6469573975
validation[          , genome  5790] predictions:    6145/  10000 (61.45%), best:    6145/10000 (61.45%), error:     11171.09180, best error:     11171.09180 on epoch:    35, epoch:   35/100, mu: 0.9108190536, learning_rate: 0.0002609009, weight_decay: 0.0000997422

epoch time: 792.5460815430s, input_fired_time: 13.0283679962, output_fired_time: 3.7049744129, propagate_forward_time: 314.6228332520, propagate_backward_time: 450.7314758301, weight_update_time: 0.2577208579, other_time: 10.4584350586
epoch time: 65.9228591919s, input_fired_time: 0.7259222865, output_fired_time: 0.0000000000, propagate_forward_time: 63.5668640137, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6300735474
validation[          , genome  5790] predictions:    6116/  10000 (61.16%), best:    6145/10000 (61.45%), error:     11186.08496, best error:     11171.09180 on epoch:    35, epoch:   36/100, mu: 0.9147745967, learning_rate: 0.0002440370, weight_decay: 0.0000949366

epoch time: 794.8616943359s, input_fired_time: 13.0610122681, output_fired_time: 3.7024688721, propagate_forward_time: 315.9169921875, propagate_backward_time: 451.7313537598, weight_update_time: 0.2599366009, other_time: 10.4498596191
epoch time: 66.0070037842s, input_fired_time: 0.7356426120, output_fired_time: 0.0000000000, propagate_forward_time: 63.6204261780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6509361267
validation[          , genome  5790] predictions:    6113/  10000 (61.13%), best:    6145/10000 (61.45%), error:     11389.18457, best error:     11171.09180 on epoch:    35, epoch:   37/100, mu: 0.9185325503, learning_rate: 0.0002282632, weight_decay: 0.0000903624

epoch time: 793.2737426758s, input_fired_time: 13.0220470428, output_fired_time: 3.7235732079, propagate_forward_time: 313.6633300781, propagate_backward_time: 452.3409118652, weight_update_time: 0.2608028352, other_time: 10.5238952637
epoch time: 65.7659454346s, input_fired_time: 0.7391491532, output_fired_time: 0.0000000000, propagate_forward_time: 63.3861083984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6406860352
validation[          , genome  5790] predictions:    6154/  10000 (61.54%), best:    6154/10000 (61.54%), error:     11155.42383, best error:     11155.42383 on epoch:    38, epoch:   38/100, mu: 0.9221027493, learning_rate: 0.0002135089, weight_decay: 0.0000860087

epoch time: 793.7060546875s, input_fired_time: 13.0488939285, output_fired_time: 3.7010784149, propagate_forward_time: 314.8114929199, propagate_backward_time: 451.6840820312, weight_update_time: 0.2585224807, other_time: 10.4605407715
epoch time: 66.3787231445s, input_fired_time: 0.7343747616, output_fired_time: 0.0000000000, propagate_forward_time: 64.0143737793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6299743652
validation[          , genome  5790] predictions:    6115/  10000 (61.15%), best:    6154/10000 (61.54%), error:     11264.75879, best error:     11155.42383 on epoch:    38, epoch:   39/100, mu: 0.9254946113, learning_rate: 0.0001997084, weight_decay: 0.0000818647

epoch time: 789.4022216797s, input_fired_time: 13.0203952789, output_fired_time: 3.6845886707, propagate_forward_time: 313.0962829590, propagate_backward_time: 449.1904296875, weight_update_time: 0.2562810779, other_time: 10.4105529785
epoch time: 65.5606689453s, input_fired_time: 0.7198530436, output_fired_time: 0.0000000000, propagate_forward_time: 63.2077484131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6330642700
validation[          , genome  5790] predictions:    6131/  10000 (61.31%), best:    6154/10000 (61.54%), error:     11248.04883, best error:     11155.42383 on epoch:    38, epoch:   40/100, mu: 0.9287170172, learning_rate: 0.0001867998, weight_decay: 0.0000779204

epoch time: 807.4133300781s, input_fired_time: 13.1262006760, output_fired_time: 3.7527163029, propagate_forward_time: 320.6651611328, propagate_backward_time: 459.2725219727, weight_update_time: 0.2632873952, other_time: 10.5966796875
epoch time: 65.2343826294s, input_fired_time: 0.7304047346, output_fired_time: 0.0000000000, propagate_forward_time: 62.8847503662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6192245483
validation[          , genome  5790] predictions:    6189/  10000 (61.89%), best:    6154/10000 (61.54%), error:     11223.16309, best error:     11155.42383 on epoch:    38, epoch:   41/100, mu: 0.9317784905, learning_rate: 0.0001747256, weight_decay: 0.0000741661

epoch time: 791.2844238281s, input_fired_time: 13.0525016785, output_fired_time: 3.6984586716, propagate_forward_time: 314.3853454590, propagate_backward_time: 449.8153076172, weight_update_time: 0.2562210858, other_time: 10.3327941895
epoch time: 65.9925003052s, input_fired_time: 0.7429544926, output_fired_time: 0.0000000000, propagate_forward_time: 63.5984497070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6510925293
validation[          , genome  5790] predictions:    6094/  10000 (60.94%), best:    6154/10000 (61.54%), error:     11358.87695, best error:     11155.42383 on epoch:    38, epoch:   42/100, mu: 0.9346870184, learning_rate: 0.0001634318, weight_decay: 0.0000705927

epoch time: 795.2381591797s, input_fired_time: 13.0910272598, output_fired_time: 3.7096071243, propagate_forward_time: 315.5977172852, propagate_backward_time: 452.3075256348, weight_update_time: 0.2605227530, other_time: 10.5323181152
epoch time: 65.4200897217s, input_fired_time: 0.7360622287, output_fired_time: 0.0000000000, propagate_forward_time: 63.0413208008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6427078247
validation[          , genome  5790] predictions:    6192/  10000 (61.92%), best:    6192/10000 (61.92%), error:     11050.72949, best error:     11050.72949 on epoch:    43, epoch:   43/100, mu: 0.9374502301, learning_rate: 0.0001528681, weight_decay: 0.0000671915

epoch time: 48518.7539062500s, input_fired_time: 13.0618600845, output_fired_time: 3.7107002735, propagate_forward_time: 314.5895080566, propagate_backward_time: 48177.2304687500, weight_update_time: 0.2598070800, other_time: 10.1601562500
epoch time: 65.9241943359s, input_fired_time: 0.7436968684, output_fired_time: 0.0000000000, propagate_forward_time: 63.5560455322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6244506836
validation[          , genome  5790] predictions:    6127/  10000 (61.27%), best:    6192/10000 (61.92%), error:     11235.09375, best error:     11050.72949 on epoch:    43, epoch:   44/100, mu: 0.9400753975, learning_rate: 0.0001429871, weight_decay: 0.0000639541

epoch time: 786.7706298828s, input_fired_time: 13.0531625748, output_fired_time: 3.6850340366, propagate_forward_time: 311.2701110840, propagate_backward_time: 448.2330627441, weight_update_time: 0.2586303651, other_time: 10.5292358398
epoch time: 62.7799186707s, input_fired_time: 0.7224389315, output_fired_time: 0.0000000000, propagate_forward_time: 60.4797439575, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5777359009
validation[          , genome  5790] predictions:    6138/  10000 (61.38%), best:    6192/10000 (61.92%), error:     11325.88574, best error:     11050.72949 on epoch:    43, epoch:   45/100, mu: 0.9425694346, learning_rate: 0.0001337449, weight_decay: 0.0000608728

epoch time: 794.4517822266s, input_fired_time: 13.1744394302, output_fired_time: 3.7194652557, propagate_forward_time: 315.0637817383, propagate_backward_time: 451.9059448242, weight_update_time: 0.2615530193, other_time: 10.5881347656
epoch time: 65.6790771484s, input_fired_time: 0.7511413693, output_fired_time: 0.0000000000, propagate_forward_time: 63.2957496643, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6321830750
validation[          , genome  5790] predictions:    6124/  10000 (61.24%), best:    6192/10000 (61.92%), error:     11293.70215, best error:     11050.72949 on epoch:    43, epoch:   46/100, mu: 0.9449388981, learning_rate: 0.0001251000, weight_decay: 0.0000579399

epoch time: 778.3841552734s, input_fired_time: 12.8912706375, output_fired_time: 3.6916375160, propagate_forward_time: 308.6936340332, propagate_backward_time: 442.7781982422, weight_update_time: 0.2573797703, other_time: 10.3293762207
epoch time: 65.6899185181s, input_fired_time: 0.7497232556, output_fired_time: 0.0000000000, propagate_forward_time: 63.3072013855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6329917908
validation[          , genome  5790] predictions:    6272/  10000 (62.72%), best:    6272/10000 (62.72%), error:     10930.87207, best error:     10930.87207 on epoch:    47, epoch:   47/100, mu: 0.9471899867, learning_rate: 0.0001170139, weight_decay: 0.0000551483

epoch time: 790.4987792969s, input_fired_time: 13.1024541855, output_fired_time: 3.7008991241, propagate_forward_time: 313.6608581543, propagate_backward_time: 449.4516296387, weight_update_time: 0.2604045570, other_time: 10.5828857422
epoch time: 65.7572021484s, input_fired_time: 0.7452082634, output_fired_time: 0.0000000000, propagate_forward_time: 63.3735694885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6384239197
validation[          , genome  5790] predictions:    6200/  10000 (62.00%), best:    6272/10000 (62.72%), error:     11143.61035, best error:     10930.87207 on epoch:    47, epoch:   48/100, mu: 0.9493286014, learning_rate: 0.0001094505, weight_decay: 0.0000524912

epoch time: 782.2080688477s, input_fired_time: 12.9882278442, output_fired_time: 3.6671528816, propagate_forward_time: 310.4542541504, propagate_backward_time: 444.7587890625, weight_update_time: 0.2548468113, other_time: 10.3396301270
epoch time: 66.2213973999s, input_fired_time: 0.7465158701, output_fired_time: 0.0000000000, propagate_forward_time: 63.8443374634, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6305465698
validation[          , genome  5790] predictions:    6215/  10000 (62.15%), best:    6272/10000 (62.72%), error:     11053.05859, best error:     10930.87207 on epoch:    47, epoch:   49/100, mu: 0.9513604045, learning_rate: 0.0001023759, weight_decay: 0.0000499621

epoch time: 793.2553710938s, input_fired_time: 13.0961647034, output_fired_time: 3.7316150665, propagate_forward_time: 315.3258056641, propagate_backward_time: 450.5443420410, weight_update_time: 0.2598853409, other_time: 10.5574035645
epoch time: 61.1951332092s, input_fired_time: 0.7133098841, output_fired_time: 0.0000000000, propagate_forward_time: 58.9386672974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5431556702
validation[          , genome  5790] predictions:    6178/  10000 (61.78%), best:    6272/10000 (62.72%), error:     11113.33691, best error:     10930.87207 on epoch:    47, epoch:   50/100, mu: 0.9532907009, learning_rate: 0.0000957586, weight_decay: 0.0000475549

epoch time: 789.6461791992s, input_fired_time: 13.1102085114, output_fired_time: 3.6802000999, propagate_forward_time: 313.2209167480, propagate_backward_time: 449.1718750000, weight_update_time: 0.2581632435, other_time: 10.4629821777
epoch time: 65.6929855347s, input_fired_time: 0.7616273165, output_fired_time: 0.0000000000, propagate_forward_time: 63.2887458801, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6426124573
validation[          , genome  5790] predictions:    6208/  10000 (62.08%), best:    6272/10000 (62.72%), error:     11054.88086, best error:     10930.87207 on epoch:    47, epoch:   51/100, mu: 0.9551245570, learning_rate: 0.0000895691, weight_decay: 0.0000452636

epoch time: 784.3210449219s, input_fired_time: 13.0380573273, output_fired_time: 3.6885802746, propagate_forward_time: 310.9617614746, propagate_backward_time: 446.2308044434, weight_update_time: 0.2582374513, other_time: 10.4017944336
epoch time: 65.8719329834s, input_fired_time: 0.7559595704, output_fired_time: 0.0000000000, propagate_forward_time: 63.4769134521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6390609741
validation[          , genome  5790] predictions:    6282/  10000 (62.82%), best:    6282/10000 (62.82%), error:     10827.76367, best error:     10827.76367 on epoch:    52, epoch:   52/100, mu: 0.9568668008, learning_rate: 0.0000837796, weight_decay: 0.0000430828

epoch time: 792.3131713867s, input_fired_time: 13.1590270996, output_fired_time: 3.7057359219, propagate_forward_time: 313.7728576660, propagate_backward_time: 451.2183837891, weight_update_time: 0.2594417632, other_time: 10.4571838379
epoch time: 66.0647048950s, input_fired_time: 0.7502760887, output_fired_time: 0.0000000000, propagate_forward_time: 63.6839447021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6304855347
validation[          , genome  5790] predictions:    6354/  10000 (63.54%), best:    6354/10000 (63.54%), error:     10789.92090, best error:     10789.92090 on epoch:    53, epoch:   53/100, mu: 0.9585220218, learning_rate: 0.0000783643, weight_decay: 0.0000410070

epoch time: 783.3934936523s, input_fired_time: 13.0434885025, output_fired_time: 3.6730265617, propagate_forward_time: 310.5015258789, propagate_backward_time: 445.7648925781, weight_update_time: 0.2569329739, other_time: 10.4105224609
epoch time: 65.6880187988s, input_fired_time: 0.7615745068, output_fired_time: 0.0000000000, propagate_forward_time: 63.2949562073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6314888000
validation[          , genome  5790] predictions:    6195/  10000 (61.95%), best:    6354/10000 (63.54%), error:     11122.17871, best error:     10789.92090 on epoch:    53, epoch:   54/100, mu: 0.9600945115, learning_rate: 0.0000732991, weight_decay: 0.0000390313

epoch time: 793.1986694336s, input_fired_time: 13.1350126266, output_fired_time: 3.7026882172, propagate_forward_time: 314.8024902344, propagate_backward_time: 451.0764160156, weight_update_time: 0.2579508424, other_time: 10.4820556641
epoch time: 65.2789306641s, input_fired_time: 0.7490533590, output_fired_time: 0.0000000000, propagate_forward_time: 62.8802070618, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6496696472
validation[          , genome  5790] predictions:    6239/  10000 (62.39%), best:    6354/10000 (63.54%), error:     10921.08789, best error:     10789.92090 on epoch:    53, epoch:   55/100, mu: 0.9615884423, learning_rate: 0.0000685613, weight_decay: 0.0000371507

epoch time: 783.3518676758s, input_fired_time: 13.0315370560, output_fired_time: 3.6477291584, propagate_forward_time: 310.5290832520, propagate_backward_time: 445.7283935547, weight_update_time: 0.2550951838, other_time: 10.4151306152
epoch time: 65.8593978882s, input_fired_time: 0.7583706379, output_fired_time: 0.0000000000, propagate_forward_time: 63.4612159729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6398124695
validation[          , genome  5790] predictions:    6294/  10000 (62.94%), best:    6354/10000 (63.54%), error:     10801.99121, best error:     10789.92090 on epoch:    53, epoch:   56/100, mu: 0.9630077481, learning_rate: 0.0000641297, weight_decay: 0.0000353607

epoch time: 773.2117309570s, input_fired_time: 12.8051309586, output_fired_time: 3.6217985153, propagate_forward_time: 306.8227233887, propagate_backward_time: 439.6789855957, weight_update_time: 0.2521911860, other_time: 10.2830810547
epoch time: 62.2101020813s, input_fired_time: 0.7239820957, output_fired_time: 0.0000000000, propagate_forward_time: 59.9108886719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5752296448
validation[          , genome  5790] predictions:    6288/  10000 (62.88%), best:    6354/10000 (63.54%), error:     10839.58105, best error:     10789.92090 on epoch:    53, epoch:   57/100, mu: 0.9643561840, learning_rate: 0.0000599845, weight_decay: 0.0000336570

epoch time: 797.6652221680s, input_fired_time: 13.2141647339, output_fired_time: 3.7196085453, propagate_forward_time: 316.5148315430, propagate_backward_time: 453.5773620605, weight_update_time: 0.2608503997, other_time: 10.6392517090
epoch time: 66.1589813232s, input_fired_time: 0.7788065672, output_fired_time: 0.0000000000, propagate_forward_time: 63.7256813049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6544914246
validation[          , genome  5790] predictions:    6350/  10000 (63.50%), best:    6350/10000 (63.50%), error:     10746.14355, best error:     10746.14355 on epoch:    58, epoch:   58/100, mu: 0.9656372666, learning_rate: 0.0000561073, weight_decay: 0.0000320354

epoch time: 776.2509765625s, input_fired_time: 12.9051504135, output_fired_time: 3.6408925056, propagate_forward_time: 307.3211975098, propagate_backward_time: 442.0319519043, weight_update_time: 0.2559950054, other_time: 10.3518066406
epoch time: 65.7633972168s, input_fired_time: 0.7563326359, output_fired_time: 0.0000000000, propagate_forward_time: 63.3642807007, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6427841187
validation[          , genome  5790] predictions:    6286/  10000 (62.86%), best:    6350/10000 (63.50%), error:     10828.22852, best error:     10746.14355 on epoch:    58, epoch:   59/100, mu: 0.9668543339, learning_rate: 0.0000524807, weight_decay: 0.0000304919

epoch time: 797.1311645508s, input_fired_time: 13.2208642960, output_fired_time: 3.7393815517, propagate_forward_time: 315.5748596191, propagate_backward_time: 454.0349731445, weight_update_time: 0.2613225579, other_time: 10.5610656738
epoch time: 65.1119003296s, input_fired_time: 0.7505744696, output_fired_time: 0.0000000000, propagate_forward_time: 62.7444992065, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6168289185
validation[          , genome  5790] predictions:    6330/  10000 (63.30%), best:    6350/10000 (63.50%), error:     10798.77441, best error:     10746.14355 on epoch:    58, epoch:   60/100, mu: 0.9680106044, learning_rate: 0.0000490885, weight_decay: 0.0000290228

epoch time: 777.5961303711s, input_fired_time: 12.9783897400, output_fired_time: 3.6436467171, propagate_forward_time: 308.3886108398, propagate_backward_time: 442.3175048828, weight_update_time: 0.2548429668, other_time: 10.2679443359
epoch time: 66.8380966187s, input_fired_time: 0.7668074965, output_fired_time: 0.0000000000, propagate_forward_time: 64.4340362549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6372528076
validation[          , genome  5790] predictions:    6241/  10000 (62.41%), best:    6350/10000 (63.50%), error:     10937.61035, best error:     10746.14355 on epoch:    58, epoch:   61/100, mu: 0.9691091180, learning_rate: 0.0000459155, weight_decay: 0.0000276244

epoch time: 792.6558227539s, input_fired_time: 13.1665048599, output_fired_time: 3.7022299767, propagate_forward_time: 314.3410339355, propagate_backward_time: 450.9257507324, weight_update_time: 0.2584832609, other_time: 10.5203247070
epoch time: 65.3486175537s, input_fired_time: 0.7552428246, output_fired_time: 0.0000000000, propagate_forward_time: 62.9781723022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6152038574
validation[          , genome  5790] predictions:    6332/  10000 (63.32%), best:    6332/10000 (63.32%), error:     10656.87012, best error:     10656.87012 on epoch:    62, epoch:   62/100, mu: 0.9701527357, learning_rate: 0.0000429477, weight_decay: 0.0000262935

epoch time: 782.2665405273s, input_fired_time: 13.0338258743, output_fired_time: 3.6497814655, propagate_forward_time: 311.2676086426, propagate_backward_time: 443.9500732422, weight_update_time: 0.2550177276, other_time: 10.3652648926
epoch time: 65.3814010620s, input_fired_time: 0.7550593019, output_fired_time: 0.0000000000, propagate_forward_time: 63.0011749268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6251678467
validation[          , genome  5790] predictions:    6355/  10000 (63.55%), best:    6332/10000 (63.32%), error:     10725.55859, best error:     10656.87012 on epoch:    62, epoch:   63/100, mu: 0.9711441994, learning_rate: 0.0000401717, weight_decay: 0.0000250266

epoch time: 2831.6030273438s, input_fired_time: 13.0667638779, output_fired_time: 3.7073817253, propagate_forward_time: 311.2394104004, propagate_backward_time: 2493.1318359375, weight_update_time: 0.2559630573, other_time: 10.4577636719
epoch time: 65.5481491089s, input_fired_time: 0.7650070786, output_fired_time: 0.0000000000, propagate_forward_time: 63.1401290894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6430130005
validation[          , genome  5790] predictions:    6328/  10000 (63.28%), best:    6332/10000 (63.32%), error:     10750.06348, best error:     10656.87012 on epoch:    62, epoch:   64/100, mu: 0.9720861316, learning_rate: 0.0000375751, weight_decay: 0.0000238208

epoch time: 795.2153930664s, input_fired_time: 13.2170276642, output_fired_time: 3.7285702229, propagate_forward_time: 315.0242919922, propagate_backward_time: 452.6199645996, weight_update_time: 0.2617505193, other_time: 10.6255187988
epoch time: 64.1676330566s, input_fired_time: 0.7504808903, output_fired_time: 0.0000000000, propagate_forward_time: 61.7903289795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6268234253
validation[          , genome  5790] predictions:    6284/  10000 (62.84%), best:    6332/10000 (63.32%), error:     10834.23926, best error:     10656.87012 on epoch:    62, epoch:   65/100, mu: 0.9729810357, learning_rate: 0.0000351464, weight_decay: 0.0000226731

epoch time: 782.9154052734s, input_fired_time: 13.0586109161, output_fired_time: 3.6527576447, propagate_forward_time: 310.9249572754, propagate_backward_time: 444.9628906250, weight_update_time: 0.2551749647, other_time: 10.3161926270
epoch time: 65.6276855469s, input_fired_time: 0.7591850162, output_fired_time: 0.0000000000, propagate_forward_time: 63.2265777588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6419219971
validation[          , genome  5790] predictions:    6359/  10000 (63.59%), best:    6332/10000 (63.32%), error:     10714.47559, best error:     10656.87012 on epoch:    62, epoch:   66/100, mu: 0.9738312364, learning_rate: 0.0000328746, weight_decay: 0.0000215807

epoch time: 788.4020996094s, input_fired_time: 13.1119565964, output_fired_time: 3.6912820339, propagate_forward_time: 312.5065612793, propagate_backward_time: 448.5692443848, weight_update_time: 0.2583649158, other_time: 10.5230712891
epoch time: 66.3998794556s, input_fired_time: 0.7888079286, output_fired_time: 0.0000000000, propagate_forward_time: 63.9506454468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6604232788
validation[          , genome  5790] predictions:    6297/  10000 (62.97%), best:    6332/10000 (63.32%), error:     10787.38574, best error:     10656.87012 on epoch:    62, epoch:   67/100, mu: 0.9746389389, learning_rate: 0.0000307497, weight_decay: 0.0000205409

epoch time: 793.2596435547s, input_fired_time: 13.2154598236, output_fired_time: 3.7064764500, propagate_forward_time: 314.7942199707, propagate_backward_time: 450.9925537109, weight_update_time: 0.2612857223, other_time: 10.5509338379
epoch time: 65.7277145386s, input_fired_time: 0.7976270318, output_fired_time: 0.0000000000, propagate_forward_time: 63.2895431519, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6405410767
validation[          , genome  5790] predictions:    6335/  10000 (63.35%), best:    6332/10000 (63.32%), error:     10682.62988, best error:     10656.87012 on epoch:    62, epoch:   68/100, mu: 0.9754062891, learning_rate: 0.0000287621, weight_decay: 0.0000195512

epoch time: 779.1801147461s, input_fired_time: 12.9710474014, output_fired_time: 3.6513984203, propagate_forward_time: 309.0716552734, propagate_backward_time: 443.1821899414, weight_update_time: 0.2533191144, other_time: 10.3037719727
epoch time: 65.7431488037s, input_fired_time: 0.7726930976, output_fired_time: 0.0000000000, propagate_forward_time: 63.3225059509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6479530334
validation[          , genome  5790] predictions:    6347/  10000 (63.47%), best:    6332/10000 (63.32%), error:     10743.83691, best error:     10656.87012 on epoch:    62, epoch:   69/100, mu: 0.9761353135, learning_rate: 0.0000269030, weight_decay: 0.0000186092

epoch time: 792.1578369141s, input_fired_time: 13.2258739471, output_fired_time: 3.7308061123, propagate_forward_time: 313.9421997070, propagate_backward_time: 450.7395629883, weight_update_time: 0.2588821948, other_time: 10.5193481445
epoch time: 65.6890792847s, input_fired_time: 0.7620041370, output_fired_time: 0.0000000000, propagate_forward_time: 63.2944717407, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6326065063
validation[          , genome  5790] predictions:    6357/  10000 (63.57%), best:    6332/10000 (63.32%), error:     10695.85156, best error:     10656.87012 on epoch:    62, epoch:   70/100, mu: 0.9768279195, learning_rate: 0.0000251641, weight_decay: 0.0000177126

epoch time: 782.8673706055s, input_fired_time: 13.0330801010, output_fired_time: 3.6800031662, propagate_forward_time: 310.5011596680, propagate_backward_time: 445.2492065430, weight_update_time: 0.2552404404, other_time: 10.4039306641
epoch time: 66.6935958862s, input_fired_time: 0.7709305882, output_fired_time: 0.0000000000, propagate_forward_time: 64.2901077271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6325607300
validation[          , genome  5790] predictions:    6260/  10000 (62.60%), best:    6332/10000 (63.32%), error:     10871.75391, best error:     10656.87012 on epoch:    62, epoch:   71/100, mu: 0.9774859548, learning_rate: 0.0000235375, weight_decay: 0.0000168592

epoch time: 781.8952026367s, input_fired_time: 13.0238742828, output_fired_time: 3.6758501530, propagate_forward_time: 309.9072265625, propagate_backward_time: 444.9472656250, weight_update_time: 0.2563440800, other_time: 10.3410034180
epoch time: 64.3575057983s, input_fired_time: 0.7426916957, output_fired_time: 0.0000000000, propagate_forward_time: 62.0319862366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5828285217
validation[          , genome  5790] predictions:    6338/  10000 (63.38%), best:    6332/10000 (63.32%), error:     10690.93848, best error:     10656.87012 on epoch:    62, epoch:   72/100, mu: 0.9781110883, learning_rate: 0.0000220162, weight_decay: 0.0000160469

epoch time: 790.3468627930s, input_fired_time: 13.1580677032, output_fired_time: 3.7011616230, propagate_forward_time: 313.7278137207, propagate_backward_time: 449.3033752441, weight_update_time: 0.2573024929, other_time: 10.4564208984
epoch time: 65.4322052002s, input_fired_time: 0.7688327432, output_fired_time: 0.0000000000, propagate_forward_time: 63.0026931763, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6606826782
validation[          , genome  5790] predictions:    6424/  10000 (64.24%), best:    6424/10000 (64.24%), error:     10526.77832, best error:     10526.77832 on epoch:    73, epoch:   73/100, mu: 0.9787049890, learning_rate: 0.0000205931, weight_decay: 0.0000152738

epoch time: 789.2116088867s, input_fired_time: 13.1492500305, output_fired_time: 3.6855366230, propagate_forward_time: 313.0140380859, propagate_backward_time: 448.8339233398, weight_update_time: 0.2594852746, other_time: 10.5288696289
epoch time: 65.5045394897s, input_fired_time: 0.7620496154, output_fired_time: 0.0000000000, propagate_forward_time: 63.0866661072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6558265686
validation[          , genome  5790] predictions:    6382/  10000 (63.82%), best:    6424/10000 (64.24%), error:     10631.33691, best error:     10526.77832 on epoch:    73, epoch:   74/100, mu: 0.9792692661, learning_rate: 0.0000192620, weight_decay: 0.0000145379

epoch time: 795.0798339844s, input_fired_time: 13.2638921738, output_fired_time: 3.7072160244, propagate_forward_time: 315.6712646484, propagate_backward_time: 451.9921875000, weight_update_time: 0.2576325536, other_time: 10.4452514648
epoch time: 65.6025466919s, input_fired_time: 0.7683951855, output_fired_time: 0.0000000000, propagate_forward_time: 63.1459274292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6882247925
validation[          , genome  5790] predictions:    6442/  10000 (64.42%), best:    6424/10000 (64.24%), error:     10556.47559, best error:     10526.77832 on epoch:    73, epoch:   75/100, mu: 0.9798053503, learning_rate: 0.0000180170, weight_decay: 0.0000138374

epoch time: 727.8209228516s, input_fired_time: 12.2193155289, output_fired_time: 3.4320709705, propagate_forward_time: 288.8814697266, propagate_backward_time: 413.2831726074, weight_update_time: 0.2422483563, other_time: 10.0049133301
epoch time: 58.8960266113s, input_fired_time: 0.6948306561, output_fired_time: 0.0000000000, propagate_forward_time: 56.6964836121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5047111511
validation[          , genome  5790] predictions:    6427/  10000 (64.27%), best:    6424/10000 (64.24%), error:     10543.66113, best error:     10526.77832 on epoch:    73, epoch:   76/100, mu: 0.9803146124, learning_rate: 0.0000168524, weight_decay: 0.0000131707

epoch time: 743.8303833008s, input_fired_time: 12.4533529282, output_fired_time: 3.4807300568, propagate_forward_time: 292.7942810059, propagate_backward_time: 425.2301330566, weight_update_time: 0.2424842566, other_time: 9.8718872070
epoch time: 61.4443092346s, input_fired_time: 0.7301074266, output_fired_time: 0.0000000000, propagate_forward_time: 59.1640815735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5501213074
validation[          , genome  5790] predictions:    6369/  10000 (63.69%), best:    6424/10000 (64.24%), error:     10661.51758, best error:     10526.77832 on epoch:    73, epoch:   77/100, mu: 0.9807984829, learning_rate: 0.0000157631, weight_decay: 0.0000125361

epoch time: 732.7565917969s, input_fired_time: 12.3376531601, output_fired_time: 3.4467799664, propagate_forward_time: 290.4184570312, propagate_backward_time: 416.7710571289, weight_update_time: 0.2408732176, other_time: 9.7826538086
epoch time: 61.4112396240s, input_fired_time: 0.7259582877, output_fired_time: 0.0000000000, propagate_forward_time: 59.1355018616, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5497779846
validation[          , genome  5790] predictions:    6408/  10000 (64.08%), best:    6424/10000 (64.24%), error:     10537.03613, best error:     10526.77832 on epoch:    73, epoch:   78/100, mu: 0.9812581539, learning_rate: 0.0000147442, weight_decay: 0.0000119321

epoch time: 750.5153198242s, input_fired_time: 12.6091747284, output_fired_time: 3.5297074318, propagate_forward_time: 297.5084838867, propagate_backward_time: 426.8675537109, weight_update_time: 0.2454191744, other_time: 10.0003662109
epoch time: 60.4137496948s, input_fired_time: 0.7150303125, output_fired_time: 0.0000000000, propagate_forward_time: 58.1715278625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5271911621
validation[          , genome  5790] predictions:    6383/  10000 (63.83%), best:    6424/10000 (64.24%), error:     10690.08496, best error:     10526.77832 on epoch:    73, epoch:   79/100, mu: 0.9816948771, learning_rate: 0.0000137912, weight_decay: 0.0000113572

epoch time: 735.2073974609s, input_fired_time: 12.3696241379, output_fired_time: 3.4698405266, propagate_forward_time: 291.1344604492, propagate_backward_time: 418.4036865234, weight_update_time: 0.2420519143, other_time: 9.8297729492
epoch time: 61.7518157959s, input_fired_time: 0.7307178378, output_fired_time: 0.0000000000, propagate_forward_time: 59.4656486511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5554504395
validation[          , genome  5790] predictions:    6435/  10000 (64.35%), best:    6435/10000 (64.35%), error:     10464.11426, best error:     10464.11426 on epoch:    80, epoch:   80/100, mu: 0.9821097851, learning_rate: 0.0000128998, weight_decay: 0.0000108100

epoch time: 734.9326782227s, input_fired_time: 12.3861284256, output_fired_time: 3.4662134647, propagate_forward_time: 291.0917968750, propagate_backward_time: 418.1286315918, weight_update_time: 0.2433131933, other_time: 9.8599548340
epoch time: 62.6824951172s, input_fired_time: 0.7448336482, output_fired_time: 0.0000000000, propagate_forward_time: 60.3631210327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5745391846
validation[          , genome  5790] predictions:    6439/  10000 (64.39%), best:    6435/10000 (64.35%), error:     10528.60059, best error:     10464.11426 on epoch:    80, epoch:   81/100, mu: 0.9825039506, learning_rate: 0.0000120660, weight_decay: 0.0000102892

epoch time: 721.4497070312s, input_fired_time: 12.1897439957, output_fired_time: 3.4035077095, propagate_forward_time: 285.7900085449, propagate_backward_time: 410.3676147461, weight_update_time: 0.2389293313, other_time: 9.6988220215
epoch time: 55.8288879395s, input_fired_time: 0.6634616256, output_fired_time: 0.0000000000, propagate_forward_time: 53.7386550903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4267730713
validation[          , genome  5790] predictions:    6411/  10000 (64.11%), best:    6435/10000 (64.35%), error:     10512.05957, best error:     10464.11426 on epoch:    80, epoch:   82/100, mu: 0.9828784466, learning_rate: 0.0000112861, weight_decay: 0.0000097934

epoch time: 703.4857788086s, input_fired_time: 11.8701496124, output_fired_time: 3.3154540062, propagate_forward_time: 278.4537963867, propagate_backward_time: 400.2292480469, weight_update_time: 0.2341455966, other_time: 9.6171264648
epoch time: 58.1897811890s, input_fired_time: 0.6943768263, output_fired_time: 0.0000000000, propagate_forward_time: 56.0097923279, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4856109619
validation[          , genome  5790] predictions:    6463/  10000 (64.63%), best:    6463/10000 (64.63%), error:     10455.50195, best error:     10455.50195 on epoch:    83, epoch:   83/100, mu: 0.9832342267, learning_rate: 0.0000105566, weight_decay: 0.0000093216

epoch time: 777.3460693359s, input_fired_time: 12.9672250748, output_fired_time: 3.6302990913, propagate_forward_time: 308.3398742676, propagate_backward_time: 442.1809082031, weight_update_time: 0.2541879117, other_time: 10.2277526855
epoch time: 66.1573181152s, input_fired_time: 0.7659402490, output_fired_time: 0.0000000000, propagate_forward_time: 63.7560195923, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6353607178
validation[          , genome  5790] predictions:    6357/  10000 (63.57%), best:    6463/10000 (64.63%), error:     10615.42090, best error:     10455.50195 on epoch:    83, epoch:   84/100, mu: 0.9835722446, learning_rate: 0.0000098742, weight_decay: 0.0000088725

epoch time: 790.3921508789s, input_fired_time: 13.1741952896, output_fired_time: 3.6843833923, propagate_forward_time: 313.4508361816, propagate_backward_time: 449.6177978516, weight_update_time: 0.2608585060, other_time: 10.4649353027
epoch time: 65.7777938843s, input_fired_time: 0.7680473328, output_fired_time: 0.0000000000, propagate_forward_time: 63.3603286743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6494216919
validation[          , genome  5790] predictions:    6492/  10000 (64.92%), best:    6492/10000 (64.92%), error:     10424.13770, best error:     10424.13770 on epoch:    85, epoch:   85/100, mu: 0.9838933349, learning_rate: 0.0000092360, weight_decay: 0.0000084450

epoch time: 791.4802856445s, input_fired_time: 13.1864490509, output_fired_time: 3.6827456951, propagate_forward_time: 314.0608520508, propagate_backward_time: 450.1851501465, weight_update_time: 0.2566852570, other_time: 10.3650817871
epoch time: 65.6987609863s, input_fired_time: 0.7688608766, output_fired_time: 0.0000000000, propagate_forward_time: 63.3092918396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6206092834
validation[          , genome  5790] predictions:    6438/  10000 (64.38%), best:    6492/10000 (64.92%), error:     10530.49414, best error:     10424.13770 on epoch:    85, epoch:   86/100, mu: 0.9841983914, learning_rate: 0.0000086390, weight_decay: 0.0000080381

epoch time: 794.1486206055s, input_fired_time: 13.2137584686, output_fired_time: 3.7059733868, propagate_forward_time: 314.6288146973, propagate_backward_time: 452.0429687500, weight_update_time: 0.2600191534, other_time: 10.5570983887
epoch time: 73.9082183838s, input_fired_time: 0.7938575149, output_fired_time: 0.0000000000, propagate_forward_time: 71.4617691040, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6525955200
validation[          , genome  5790] predictions:    6463/  10000 (64.63%), best:    6492/10000 (64.92%), error:     10484.43066, best error:     10424.13770 on epoch:    85, epoch:   87/100, mu: 0.9844881892, learning_rate: 0.0000080806, weight_decay: 0.0000076508

epoch time: 771.7029418945s, input_fired_time: 12.9098396301, output_fired_time: 3.6062214375, propagate_forward_time: 305.8599548340, propagate_backward_time: 439.2104797363, weight_update_time: 0.2490224540, other_time: 10.1164550781
epoch time: 60.8438720703s, input_fired_time: 0.7224444747, output_fired_time: 0.0000000000, propagate_forward_time: 58.5950546265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5263748169
validation[          , genome  5790] predictions:    6438/  10000 (64.38%), best:    6492/10000 (64.92%), error:     10476.61621, best error:     10424.13770 on epoch:    85, epoch:   88/100, mu: 0.9847635627, learning_rate: 0.0000075583, weight_decay: 0.0000072822

epoch time: 764.1251831055s, input_fired_time: 12.8195266724, output_fired_time: 3.5823452473, propagate_forward_time: 302.7024841309, propagate_backward_time: 434.9720458984, weight_update_time: 0.2476614267, other_time: 10.0487976074
epoch time: 64.4899444580s, input_fired_time: 0.7620469928, output_fired_time: 0.0000000000, propagate_forward_time: 62.0877952576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6401023865
validation[          , genome  5790] predictions:    6477/  10000 (64.77%), best:    6477/10000 (64.77%), error:     10413.37891, best error:     10413.37891 on epoch:    89, epoch:   89/100, mu: 0.9850251675, learning_rate: 0.0000070698, weight_decay: 0.0000069313

epoch time: 772.4627075195s, input_fired_time: 12.9342470169, output_fired_time: 3.6173679829, propagate_forward_time: 306.1925964355, propagate_backward_time: 439.5415649414, weight_update_time: 0.2509053051, other_time: 10.1769104004
epoch time: 64.6240310669s, input_fired_time: 0.7592830658, output_fired_time: 0.0000000000, propagate_forward_time: 62.2457809448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6189651489
validation[          , genome  5790] predictions:    6443/  10000 (64.43%), best:    6477/10000 (64.77%), error:     10524.83984, best error:     10413.37891 on epoch:    89, epoch:   90/100, mu: 0.9852737188, learning_rate: 0.0000066128, weight_decay: 0.0000065974

epoch time: 778.7608642578s, input_fired_time: 13.0737352371, output_fired_time: 3.6537446976, propagate_forward_time: 308.8324890137, propagate_backward_time: 442.9559326172, weight_update_time: 0.2518929541, other_time: 10.2449645996
epoch time: 63.8846321106s, input_fired_time: 0.7491929531, output_fired_time: 0.0000000000, propagate_forward_time: 61.5484542847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5869865417
validation[          , genome  5790] predictions:    6465/  10000 (64.65%), best:    6477/10000 (64.77%), error:     10480.95410, best error:     10413.37891 on epoch:    89, epoch:   91/100, mu: 0.9855098128, learning_rate: 0.0000061854, weight_decay: 0.0000062795

epoch time: 778.1011962891s, input_fired_time: 13.1230106354, output_fired_time: 3.6347477436, propagate_forward_time: 308.4676818848, propagate_backward_time: 442.4922180176, weight_update_time: 0.2587320507, other_time: 10.3835449219
epoch time: 64.5848007202s, input_fired_time: 0.7598042488, output_fired_time: 0.0000000000, propagate_forward_time: 62.2226104736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6023864746
validation[          , genome  5790] predictions:    6463/  10000 (64.63%), best:    6463/10000 (64.63%), error:     10402.87500, best error:     10402.87500 on epoch:    92, epoch:   92/100, mu: 0.9857341051, learning_rate: 0.0000057855, weight_decay: 0.0000059770

epoch time: 776.7009277344s, input_fired_time: 13.0639810562, output_fired_time: 3.6379680634, propagate_forward_time: 308.2185058594, propagate_backward_time: 441.5405273438, weight_update_time: 0.2539609671, other_time: 10.2399902344
epoch time: 64.4499130249s, input_fired_time: 0.7595669031, output_fired_time: 0.0000000000, propagate_forward_time: 62.0886039734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6017417908
validation[          , genome  5790] predictions:    6440/  10000 (64.40%), best:    6463/10000 (64.63%), error:     10407.26465, best error:     10402.87500 on epoch:    92, epoch:   93/100, mu: 0.9859471917, learning_rate: 0.0000054116, weight_decay: 0.0000056890

epoch time: 775.6377563477s, input_fired_time: 13.0100402832, output_fired_time: 3.6321437359, propagate_forward_time: 307.4529113770, propagate_backward_time: 441.2129516602, weight_update_time: 0.2536354959, other_time: 10.3296813965
epoch time: 64.4749069214s, input_fired_time: 0.7609115243, output_fired_time: 0.0000000000, propagate_forward_time: 62.0928382874, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6211585999
validation[          , genome  5790] predictions:    6448/  10000 (64.48%), best:    6463/10000 (64.63%), error:     10406.72949, best error:     10402.87500 on epoch:    92, epoch:   94/100, mu: 0.9861496687, learning_rate: 0.0000050618, weight_decay: 0.0000054149

epoch time: 774.9945678711s, input_fired_time: 13.0349245071, output_fired_time: 3.6460180283, propagate_forward_time: 306.2621459961, propagate_backward_time: 441.8374023438, weight_update_time: 0.2520454228, other_time: 10.2141113281
epoch time: 65.1912307739s, input_fired_time: 0.7631134987, output_fired_time: 0.0000000000, propagate_forward_time: 62.8143997192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6137161255
validation[          , genome  5790] predictions:    6454/  10000 (64.54%), best:    6463/10000 (64.63%), error:     10457.51172, best error:     10402.87500 on epoch:    92, epoch:   95/100, mu: 0.9863420129, learning_rate: 0.0000047346, weight_decay: 0.0000051540

epoch time: 791.6264648438s, input_fired_time: 13.2453842163, output_fired_time: 3.7138583660, propagate_forward_time: 313.8479919434, propagate_backward_time: 450.4263000488, weight_update_time: 0.2558863759, other_time: 10.3929443359
epoch time: 65.8058776855s, input_fired_time: 0.7690142989, output_fired_time: 0.0000000000, propagate_forward_time: 63.4052772522, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6315879822
validation[          , genome  5790] predictions:    6502/  10000 (65.02%), best:    6502/10000 (65.02%), error:     10373.32324, best error:     10373.32324 on epoch:    96, epoch:   96/100, mu: 0.9865247607, learning_rate: 0.0000044286, weight_decay: 0.0000049057

epoch time: 794.7974853516s, input_fired_time: 13.2334508896, output_fired_time: 3.7175924778, propagate_forward_time: 315.4085998535, propagate_backward_time: 452.0297241211, weight_update_time: 0.2572649717, other_time: 10.4081115723
epoch time: 66.5693206787s, input_fired_time: 0.7791240811, output_fired_time: 0.0000000000, propagate_forward_time: 64.1509170532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6392822266
validation[          , genome  5790] predictions:    6454/  10000 (64.54%), best:    6502/10000 (65.02%), error:     10412.83105, best error:     10373.32324 on epoch:    96, epoch:   97/100, mu: 0.9866983891, learning_rate: 0.0000041423, weight_decay: 0.0000046693

epoch time: 791.8522338867s, input_fired_time: 13.2285623550, output_fired_time: 3.6856722832, propagate_forward_time: 314.8611450195, propagate_backward_time: 449.6680297852, weight_update_time: 0.2586262822, other_time: 10.4088134766
epoch time: 65.4434814453s, input_fired_time: 0.7633800507, output_fired_time: 0.0000000000, propagate_forward_time: 63.0468635559, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6332359314
validation[          , genome  5790] predictions:    6494/  10000 (64.94%), best:    6502/10000 (65.02%), error:     10386.70703, best error:     10373.32324 on epoch:    96, epoch:   98/100, mu: 0.9868633151, learning_rate: 0.0000038746, weight_decay: 0.0000044443

epoch time: 794.8024902344s, input_fired_time: 13.2784557343, output_fired_time: 3.7564253807, propagate_forward_time: 315.0636901855, propagate_backward_time: 452.2182312012, weight_update_time: 0.2592566013, other_time: 10.4857177734
epoch time: 66.1600112915s, input_fired_time: 0.7762334347, output_fired_time: 0.0000000000, propagate_forward_time: 63.7154312134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6683502197
validation[          , genome  5790] predictions:    6466/  10000 (64.66%), best:    6502/10000 (65.02%), error:     10383.62793, best error:     10373.32324 on epoch:    96, epoch:   99/100, mu: 0.9870200157, learning_rate: 0.0000036241, weight_decay: 0.0000042302

epoch time: 794.6514892578s, input_fired_time: 13.3438014984, output_fired_time: 3.7355356216, propagate_forward_time: 315.5092163086, propagate_backward_time: 451.6174621582, weight_update_time: 0.2591662109, other_time: 10.4454650879
epoch time: 65.9867477417s, input_fired_time: 0.7703276873, output_fired_time: 0.0000000000, propagate_forward_time: 63.5851936340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6312294006
validation[          , genome  5790] predictions:    6495/  10000 (64.95%), best:    6495/10000 (64.95%), error:     10345.40820, best error:     10345.40820 on epoch:   100, epoch:  100/100, mu: 0.9871689081, learning_rate: 0.0000033899, weight_decay: 0.0000040264

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 327.6390075684s, input_fired_time: 3.8724822998, output_fired_time: 0.0000000000, propagate_forward_time: 315.4335021973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.3330383301
best training[          , genome  5790] predictions:   35676/  50000 (71.35%), best:    6495/10000 (64.95%), error:     44178.58594, best error:     10345.40820 on epoch:   100, epoch:  101/100, mu: 0.9873103499, learning_rate: 0.0000031708, weight_decay: 0.0000038324
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 66.6187057495s, input_fired_time: 0.7793626189, output_fired_time: 0.0000000000, propagate_forward_time: 64.1651306152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6742095947
   testing[          , genome  5790] predictions:    6495/  10000 (64.95%), best:    6495/10000 (64.95%), error:     10345.40820, best error:     10345.40820 on epoch:   100, epoch:  101/100, mu: 0.9873103499, learning_rate: 0.0000031708, weight_decay: 0.0000038324
backpropagation finished successfully!
12:28:27 (24487): called boinc_finish(0)

</stderr_txt>
]]>