Nameexact_genome_1542189904_182_5887_2
Workunit4088348
Created10 Jan 2019, 21:51:13 UTC
Sent10 Jan 2019, 21:51:13 UTC
Report deadline25 Mar 2019, 17:04:29 UTC
Received12 Jan 2019, 6:19:52 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID23692
Run time1 days 7 hours 5 min 15 sec
CPU time1 days 6 hours 11 min 44 sec
Validate stateValid
Credit18,450.22
Device peak FLOPS4.16 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size524.34 MB
Peak swap size544.25 MB
Peak disk usage8.93 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
9243
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 20
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 15
read number_validation_images: 10000
read best_validation_predictions: 5489
read best_validation_error: 13709.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5887
read normal distribution: '1 0 0'
generator_str: '368765828'
read generator: 368765828
read generated_by_map:
1 disable_edge 1
reading 73 nodes.
reading 252 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1002.46173095703s, input_fired_time: 8.43319988250732, output_fired_time: 7.94223594665527, propagate_forward_time: 377.961090087891, propagate_backward_time: 597.513488769531, weight_update_time: 1.00015997886658, other_time: 10.6116333007813
epoch time: 77.7526779174805s, input_fired_time: 1.07125639915466, output_fired_time: 0, propagate_forward_time: 74.8579177856445, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.82350158691406
validation[          , genome  5887] predictions:    5557/  10000 (55.57%), best:    5557/10000 (55.57%), error:     13548.05273, best error:     13548.05273 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 1023.5376586914s, input_fired_time: 8.7085599899, output_fired_time: 8.2334651947, propagate_forward_time: 385.8589477539, propagate_backward_time: 609.9421386719, weight_update_time: 1.0406315327, other_time: 10.7945556641
epoch time: 86.0619430542s, input_fired_time: 1.2157785892, output_fired_time: 0.0000000000, propagate_forward_time: 82.7593765259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0867843628
validation[          , genome  5887] predictions:    5589/  10000 (55.89%), best:    5589/10000 (55.89%), error:     13433.06641, best error:     13433.06641 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1028.0839843750s, input_fired_time: 8.7948741913, output_fired_time: 8.2358226776, propagate_forward_time: 387.5017089844, propagate_backward_time: 612.6108398438, weight_update_time: 1.0283135176, other_time: 10.9407348633
epoch time: 79.9526672363s, input_fired_time: 1.1088186502, output_fired_time: 0.0000000000, propagate_forward_time: 76.9556808472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8881683350
validation[          , genome  5887] predictions:    5411/  10000 (54.11%), best:    5589/10000 (55.89%), error:     14177.38281, best error:     13433.06641 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 1034.9936523438s, input_fired_time: 8.8314981461, output_fired_time: 8.2802228928, propagate_forward_time: 390.1876831055, propagate_backward_time: 616.7210083008, weight_update_time: 1.0544857979, other_time: 10.9732055664
epoch time: 79.4646224976s, input_fired_time: 1.1015616655, output_fired_time: 0.0000000000, propagate_forward_time: 76.4924926758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8705673218
validation[          , genome  5887] predictions:    5419/  10000 (54.19%), best:    5589/10000 (55.89%), error:     14055.11133, best error:     13433.06641 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 1021.7647094727s, input_fired_time: 8.7097692490, output_fired_time: 8.1652212143, propagate_forward_time: 384.4579162598, propagate_backward_time: 609.5792846680, weight_update_time: 1.0354310274, other_time: 10.8524780273
epoch time: 82.4207611084s, input_fired_time: 1.1632434130, output_fired_time: 0.0000000000, propagate_forward_time: 79.3060150146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9514999390
validation[          , genome  5887] predictions:    5519/  10000 (55.19%), best:    5589/10000 (55.89%), error:     13792.59766, best error:     13433.06641 on epoch:    21, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 1009.1848754883s, input_fired_time: 8.5700702667, output_fired_time: 7.9898934364, propagate_forward_time: 380.8143615723, propagate_backward_time: 601.2259521484, weight_update_time: 0.9996622801, other_time: 10.5845947266
epoch time: 77.0126190186s, input_fired_time: 1.0604722500, output_fired_time: 0.0000000000, propagate_forward_time: 74.1615447998, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7906036377
validation[          , genome  5887] predictions:    5329/  10000 (53.29%), best:    5589/10000 (55.89%), error:     14873.62891, best error:     13433.06641 on epoch:    21, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 989.0955200195s, input_fired_time: 8.3963184357, output_fired_time: 7.8881397247, propagate_forward_time: 373.1173706055, propagate_backward_time: 589.3303222656, weight_update_time: 1.0149484873, other_time: 10.3634033203
epoch time: 76.0721664429s, input_fired_time: 1.0682257414, output_fired_time: 0.0000000000, propagate_forward_time: 73.1840820313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8198623657
validation[          , genome  5887] predictions:    5497/  10000 (54.97%), best:    5589/10000 (55.89%), error:     13929.94141, best error:     13433.06641 on epoch:    21, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 984.7141113281s, input_fired_time: 8.3891315460, output_fired_time: 7.8012228012, propagate_forward_time: 371.3840942383, propagate_backward_time: 586.8560180664, weight_update_time: 0.9805143476, other_time: 10.2836303711
epoch time: 77.7206878662s, input_fired_time: 1.0712265968, output_fired_time: 0.0000000000, propagate_forward_time: 74.7928466797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8566131592
validation[          , genome  5887] predictions:    5676/  10000 (56.76%), best:    5676/10000 (56.76%), error:     13269.82227, best error:     13269.82227 on epoch:    27, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 983.3672485352s, input_fired_time: 8.3828554153, output_fired_time: 7.7664012909, propagate_forward_time: 370.5558166504, propagate_backward_time: 586.5068359375, weight_update_time: 0.9762449265, other_time: 10.1552734375
epoch time: 76.8714904785s, input_fired_time: 1.0693700314, output_fired_time: 0.0000000000, propagate_forward_time: 73.9844207764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8177032471
validation[          , genome  5887] predictions:    5689/  10000 (56.89%), best:    5689/10000 (56.89%), error:     13220.19141, best error:     13220.19141 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 981.9998779297s, input_fired_time: 8.3725376129, output_fired_time: 7.7919015884, propagate_forward_time: 369.8357849121, propagate_backward_time: 585.6070556641, weight_update_time: 0.9857099652, other_time: 10.3925781250
epoch time: 77.4010543823s, input_fired_time: 1.0806933641, output_fired_time: 0.0000000000, propagate_forward_time: 74.4816589355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8386993408
validation[          , genome  5887] predictions:    5453/  10000 (54.53%), best:    5689/10000 (56.89%), error:     14130.46680, best error:     13220.19141 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 985.1367797852s, input_fired_time: 8.3915929794, output_fired_time: 7.8086509705, propagate_forward_time: 371.8947753906, propagate_backward_time: 586.6464233398, weight_update_time: 0.9839304686, other_time: 10.3953247070
epoch time: 77.3637084961s, input_fired_time: 1.0796755552, output_fired_time: 0.0000000000, propagate_forward_time: 74.4341201782, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8499145508
validation[          , genome  5887] predictions:    5607/  10000 (56.07%), best:    5689/10000 (56.89%), error:     13764.67871, best error:     13220.19141 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 986.0158081055s, input_fired_time: 8.4106616974, output_fired_time: 7.8289942741, propagate_forward_time: 372.0132446289, propagate_backward_time: 587.3265380859, weight_update_time: 0.9812010527, other_time: 10.4364013672
epoch time: 76.4594421387s, input_fired_time: 1.0629231930, output_fired_time: 0.0000000000, propagate_forward_time: 73.5543518066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8421707153
validation[          , genome  5887] predictions:    5689/  10000 (56.89%), best:    5689/10000 (56.89%), error:     13127.87402, best error:     13127.87402 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1010.9844970703s, input_fired_time: 8.5253486633, output_fired_time: 8.1805791855, propagate_forward_time: 389.7974548340, propagate_backward_time: 593.9530029297, weight_update_time: 1.0005789995, other_time: 10.5280761719
epoch time: 83.0596771240s, input_fired_time: 1.0773551464, output_fired_time: 0.0000000000, propagate_forward_time: 80.1443481445, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8379745483
validation[          , genome  5887] predictions:    5854/  10000 (58.54%), best:    5854/10000 (58.54%), error:     12759.66406, best error:     12759.66406 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 1029.6595458984s, input_fired_time: 8.6430730820, output_fired_time: 8.4042882919, propagate_forward_time: 403.1838684082, propagate_backward_time: 598.8333740234, weight_update_time: 1.0321952105, other_time: 10.5949707031
epoch time: 84.5099182129s, input_fired_time: 1.0742499828, output_fired_time: 0.0000000000, propagate_forward_time: 81.5794525146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8562164307
validation[          , genome  5887] predictions:    5644/  10000 (56.44%), best:    5854/10000 (58.54%), error:     13806.25977, best error:     12759.66406 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1028.0571289063s, input_fired_time: 8.6192827225, output_fired_time: 8.4147796631, propagate_forward_time: 403.4254760742, propagate_backward_time: 597.0692138672, weight_update_time: 1.0105019808, other_time: 10.5283813477
epoch time: 83.4673233032s, input_fired_time: 1.0723516941, output_fired_time: 0.0000000000, propagate_forward_time: 80.5595092773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8354644775
validation[          , genome  5887] predictions:    5693/  10000 (56.93%), best:    5854/10000 (58.54%), error:     13269.63086, best error:     12759.66406 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1043.1337890625s, input_fired_time: 8.7613592148, output_fired_time: 8.5825366974, propagate_forward_time: 413.3585815430, propagate_backward_time: 601.7560424805, weight_update_time: 1.0246717930, other_time: 10.6752929688
epoch time: 86.6141586304s, input_fired_time: 1.0697145462, output_fired_time: 0.0000000000, propagate_forward_time: 83.6711730957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8732681274
validation[          , genome  5887] predictions:    5822/  10000 (58.22%), best:    5854/10000 (58.54%), error:     12867.68262, best error:     12759.66406 on epoch:    32, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1031.5490722656s, input_fired_time: 8.6580696106, output_fired_time: 8.4385032654, propagate_forward_time: 406.3383789063, propagate_backward_time: 597.6514282227, weight_update_time: 1.0147627592, other_time: 10.4627075195
epoch time: 83.6635208130s, input_fired_time: 1.0740885735, output_fired_time: 0.0000000000, propagate_forward_time: 80.7597122192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8297195435
validation[          , genome  5887] predictions:    5758/  10000 (57.58%), best:    5854/10000 (58.54%), error:     13096.90430, best error:     12759.66406 on epoch:    32, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1030.3922119141s, input_fired_time: 8.6303310394, output_fired_time: 8.4201374054, propagate_forward_time: 406.2469787598, propagate_backward_time: 596.8065185547, weight_update_time: 1.0118418932, other_time: 10.2882080078
epoch time: 84.8019027710s, input_fired_time: 1.0811672211, output_fired_time: 0.0000000000, propagate_forward_time: 81.9179000854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8028335571
validation[          , genome  5887] predictions:    5775/  10000 (57.75%), best:    5854/10000 (58.54%), error:     12837.10059, best error:     12759.66406 on epoch:    32, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 986.5234985352s, input_fired_time: 8.6205549240, output_fired_time: 8.0519037247, propagate_forward_time: 379.5426635742, propagate_backward_time: 579.6197509766, weight_update_time: 1.0005520582, other_time: 10.6886596680
epoch time: 78.2522125244s, input_fired_time: 1.0976212025, output_fired_time: 0.0000000000, propagate_forward_time: 75.2418899536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9127044678
validation[          , genome  5887] predictions:    5627/  10000 (56.27%), best:    5854/10000 (58.54%), error:     13626.75586, best error:     12759.66406 on epoch:    32, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 969.3887329102s, input_fired_time: 8.4988632202, output_fired_time: 7.9498786926, propagate_forward_time: 368.5574645996, propagate_backward_time: 573.5648803711, weight_update_time: 0.9946095347, other_time: 10.8176879883
epoch time: 76.2285690308s, input_fired_time: 1.0786417723, output_fired_time: 0.0000000000, propagate_forward_time: 73.2696304321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8802947998
validation[          , genome  5887] predictions:    5776/  10000 (57.76%), best:    5854/10000 (58.54%), error:     12834.99023, best error:     12759.66406 on epoch:    32, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 968.9736328125s, input_fired_time: 8.5215539932, output_fired_time: 7.9775147438, propagate_forward_time: 368.4180908203, propagate_backward_time: 573.1750488281, weight_update_time: 1.0003790855, other_time: 10.8814086914
epoch time: 76.5387496948s, input_fired_time: 1.0839756727, output_fired_time: 0.0000000000, propagate_forward_time: 73.5304412842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9243316650
validation[          , genome  5887] predictions:    5769/  10000 (57.69%), best:    5854/10000 (58.54%), error:     12946.34766, best error:     12759.66406 on epoch:    32, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 977.2968750000s, input_fired_time: 8.5648765564, output_fired_time: 7.9849014282, propagate_forward_time: 371.3195800781, propagate_backward_time: 578.5837402344, weight_update_time: 0.9967411160, other_time: 10.8437500000
epoch time: 79.3355484009s, input_fired_time: 1.0767728090, output_fired_time: 0.0000000000, propagate_forward_time: 76.3927230835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8660507202
validation[          , genome  5887] predictions:    5811/  10000 (58.11%), best:    5811/10000 (58.11%), error:     12740.10156, best error:     12740.10156 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 991.2551269531s, input_fired_time: 8.6380262375, output_fired_time: 8.1381788254, propagate_forward_time: 381.7200927734, propagate_backward_time: 582.0413818359, weight_update_time: 0.9990470409, other_time: 10.7174682617
epoch time: 81.9111251831s, input_fired_time: 1.0993913412, output_fired_time: 0.0000000000, propagate_forward_time: 78.9152297974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8965072632
validation[          , genome  5887] predictions:    5825/  10000 (58.25%), best:    5825/10000 (58.25%), error:     12727.08203, best error:     12727.08203 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 1000.1683349609s, input_fired_time: 8.6495866776, output_fired_time: 8.2890453339, propagate_forward_time: 390.2441711426, propagate_backward_time: 582.1881713867, weight_update_time: 1.0141377449, other_time: 10.7973022461
epoch time: 81.6975250244s, input_fired_time: 1.0831435919, output_fired_time: 0.0000000000, propagate_forward_time: 78.7126541138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9017257690
validation[          , genome  5887] predictions:    5943/  10000 (59.43%), best:    5943/10000 (59.43%), error:     12332.29688, best error:     12332.29688 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 999.5186157227s, input_fired_time: 8.6735305786, output_fired_time: 8.2756071091, propagate_forward_time: 389.9566040039, propagate_backward_time: 581.8468627930, weight_update_time: 1.0102083683, other_time: 10.7659912109
epoch time: 80.2270889282s, input_fired_time: 1.0963343382, output_fired_time: 0.0000000000, propagate_forward_time: 77.2228240967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9079284668
validation[          , genome  5887] predictions:    5908/  10000 (59.08%), best:    5943/10000 (59.43%), error:     12533.29980, best error:     12332.29688 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 997.5328979492s, input_fired_time: 8.6627235413, output_fired_time: 8.2684993744, propagate_forward_time: 388.4277038574, propagate_backward_time: 581.4311523438, weight_update_time: 1.0091441870, other_time: 10.7427978516
epoch time: 76.9704666138s, input_fired_time: 1.0905976295, output_fired_time: 0.0000000000, propagate_forward_time: 73.9305419922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9493255615
validation[          , genome  5887] predictions:    5869/  10000 (58.69%), best:    5943/10000 (59.43%), error:     12711.81836, best error:     12332.29688 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 993.0209350586s, input_fired_time: 8.7229375839, output_fired_time: 8.2599544525, propagate_forward_time: 384.5577392578, propagate_backward_time: 580.6275024414, weight_update_time: 1.0085122585, other_time: 10.8527832031
epoch time: 79.5250091553s, input_fired_time: 1.0902361870, output_fired_time: 0.0000000000, propagate_forward_time: 76.5394973755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8952789307
validation[          , genome  5887] predictions:    5960/  10000 (59.60%), best:    5943/10000 (59.43%), error:     12670.21680, best error:     12332.29688 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 999.7380371094s, input_fired_time: 8.6665115356, output_fired_time: 8.2447242737, propagate_forward_time: 389.3040466309, propagate_backward_time: 582.7102050781, weight_update_time: 1.0138784647, other_time: 10.8125000000
epoch time: 80.0651931763s, input_fired_time: 1.0936648846, output_fired_time: 0.0000000000, propagate_forward_time: 77.0280685425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9434585571
validation[          , genome  5887] predictions:    5794/  10000 (57.94%), best:    5943/10000 (59.43%), error:     12829.15234, best error:     12332.29688 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1004.0808715820s, input_fired_time: 8.6840047836, output_fired_time: 8.3520412445, propagate_forward_time: 391.7902526855, propagate_backward_time: 584.4265136719, weight_update_time: 1.0095887184, other_time: 10.8280029297
epoch time: 80.5680465698s, input_fired_time: 1.0859451294, output_fired_time: 0.0000000000, propagate_forward_time: 77.5771789551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9049224854
validation[          , genome  5887] predictions:    5911/  10000 (59.11%), best:    5943/10000 (59.43%), error:     12458.04297, best error:     12332.29688 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1004.5509643555s, input_fired_time: 8.8432207108, output_fired_time: 8.4996871948, propagate_forward_time: 390.9872436523, propagate_backward_time: 584.7257690430, weight_update_time: 1.0283039808, other_time: 11.4950561523
epoch time: 79.8861007690s, input_fired_time: 1.0998771191, output_fired_time: 0.0000000000, propagate_forward_time: 76.8229980469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9632263184
validation[          , genome  5887] predictions:    5960/  10000 (59.60%), best:    5960/10000 (59.60%), error:     12326.91113, best error:     12326.91113 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 999.0289306641s, input_fired_time: 8.8291215897, output_fired_time: 8.4204273224, propagate_forward_time: 388.8812255859, propagate_backward_time: 581.2230834961, weight_update_time: 1.0237911940, other_time: 11.6751098633
epoch time: 82.8998565674s, input_fired_time: 1.1206254959, output_fired_time: 0.0000000000, propagate_forward_time: 79.7240142822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0552139282
validation[          , genome  5887] predictions:    5812/  10000 (58.12%), best:    5960/10000 (59.60%), error:     12796.16211, best error:     12326.91113 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 988.4042358398s, input_fired_time: 8.8493556976, output_fired_time: 8.3895921707, propagate_forward_time: 381.4665527344, propagate_backward_time: 577.7688598633, weight_update_time: 1.0222187042, other_time: 11.9298706055
epoch time: 78.9878997803s, input_fired_time: 1.1311895847, output_fired_time: 0.0000000000, propagate_forward_time: 75.6703186035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1863937378
validation[          , genome  5887] predictions:    6017/  10000 (60.17%), best:    5960/10000 (59.60%), error:     12343.20410, best error:     12326.91113 on epoch:    49, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 973.9293212891s, input_fired_time: 8.8117389679, output_fired_time: 8.2444362640, propagate_forward_time: 371.8522949219, propagate_backward_time: 572.9647827148, weight_update_time: 1.0262442827, other_time: 12.0560302734
epoch time: 76.8808822632s, input_fired_time: 1.1125535965, output_fired_time: 0.0000000000, propagate_forward_time: 73.6826171875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0857086182
validation[          , genome  5887] predictions:    5875/  10000 (58.75%), best:    5960/10000 (59.60%), error:     12513.15430, best error:     12326.91113 on epoch:    49, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 972.4478149414s, input_fired_time: 8.7891044617, output_fired_time: 8.2227067947, propagate_forward_time: 369.8424377441, propagate_backward_time: 573.5708007813, weight_update_time: 1.0426788330, other_time: 12.0227050781
epoch time: 76.6419296265s, input_fired_time: 1.1180508137, output_fired_time: 0.0000000000, propagate_forward_time: 73.3487548828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1751251221
validation[          , genome  5887] predictions:    5798/  10000 (57.98%), best:    5960/10000 (59.60%), error:     12920.49121, best error:     12326.91113 on epoch:    49, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 968.3626098633s, input_fired_time: 8.7506618500, output_fired_time: 8.1779956818, propagate_forward_time: 368.1570739746, propagate_backward_time: 571.2740478516, weight_update_time: 1.0178042650, other_time: 12.0028076172
epoch time: 77.0034027100s, input_fired_time: 1.1593779325, output_fired_time: 0.0000000000, propagate_forward_time: 73.6209869385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2230377197
validation[          , genome  5887] predictions:    6027/  10000 (60.27%), best:    6027/10000 (60.27%), error:     11996.84375, best error:     11996.84375 on epoch:    54, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 991.7675781250s, input_fired_time: 8.9990596771, output_fired_time: 8.3120231628, propagate_forward_time: 378.3209533691, propagate_backward_time: 583.8154296875, weight_update_time: 1.0325670242, other_time: 12.3200683594
epoch time: 76.7942733765s, input_fired_time: 1.1234650612, output_fired_time: 0.0000000000, propagate_forward_time: 73.4921417236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1786651611
validation[          , genome  5887] predictions:    5976/  10000 (59.76%), best:    6027/10000 (60.27%), error:     12381.29492, best error:     11996.84375 on epoch:    54, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 972.8837280273s, input_fired_time: 8.8282899857, output_fired_time: 8.2457036972, propagate_forward_time: 370.8134765625, propagate_backward_time: 572.8726196289, weight_update_time: 1.0213937759, other_time: 12.1235961914
epoch time: 76.9370422363s, input_fired_time: 1.1268018484, output_fired_time: 0.0000000000, propagate_forward_time: 73.6197357178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1905059814
validation[          , genome  5887] predictions:    5965/  10000 (59.65%), best:    6027/10000 (60.27%), error:     12309.06250, best error:     11996.84375 on epoch:    54, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 967.4047851563s, input_fired_time: 8.8121500015, output_fired_time: 8.2180309296, propagate_forward_time: 369.0824584961, propagate_backward_time: 569.1929931641, weight_update_time: 1.0135537386, other_time: 12.0991821289
epoch time: 77.0031661987s, input_fired_time: 1.1210806370, output_fired_time: 0.0000000000, propagate_forward_time: 73.8121795654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0699081421
validation[          , genome  5887] predictions:    5972/  10000 (59.72%), best:    6027/10000 (60.27%), error:     12188.96387, best error:     11996.84375 on epoch:    54, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 969.9078369141s, input_fired_time: 8.8030033112, output_fired_time: 8.1777019501, propagate_forward_time: 368.7406921387, propagate_backward_time: 572.1738281250, weight_update_time: 1.0117915869, other_time: 12.0126953125
epoch time: 77.7929534912s, input_fired_time: 1.1325944662, output_fired_time: 0.0000000000, propagate_forward_time: 74.4008483887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2595138550
validation[          , genome  5887] predictions:    5998/  10000 (59.98%), best:    6027/10000 (60.27%), error:     12177.97266, best error:     11996.84375 on epoch:    54, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 969.7918701172s, input_fired_time: 8.8531990051, output_fired_time: 8.1680727005, propagate_forward_time: 369.2329101563, propagate_backward_time: 571.4931640625, weight_update_time: 1.0119956732, other_time: 12.0444946289
epoch time: 77.4846420288s, input_fired_time: 1.1374399662, output_fired_time: 0.0000000000, propagate_forward_time: 74.1783142090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1688842773
validation[          , genome  5887] predictions:    6038/  10000 (60.38%), best:    6038/10000 (60.38%), error:     11892.17969, best error:     11892.17969 on epoch:    59, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 970.2403564453s, input_fired_time: 8.8004484177, output_fired_time: 8.1863994598, propagate_forward_time: 369.1669921875, propagate_backward_time: 572.0626831055, weight_update_time: 1.0158511400, other_time: 12.0238037109
epoch time: 76.8991012573s, input_fired_time: 1.1237763166, output_fired_time: 0.0000000000, propagate_forward_time: 73.7241058350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0512161255
validation[          , genome  5887] predictions:    6011/  10000 (60.11%), best:    6038/10000 (60.38%), error:     11942.66309, best error:     11892.17969 on epoch:    59, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 969.6350097656s, input_fired_time: 8.7960662842, output_fired_time: 8.2294292450, propagate_forward_time: 368.9521484375, propagate_backward_time: 571.7199707031, weight_update_time: 1.0236693621, other_time: 11.9373779297
epoch time: 76.6215591431s, input_fired_time: 1.1314883232, output_fired_time: 0.0000000000, propagate_forward_time: 73.3798522949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1102218628
validation[          , genome  5887] predictions:    5969/  10000 (59.69%), best:    6038/10000 (60.38%), error:     12227.38965, best error:     11892.17969 on epoch:    59, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 977.8173828125s, input_fired_time: 8.8451509476, output_fired_time: 8.2190990448, propagate_forward_time: 371.3160400391, propagate_backward_time: 577.5063476563, weight_update_time: 1.0117081404, other_time: 11.9307250977
epoch time: 77.7933731079s, input_fired_time: 1.1381652355, output_fired_time: 0.0000000000, propagate_forward_time: 74.5059356689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1492691040
validation[          , genome  5887] predictions:    5951/  10000 (59.51%), best:    6038/10000 (60.38%), error:     12341.78027, best error:     11892.17969 on epoch:    59, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 974.3999633789s, input_fired_time: 8.8410091400, output_fired_time: 8.2463312149, propagate_forward_time: 370.7800292969, propagate_backward_time: 574.7283325195, weight_update_time: 1.0137608051, other_time: 11.8042602539
epoch time: 76.9844894409s, input_fired_time: 1.1442658901, output_fired_time: 0.0000000000, propagate_forward_time: 73.8332748413, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0069503784
validation[          , genome  5887] predictions:    6057/  10000 (60.57%), best:    6038/10000 (60.38%), error:     12032.71875, best error:     11892.17969 on epoch:    59, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 1004.8429565430s, input_fired_time: 8.9493350983, output_fired_time: 8.3877172470, propagate_forward_time: 388.2523498535, propagate_backward_time: 587.5913696289, weight_update_time: 1.0272756815, other_time: 11.6621704102
epoch time: 82.3158111572s, input_fired_time: 1.1443043947, output_fired_time: 0.0000000000, propagate_forward_time: 79.0806274414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0908813477
validation[          , genome  5887] predictions:    6026/  10000 (60.26%), best:    6038/10000 (60.38%), error:     12069.58594, best error:     11892.17969 on epoch:    59, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 1008.9102783203s, input_fired_time: 8.9303169250, output_fired_time: 8.4037284851, propagate_forward_time: 390.4334106445, propagate_backward_time: 589.5336303711, weight_update_time: 1.0270234346, other_time: 11.6091918945
epoch time: 81.0624694824s, input_fired_time: 1.1302877665, output_fired_time: 0.0000000000, propagate_forward_time: 77.9408721924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9913101196
validation[          , genome  5887] predictions:    6046/  10000 (60.46%), best:    6038/10000 (60.38%), error:     11937.95703, best error:     11892.17969 on epoch:    59, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 1035.3100585938s, input_fired_time: 9.2216167450, output_fired_time: 8.6646318436, propagate_forward_time: 400.6989440918, propagate_backward_time: 604.8264160156, weight_update_time: 1.0773679018, other_time: 11.8985595703
epoch time: 560.3459472656s, input_fired_time: 1.1894434690, output_fired_time: 0.0000000000, propagate_forward_time: 557.0551147461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1013793945
validation[          , genome  5887] predictions:    6062/  10000 (60.62%), best:    6038/10000 (60.38%), error:     11988.09570, best error:     11892.17969 on epoch:    59, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 1026.2779541016s, input_fired_time: 9.3132543564, output_fired_time: 8.5946426392, propagate_forward_time: 390.5545349121, propagate_backward_time: 605.3236083984, weight_update_time: 1.0572471619, other_time: 12.4919433594
epoch time: 79.3244934082s, input_fired_time: 1.1765015125, output_fired_time: 0.0000000000, propagate_forward_time: 75.9257125854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2222824097
validation[          , genome  5887] predictions:    6013/  10000 (60.13%), best:    6038/10000 (60.38%), error:     11946.15234, best error:     11892.17969 on epoch:    59, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 1022.2496337891s, input_fired_time: 9.2365436554, output_fired_time: 8.5670633316, propagate_forward_time: 389.4393615723, propagate_backward_time: 602.5572509766, weight_update_time: 1.0672037601, other_time: 12.4493408203
epoch time: 80.2330932617s, input_fired_time: 1.2140632868, output_fired_time: 0.0000000000, propagate_forward_time: 76.7867813110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2322463989
validation[          , genome  5887] predictions:    6109/  10000 (61.09%), best:    6038/10000 (60.38%), error:     11965.27637, best error:     11892.17969 on epoch:    59, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 1026.6195068359s, input_fired_time: 9.2487382889, output_fired_time: 8.5018033981, propagate_forward_time: 389.8316040039, propagate_backward_time: 606.8563842773, weight_update_time: 1.0617464781, other_time: 12.1809692383
epoch time: 81.8496170044s, input_fired_time: 1.2069411278, output_fired_time: 0.0000000000, propagate_forward_time: 78.4251480103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2175292969
validation[          , genome  5887] predictions:    6124/  10000 (61.24%), best:    6038/10000 (60.38%), error:     12089.50293, best error:     11892.17969 on epoch:    59, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 1032.1739501953s, input_fired_time: 9.3169898987, output_fired_time: 8.6071243286, propagate_forward_time: 392.2313537598, propagate_backward_time: 609.7015380859, weight_update_time: 1.0641775131, other_time: 12.3168945313
epoch time: 81.7984466553s, input_fired_time: 1.1872810125, output_fired_time: 0.0000000000, propagate_forward_time: 78.4312133789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1799545288
validation[          , genome  5887] predictions:    5953/  10000 (59.53%), best:    6038/10000 (60.38%), error:     12188.13477, best error:     11892.17969 on epoch:    59, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 1040.8746337891s, input_fired_time: 9.3669948578, output_fired_time: 8.6528797150, propagate_forward_time: 394.7609863281, propagate_backward_time: 615.7365112305, weight_update_time: 1.0623273849, other_time: 12.3572998047
epoch time: 82.1303558350s, input_fired_time: 1.2158776522, output_fired_time: 0.0000000000, propagate_forward_time: 78.7422561646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1722183228
validation[          , genome  5887] predictions:    6088/  10000 (60.88%), best:    6038/10000 (60.38%), error:     11990.96582, best error:     11892.17969 on epoch:    59, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 1031.5709228516s, input_fired_time: 9.3083419800, output_fired_time: 8.5408306122, propagate_forward_time: 391.8116455078, propagate_backward_time: 609.7293090820, weight_update_time: 1.0670020580, other_time: 12.1807861328
epoch time: 81.5126113892s, input_fired_time: 1.1877945662, output_fired_time: 0.0000000000, propagate_forward_time: 78.1944274902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1303863525
validation[          , genome  5887] predictions:    5874/  10000 (58.74%), best:    6038/10000 (60.38%), error:     12660.97852, best error:     11892.17969 on epoch:    59, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 1029.8531494141s, input_fired_time: 9.2706241608, output_fired_time: 8.5216484070, propagate_forward_time: 391.5050048828, propagate_backward_time: 608.3775024414, weight_update_time: 1.0557200909, other_time: 12.1783447266
epoch time: 81.8289184570s, input_fired_time: 1.2071082592, output_fired_time: 0.0000000000, propagate_forward_time: 78.4306411743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1911697388
validation[          , genome  5887] predictions:    6052/  10000 (60.52%), best:    6038/10000 (60.38%), error:     12220.52539, best error:     11892.17969 on epoch:    59, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 1029.3214111328s, input_fired_time: 9.2635984421, output_fired_time: 8.5451431274, propagate_forward_time: 391.0653991699, propagate_backward_time: 608.2723388672, weight_update_time: 1.0510400534, other_time: 12.1749267578
epoch time: 82.3467025757s, input_fired_time: 1.2168464661, output_fired_time: 0.0000000000, propagate_forward_time: 78.9521789551, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1776733398
validation[          , genome  5887] predictions:    6098/  10000 (60.98%), best:    6098/10000 (60.98%), error:     11879.40918, best error:     11879.40918 on epoch:    74, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 1016.7489624023s, input_fired_time: 9.0959415436, output_fired_time: 8.3017654419, propagate_forward_time: 385.6129455566, propagate_backward_time: 601.8858642578, weight_update_time: 1.0438784361, other_time: 11.8524169922
epoch time: 79.4786987305s, input_fired_time: 1.1690664291, output_fired_time: 0.0000000000, propagate_forward_time: 76.1979751587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1116561890
validation[          , genome  5887] predictions:    6097/  10000 (60.97%), best:    6098/10000 (60.98%), error:     11924.91113, best error:     11879.40918 on epoch:    74, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 1026.8187255859s, input_fired_time: 9.2146558762, output_fired_time: 8.4500751495, propagate_forward_time: 389.2786865234, propagate_backward_time: 607.9093017578, weight_update_time: 1.0486187935, other_time: 11.9660034180
epoch time: 81.9705657959s, input_fired_time: 1.2147152424, output_fired_time: 0.0000000000, propagate_forward_time: 78.5825271606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1733245850
validation[          , genome  5887] predictions:    6076/  10000 (60.76%), best:    6098/10000 (60.98%), error:     12012.11914, best error:     11879.40918 on epoch:    74, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 1029.0925292969s, input_fired_time: 9.2249164581, output_fired_time: 8.4470462799, propagate_forward_time: 390.1026000977, propagate_backward_time: 609.2254028320, weight_update_time: 1.0466951132, other_time: 12.0925903320
epoch time: 82.0507888794s, input_fired_time: 1.2069052458, output_fired_time: 0.0000000000, propagate_forward_time: 78.7630157471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0808715820
validation[          , genome  5887] predictions:    6106/  10000 (61.06%), best:    6106/10000 (61.06%), error:     11835.78516, best error:     11835.78516 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 1033.9320068359s, input_fired_time: 9.2420339584, output_fired_time: 8.4650449753, propagate_forward_time: 391.6822509766, propagate_backward_time: 612.3269042969, weight_update_time: 1.0513448715, other_time: 12.2157592773
epoch time: 81.9880523682s, input_fired_time: 1.2152417898, output_fired_time: 0.0000000000, propagate_forward_time: 78.6471405029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1256713867
validation[          , genome  5887] predictions:    6079/  10000 (60.79%), best:    6106/10000 (61.06%), error:     11970.14551, best error:     11835.78516 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 1043.3812255859s, input_fired_time: 9.3423337936, output_fired_time: 8.5518779755, propagate_forward_time: 395.7880859375, propagate_backward_time: 617.8973999023, weight_update_time: 1.0552020073, other_time: 11.8015747070
epoch time: 81.3783874512s, input_fired_time: 1.1944898367, output_fired_time: 0.0000000000, propagate_forward_time: 78.1818161011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0020828247
validation[          , genome  5887] predictions:    6095/  10000 (60.95%), best:    6106/10000 (61.06%), error:     11860.01074, best error:     11835.78516 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1035.4625244141s, input_fired_time: 9.2513027191, output_fired_time: 8.4135599136, propagate_forward_time: 393.1420898438, propagate_backward_time: 612.8203735352, weight_update_time: 1.0496585369, other_time: 11.8351440430
epoch time: 81.5277481079s, input_fired_time: 1.2159994841, output_fired_time: 0.0000000000, propagate_forward_time: 78.1816864014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1300659180
validation[          , genome  5887] predictions:    6074/  10000 (60.74%), best:    6106/10000 (61.06%), error:     12129.30273, best error:     11835.78516 on epoch:    77, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1032.5662841797s, input_fired_time: 9.2055444717, output_fired_time: 8.3861150742, propagate_forward_time: 391.2396545410, propagate_backward_time: 612.1187133789, weight_update_time: 1.0407837629, other_time: 11.6162719727
epoch time: 80.7639617920s, input_fired_time: 1.1784427166, output_fired_time: 0.0000000000, propagate_forward_time: 77.5965881348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9889297485
validation[          , genome  5887] predictions:    6055/  10000 (60.55%), best:    6106/10000 (61.06%), error:     11956.45117, best error:     11835.78516 on epoch:    77, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1036.7686767578s, input_fired_time: 9.1996383667, output_fired_time: 8.3999090195, propagate_forward_time: 392.7145080566, propagate_backward_time: 614.7022094727, weight_update_time: 1.0394430161, other_time: 11.7525024414
epoch time: 85.8582458496s, input_fired_time: 1.2645413876, output_fired_time: 0.0000000000, propagate_forward_time: 82.3275985718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2661056519
validation[          , genome  5887] predictions:    6120/  10000 (61.20%), best:    6106/10000 (61.06%), error:     11931.87305, best error:     11835.78516 on epoch:    77, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 1085.2493896484s, input_fired_time: 9.6675977707, output_fired_time: 8.8231039047, propagate_forward_time: 411.2449035645, propagate_backward_time: 643.0637207031, weight_update_time: 1.0975301266, other_time: 12.4500732422
epoch time: 86.1018905640s, input_fired_time: 1.2773793936, output_fired_time: 0.0000000000, propagate_forward_time: 82.6586380005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1658706665
validation[          , genome  5887] predictions:    6075/  10000 (60.75%), best:    6106/10000 (61.06%), error:     12179.29785, best error:     11835.78516 on epoch:    77, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 1132.3031005859s, input_fired_time: 9.9980697632, output_fired_time: 9.3752031326, propagate_forward_time: 439.1576538086, propagate_backward_time: 660.8467407227, weight_update_time: 1.1922371387, other_time: 12.9254150391
epoch time: 94.4355239868s, input_fired_time: 1.3314013481, output_fired_time: 0.0000000000, propagate_forward_time: 90.7165374756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3875885010
validation[          , genome  5887] predictions:    6080/  10000 (60.80%), best:    6106/10000 (61.06%), error:     12082.92285, best error:     11835.78516 on epoch:    77, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 1159.8402099609s, input_fired_time: 10.1928272247, output_fired_time: 9.7448167801, propagate_forward_time: 452.9801635742, propagate_backward_time: 673.5565795898, weight_update_time: 1.1512752771, other_time: 13.3657226563
epoch time: 96.6621475220s, input_fired_time: 1.3394035101, output_fired_time: 0.0000000000, propagate_forward_time: 92.9373931885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3853530884
validation[          , genome  5887] predictions:    6106/  10000 (61.06%), best:    6106/10000 (61.06%), error:     11950.82129, best error:     11835.78516 on epoch:    77, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 1171.0955810547s, input_fired_time: 10.3535079956, output_fired_time: 9.7560176849, propagate_forward_time: 458.0747375488, propagate_backward_time: 679.4832153320, weight_update_time: 1.2245746851, other_time: 13.4281616211
epoch time: 94.2192764282s, input_fired_time: 1.2498874664, output_fired_time: 0.0000000000, propagate_forward_time: 90.7517089844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2176818848
validation[          , genome  5887] predictions:    6173/  10000 (61.73%), best:    6106/10000 (61.06%), error:     11895.04688, best error:     11835.78516 on epoch:    77, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 1153.1895751953s, input_fired_time: 10.2286500931, output_fired_time: 9.6511173248, propagate_forward_time: 451.7707519531, propagate_backward_time: 668.4904785156, weight_update_time: 1.2189542055, other_time: 13.0485839844
epoch time: 94.8504943848s, input_fired_time: 1.2948148251, output_fired_time: 0.0000000000, propagate_forward_time: 91.2373352051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3183441162
validation[          , genome  5887] predictions:    6097/  10000 (60.97%), best:    6106/10000 (61.06%), error:     12145.74316, best error:     11835.78516 on epoch:    77, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 1125.1768798828s, input_fired_time: 9.9550905228, output_fired_time: 9.4700374603, propagate_forward_time: 441.0421752930, propagate_backward_time: 652.1408081055, weight_update_time: 1.0927250385, other_time: 12.5687255859
epoch time: 86.8115844727s, input_fired_time: 1.1804364920, output_fired_time: 0.0000000000, propagate_forward_time: 83.6347427368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9964065552
validation[          , genome  5887] predictions:    6118/  10000 (61.18%), best:    6106/10000 (61.06%), error:     12016.88770, best error:     11835.78516 on epoch:    77, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1054.5627441406s, input_fired_time: 9.3299932480, output_fired_time: 8.8277196884, propagate_forward_time: 411.6569213867, propagate_backward_time: 613.0767211914, weight_update_time: 1.0628911257, other_time: 11.6713867188
epoch time: 85.0784072876s, input_fired_time: 1.1937328577, output_fired_time: 0.0000000000, propagate_forward_time: 81.8020248413, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0826492310
validation[          , genome  5887] predictions:    6127/  10000 (61.27%), best:    6106/10000 (61.06%), error:     11898.05469, best error:     11835.78516 on epoch:    77, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1067.6864013672s, input_fired_time: 9.5022563934, output_fired_time: 8.9245996475, propagate_forward_time: 417.8370971680, propagate_backward_time: 619.4390258789, weight_update_time: 1.0902012587, other_time: 11.9835205078
epoch time: 86.2139663696s, input_fired_time: 1.2040505409, output_fired_time: 0.0000000000, propagate_forward_time: 82.9058837891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1040344238
validation[          , genome  5887] predictions:    6169/  10000 (61.69%), best:    6106/10000 (61.06%), error:     11847.22852, best error:     11835.78516 on epoch:    77, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 1066.8044433594s, input_fired_time: 9.4274930954, output_fired_time: 8.9155502319, propagate_forward_time: 418.0500183105, propagate_backward_time: 618.6054687500, weight_update_time: 1.0707613230, other_time: 11.8059082031
epoch time: 86.0329971313s, input_fired_time: 1.2007343769, output_fired_time: 0.0000000000, propagate_forward_time: 82.7764358521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0558242798
validation[          , genome  5887] predictions:    6113/  10000 (61.13%), best:    6106/10000 (61.06%), error:     11930.28809, best error:     11835.78516 on epoch:    77, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1061.7203369141s, input_fired_time: 9.4475307465, output_fired_time: 8.9289951324, propagate_forward_time: 415.1297912598, propagate_backward_time: 616.2330322266, weight_update_time: 1.0679980516, other_time: 11.9810791016
epoch time: 85.2800292969s, input_fired_time: 1.2027996778, output_fired_time: 0.0000000000, propagate_forward_time: 81.9495315552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1277008057
validation[          , genome  5887] predictions:    6111/  10000 (61.11%), best:    6106/10000 (61.06%), error:     12038.56348, best error:     11835.78516 on epoch:    77, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1055.0883789063s, input_fired_time: 9.4454641342, output_fired_time: 8.8125953674, propagate_forward_time: 410.5079345703, propagate_backward_time: 614.2211303711, weight_update_time: 1.0763287544, other_time: 12.1012573242
epoch time: 83.8000793457s, input_fired_time: 1.2296682596, output_fired_time: 0.0000000000, propagate_forward_time: 80.4378128052, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1325988770
validation[          , genome  5887] predictions:    6126/  10000 (61.26%), best:    6126/10000 (61.26%), error:     11814.22559, best error:     11814.22559 on epoch:    93, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1045.7686767578s, input_fired_time: 9.3971614838, output_fired_time: 8.6839828491, propagate_forward_time: 405.2588500977, propagate_backward_time: 610.5226440430, weight_update_time: 1.0594608784, other_time: 11.9060058594
epoch time: 83.8180313110s, input_fired_time: 1.2011976242, output_fired_time: 0.0000000000, propagate_forward_time: 80.5174942017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0993423462
validation[          , genome  5887] predictions:    6102/  10000 (61.02%), best:    6126/10000 (61.26%), error:     12028.80566, best error:     11814.22559 on epoch:    93, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1042.1269531250s, input_fired_time: 9.3291406631, output_fired_time: 8.6161298752, propagate_forward_time: 403.6238403320, propagate_backward_time: 608.8170166016, weight_update_time: 1.0542526245, other_time: 11.7409057617
epoch time: 86.0136108398s, input_fired_time: 1.2102499008, output_fired_time: 0.0000000000, propagate_forward_time: 82.7705307007, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0328292847
validation[          , genome  5887] predictions:    6174/  10000 (61.74%), best:    6126/10000 (61.26%), error:     11906.78906, best error:     11814.22559 on epoch:    93, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1047.6097412109s, input_fired_time: 9.3316202164, output_fired_time: 8.7338895798, propagate_forward_time: 407.7840576172, propagate_backward_time: 609.9029541016, weight_update_time: 1.0596079826, other_time: 11.8571777344
epoch time: 86.4590225220s, input_fired_time: 1.2119065523, output_fired_time: 0.0000000000, propagate_forward_time: 83.1206741333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1264419556
validation[          , genome  5887] predictions:    6115/  10000 (61.15%), best:    6126/10000 (61.26%), error:     11975.02148, best error:     11814.22559 on epoch:    93, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1070.5019531250s, input_fired_time: 9.6153831482, output_fired_time: 8.9875135422, propagate_forward_time: 415.0116577148, propagate_backward_time: 624.6947631836, weight_update_time: 1.0893768072, other_time: 12.1926269531
epoch time: 84.8751907349s, input_fired_time: 1.1941692829, output_fired_time: 0.0000000000, propagate_forward_time: 81.6437225342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0373001099
validation[          , genome  5887] predictions:    6165/  10000 (61.65%), best:    6165/10000 (61.65%), error:     11759.50586, best error:     11759.50586 on epoch:    97, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1059.0915527344s, input_fired_time: 9.4976787567, output_fired_time: 8.8329515457, propagate_forward_time: 412.4822082520, propagate_backward_time: 616.3292846680, weight_update_time: 1.0656824112, other_time: 11.9494018555
epoch time: 86.9740295410s, input_fired_time: 1.2260605097, output_fired_time: 0.0000000000, propagate_forward_time: 83.5698471069, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1781234741
validation[          , genome  5887] predictions:    6127/  10000 (61.27%), best:    6165/10000 (61.65%), error:     11888.10449, best error:     11759.50586 on epoch:    97, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1077.7968750000s, input_fired_time: 9.6531133652, output_fired_time: 8.9887046814, propagate_forward_time: 417.7297363281, propagate_backward_time: 629.0297851563, weight_update_time: 1.1339828968, other_time: 12.3956298828
epoch time: 87.8862228394s, input_fired_time: 1.1813147068, output_fired_time: 0.0000000000, propagate_forward_time: 84.6623611450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0425491333
validation[          , genome  5887] predictions:    6149/  10000 (61.49%), best:    6165/10000 (61.65%), error:     11938.80273, best error:     11759.50586 on epoch:    97, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1063.7517089844s, input_fired_time: 9.3616142273, output_fired_time: 8.8536453247, propagate_forward_time: 416.3384704590, propagate_backward_time: 617.3040161133, weight_update_time: 1.0619642735, other_time: 11.8939819336
epoch time: 86.3784332275s, input_fired_time: 1.1763309240, output_fired_time: 0.0000000000, propagate_forward_time: 83.1195220947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0825805664
validation[          , genome  5887] predictions:    6087/  10000 (60.87%), best:    6165/10000 (61.65%), error:     11982.02539, best error:     11759.50586 on epoch:    97, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 431.8413085938s, input_fired_time: 5.8552174568, output_fired_time: 0.0000000000, propagate_forward_time: 415.4047241211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.5813598633
best training[          , genome  5887] predictions:   40401/  50000 (80.80%), best:    6165/10000 (61.65%), error:     29694.32422, best error:     11759.50586 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 85.2631759644s, input_fired_time: 1.1590230465, output_fired_time: 0.0000000000, propagate_forward_time: 82.1262893677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9778671265
   testing[          , genome  5887] predictions:    6165/  10000 (61.65%), best:    6165/10000 (61.65%), error:     11759.50586, best error:     11759.50586 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
01:18:46 (1692): called boinc_finish(0)

</stderr_txt>
]]>