Nameexact_genome_1542069603_188_5744_3
Workunit4085157
Created1 Mar 2019, 17:55:15 UTC
Sent1 Mar 2019, 18:02:36 UTC
Report deadline9 Jun 2019, 10:31:31 UTC
Received2 Mar 2019, 18:56:43 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID80138
Run time1 days 0 hours 49 min 52 sec
CPU time1 days 0 hours 41 min 45 sec
Validate stateValid
Credit24,921.69
Device peak FLOPS4.52 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size544.52 MB
Peak swap size564.38 MB
Peak disk usage12.13 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
, best:    6122/10000 (61.22%), error:     11226.35254, best error:     11226.35254 on epoch:    21, epoch:   21/100, mu: 0.8155557513, learning_rate: 0.0002622913, weight_decay: 0.0001391232

epoch time: 838.0652465820s, input_fired_time: 15.2971372604, output_fired_time: 5.1049752235, propagate_forward_time: 239.3441162109, propagate_backward_time: 570.3670043945, weight_update_time: 0.2869359553, other_time: 7.9520263672
epoch time: 49.9584655762s, input_fired_time: 0.8991371989, output_fired_time: 0.0000000000, propagate_forward_time: 47.8099746704, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2493553162
validation[          , genome  5744] predictions:    6054/  10000 (60.54%), best:    6122/10000 (61.22%), error:     11387.53027, best error:     11226.35254 on epoch:    21, epoch:   22/100, mu: 0.8236784935, learning_rate: 0.0002444643, weight_decay: 0.0001307958

epoch time: 838.1762084961s, input_fired_time: 15.3148298264, output_fired_time: 5.1036901474, propagate_forward_time: 239.3384704590, propagate_backward_time: 570.4143676758, weight_update_time: 0.2881749272, other_time: 8.0048217773
epoch time: 49.9807624817s, input_fired_time: 0.9006946087, output_fired_time: 0.0000000000, propagate_forward_time: 47.8362579346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2438087463
validation[          , genome  5744] predictions:    6107/  10000 (61.07%), best:    6107/10000 (61.07%), error:     11138.81836, best error:     11138.81836 on epoch:    23, epoch:   23/100, mu: 0.8314230442, learning_rate: 0.0002278490, weight_decay: 0.0001229668

epoch time: 838.3981323242s, input_fired_time: 15.3224802017, output_fired_time: 5.1114373207, propagate_forward_time: 239.3740234375, propagate_backward_time: 570.5816650391, weight_update_time: 0.2895331979, other_time: 8.0084838867
epoch time: 49.9843101501s, input_fired_time: 0.9133278131, output_fired_time: 0.0000000000, propagate_forward_time: 47.8234596252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2475242615
validation[          , genome  5744] predictions:    6158/  10000 (61.58%), best:    6158/10000 (61.58%), error:     10982.63574, best error:     10982.63574 on epoch:    24, epoch:   24/100, mu: 0.8388069272, learning_rate: 0.0002123630, weight_decay: 0.0001156064

epoch time: 838.1787719727s, input_fired_time: 15.3279781342, output_fired_time: 5.1100726128, propagate_forward_time: 239.2840881348, propagate_backward_time: 570.4736328125, weight_update_time: 0.2886558175, other_time: 7.9830322266
epoch time: 49.9475669861s, input_fired_time: 0.9145308137, output_fired_time: 0.0000000000, propagate_forward_time: 47.7871398926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2458953857
validation[          , genome  5744] predictions:    6192/  10000 (61.92%), best:    6158/10000 (61.58%), error:     11029.17969, best error:     10982.63574 on epoch:    24, epoch:   25/100, mu: 0.8458470106, learning_rate: 0.0001979295, weight_decay: 0.0001086866

epoch time: 838.5933837891s, input_fired_time: 15.3408498764, output_fired_time: 5.1196904182, propagate_forward_time: 239.4646148682, propagate_backward_time: 570.6727294922, weight_update_time: 0.2871612906, other_time: 7.9955444336
epoch time: 49.9875946045s, input_fired_time: 0.9096553922, output_fired_time: 0.0000000000, propagate_forward_time: 47.8361167908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2418212891
validation[          , genome  5744] predictions:    6235/  10000 (62.35%), best:    6235/10000 (62.35%), error:     10946.18555, best error:     10946.18555 on epoch:    26, epoch:   26/100, mu: 0.8525592685, learning_rate: 0.0001844769, weight_decay: 0.0001021810

epoch time: 838.3643798828s, input_fired_time: 15.3469247818, output_fired_time: 5.1045188904, propagate_forward_time: 239.3175201416, propagate_backward_time: 570.5673828125, weight_update_time: 0.2878281772, other_time: 8.0280761719
epoch time: 49.9659881592s, input_fired_time: 0.9114559293, output_fired_time: 0.0000000000, propagate_forward_time: 47.8070640564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2474670410
validation[          , genome  5744] predictions:    6137/  10000 (61.37%), best:    6235/10000 (62.35%), error:     11157.64063, best error:     10946.18555 on epoch:    26, epoch:   27/100, mu: 0.8589590192, learning_rate: 0.0001719387, weight_decay: 0.0000960648

epoch time: 838.2989501953s, input_fired_time: 15.3555965424, output_fired_time: 5.1092376709, propagate_forward_time: 239.1596374512, propagate_backward_time: 570.6985473633, weight_update_time: 0.2887531221, other_time: 7.9758911133
epoch time: 49.9442825317s, input_fired_time: 0.9188210964, output_fired_time: 0.0000000000, propagate_forward_time: 47.7831420898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2423210144
validation[          , genome  5744] predictions:    6088/  10000 (60.88%), best:    6235/10000 (62.35%), error:     11275.35254, best error:     10946.18555 on epoch:    26, epoch:   28/100, mu: 0.8650607467, learning_rate: 0.0001602527, weight_decay: 0.0000903147

epoch time: 838.4736328125s, input_fired_time: 15.3692369461, output_fired_time: 5.1094913483, propagate_forward_time: 239.2666625977, propagate_backward_time: 570.7178955078, weight_update_time: 0.2884403467, other_time: 8.0103149414
epoch time: 49.9525833130s, input_fired_time: 0.9224177003, output_fired_time: 0.0000000000, propagate_forward_time: 47.7851638794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2450027466
validation[          , genome  5744] predictions:    6313/  10000 (63.13%), best:    6313/10000 (63.13%), error:     10749.35938, best error:     10749.35938 on epoch:    29, epoch:   29/100, mu: 0.8708783388, learning_rate: 0.0001493609, weight_decay: 0.0000849088

epoch time: 838.5812988281s, input_fired_time: 15.3675394058, output_fired_time: 5.1165227890, propagate_forward_time: 239.4623260498, propagate_backward_time: 570.6181030273, weight_update_time: 0.2874201834, other_time: 8.0167846680
epoch time: 49.9863739014s, input_fired_time: 0.9169675112, output_fired_time: 0.0000000000, propagate_forward_time: 47.8233642578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2460403442
validation[          , genome  5744] predictions:    6111/  10000 (61.11%), best:    6313/10000 (63.13%), error:     11151.51953, best error:     10749.35938 on epoch:    29, epoch:   30/100, mu: 0.8764250875, learning_rate: 0.0001392094, weight_decay: 0.0000798265

epoch time: 838.4593505859s, input_fired_time: 15.3873777390, output_fired_time: 5.1210470200, propagate_forward_time: 239.3097839355, propagate_backward_time: 570.6316528320, weight_update_time: 0.2873710990, other_time: 8.0094604492
epoch time: 50.0560913086s, input_fired_time: 0.9249942303, output_fired_time: 0.0000000000, propagate_forward_time: 47.8827362061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2483596802
validation[          , genome  5744] predictions:    6275/  10000 (62.75%), best:    6313/10000 (63.13%), error:     10757.96875, best error:     10749.35938 on epoch:    29, epoch:   31/100, mu: 0.8817135692, learning_rate: 0.0001297479, weight_decay: 0.0000750483

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_3_r591053034_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.886756
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 0.000120929
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 7.05562e-05
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 32
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 29
read number_validation_images: 10000
read best_validation_predictions: 6313
read best_validation_error: 10749.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '238791687'
read generator: 238791687
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 824.909606933594s, input_fired_time: 15.1258430480957, output_fired_time: 5.04798316955566, propagate_forward_time: 235.232620239258, propagate_backward_time: 562.005004882813, weight_update_time: 0.281312793493271, other_time: 7.4981689453125
epoch time: 49.1397933959961s, input_fired_time: 0.90177458524704, output_fired_time: 0, propagate_forward_time: 46.9940719604492, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.24394607543945
validation[          , genome  5744] predictions:    6190/  10000 (61.90%), best:    6313/10000 (63.13%), error:     11037.84961, best error:     10749.35938 on epoch:    29, epoch:   32/100, mu: 0.8867557645, learning_rate: 0.0001209294, weight_decay: 0.0000705562

epoch time: 824.7663574219s, input_fired_time: 15.1338005066, output_fired_time: 5.0191259384, propagate_forward_time: 235.4736480713, propagate_backward_time: 561.2984008789, weight_update_time: 0.2795705497, other_time: 7.8414306641
epoch time: 49.1507186890s, input_fired_time: 0.9126011133, output_fired_time: 0.0000000000, propagate_forward_time: 46.9905052185, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2476119995
validation[          , genome  5744] predictions:    6237/  10000 (62.37%), best:    6313/10000 (63.13%), error:     10811.75684, best error:     10749.35938 on epoch:    29, epoch:   33/100, mu: 0.8915631771, learning_rate: 0.0001127103, weight_decay: 0.0000663330

epoch time: 823.5860595703s, input_fired_time: 15.1290445328, output_fired_time: 5.0232043266, propagate_forward_time: 235.0981903076, propagate_backward_time: 560.4431762695, weight_update_time: 0.2791824639, other_time: 7.8924560547
epoch time: 49.1206283569s, input_fired_time: 0.9045171738, output_fired_time: 0.0000000000, propagate_forward_time: 46.9685821533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2475280762
validation[          , genome  5744] predictions:    6198/  10000 (61.98%), best:    6313/10000 (63.13%), error:     10955.19434, best error:     10749.35938 on epoch:    29, epoch:   34/100, mu: 0.8961467743, learning_rate: 0.0001050498, weight_decay: 0.0000623625

epoch time: 823.9733276367s, input_fired_time: 15.1333761215, output_fired_time: 5.0217657089, propagate_forward_time: 235.1710662842, propagate_backward_time: 560.8375854492, weight_update_time: 0.2785576880, other_time: 7.8095092773
epoch time: 49.1717224121s, input_fired_time: 0.9059482217, output_fired_time: 0.0000000000, propagate_forward_time: 47.0235939026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2421798706
validation[          , genome  5744] predictions:    6141/  10000 (61.41%), best:    6313/10000 (63.13%), error:     11052.63770, best error:     10749.35938 on epoch:    29, epoch:   35/100, mu: 0.9005169272, learning_rate: 0.0000979100, weight_decay: 0.0000586297

epoch time: 824.1326904297s, input_fired_time: 15.1402397156, output_fired_time: 5.0113816261, propagate_forward_time: 235.2870635986, propagate_backward_time: 560.7902221680, weight_update_time: 0.2792371213, other_time: 7.9038085938
epoch time: 49.1308898926s, input_fired_time: 0.9157849550, output_fired_time: 0.0000000000, propagate_forward_time: 46.9677734375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2473297119
validation[          , genome  5744] predictions:    6302/  10000 (63.02%), best:    6302/10000 (63.02%), error:     10719.26953, best error:     10719.26953 on epoch:    36, epoch:   36/100, mu: 0.9046835899, learning_rate: 0.0000912554, weight_decay: 0.0000551203

epoch time: 823.8150634766s, input_fired_time: 15.1443586349, output_fired_time: 5.0154294968, propagate_forward_time: 235.1120605469, propagate_backward_time: 560.7116088867, weight_update_time: 0.2812316418, other_time: 7.8316040039
epoch time: 49.0976257324s, input_fired_time: 0.9158731103, output_fired_time: 0.0000000000, propagate_forward_time: 46.9384384155, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2433128357
validation[          , genome  5744] predictions:    6268/  10000 (62.68%), best:    6302/10000 (63.02%), error:     10731.27344, best error:     10719.26953 on epoch:    36, epoch:   37/100, mu: 0.9086562395, learning_rate: 0.0000850531, weight_decay: 0.0000518210

epoch time: 824.3469238281s, input_fired_time: 15.1550788879, output_fired_time: 5.0183415413, propagate_forward_time: 235.1593017578, propagate_backward_time: 561.1364135742, weight_update_time: 0.2813673019, other_time: 7.8777465820
epoch time: 49.0780715942s, input_fired_time: 0.9137303829, output_fired_time: 0.0000000000, propagate_forward_time: 46.9227752686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2415657043
validation[          , genome  5744] predictions:    6317/  10000 (63.17%), best:    6317/10000 (63.17%), error:     10689.13965, best error:     10689.13965 on epoch:    38, epoch:   38/100, mu: 0.9124438763, learning_rate: 0.0000792724, weight_decay: 0.0000487192

epoch time: 823.7623291016s, input_fired_time: 15.1882133484, output_fired_time: 5.0193767548, propagate_forward_time: 235.3183288574, propagate_backward_time: 560.3828735352, weight_update_time: 0.2808707654, other_time: 7.8535766602
epoch time: 49.1246681213s, input_fired_time: 0.9249576330, output_fired_time: 0.0000000000, propagate_forward_time: 46.9550247192, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2446861267
validation[          , genome  5744] predictions:    6363/  10000 (63.63%), best:    6363/10000 (63.63%), error:     10466.80176, best error:     10466.80176 on epoch:    39, epoch:   39/100, mu: 0.9160551429, learning_rate: 0.0000738845, weight_decay: 0.0000458030

epoch time: 824.9066772461s, input_fired_time: 15.2014350891, output_fired_time: 5.0219774246, propagate_forward_time: 235.4865875244, propagate_backward_time: 561.3154907227, weight_update_time: 0.2801827192, other_time: 7.8812255859
epoch time: 49.1125411987s, input_fired_time: 0.9161536098, output_fired_time: 0.0000000000, propagate_forward_time: 46.9614219666, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2349662781
validation[          , genome  5744] predictions:    6252/  10000 (62.52%), best:    6363/10000 (63.63%), error:     10751.87891, best error:     10466.80176 on epoch:    39, epoch:   40/100, mu: 0.9194982648, learning_rate: 0.0000688629, weight_decay: 0.0000430614

epoch time: 823.8235473633s, input_fired_time: 15.1799325943, output_fired_time: 5.0194621086, propagate_forward_time: 235.0905151367, propagate_backward_time: 560.6656494141, weight_update_time: 0.2799481750, other_time: 7.8679809570
epoch time: 49.1224899292s, input_fired_time: 0.9222993255, output_fired_time: 0.0000000000, propagate_forward_time: 46.9526710510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2475204468
validation[          , genome  5744] predictions:    6272/  10000 (62.72%), best:    6363/10000 (63.63%), error:     10655.27051, best error:     10466.80176 on epoch:    39, epoch:   41/100, mu: 0.9227810502, learning_rate: 0.0000641825, weight_decay: 0.0000404839

epoch time: 824.3322143555s, input_fired_time: 15.2014923096, output_fired_time: 5.0233020782, propagate_forward_time: 235.3213043213, propagate_backward_time: 560.8808593750, weight_update_time: 0.2805083096, other_time: 7.9052734375
epoch time: 49.1059799194s, input_fired_time: 0.9216904640, output_fired_time: 0.0000000000, propagate_forward_time: 46.9404983521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2437896729
validation[          , genome  5744] predictions:    6346/  10000 (63.46%), best:    6346/10000 (63.46%), error:     10434.28516, best error:     10434.28516 on epoch:    42, epoch:   42/100, mu: 0.9259110093, learning_rate: 0.0000598203, weight_decay: 0.0000380607

epoch time: 824.4620971680s, input_fired_time: 15.1949434280, output_fired_time: 5.0205783844, propagate_forward_time: 235.2249145508, propagate_backward_time: 561.1770629883, weight_update_time: 0.2803466022, other_time: 7.8446044922
epoch time: 49.2008209229s, input_fired_time: 0.9215145707, output_fired_time: 0.0000000000, propagate_forward_time: 47.0486907959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2306137085
validation[          , genome  5744] predictions:    6240/  10000 (62.40%), best:    6346/10000 (63.46%), error:     10764.68164, best error:     10434.28516 on epoch:    42, epoch:   43/100, mu: 0.9288952351, learning_rate: 0.0000557545, weight_decay: 0.0000357825

epoch time: 826.3720703125s, input_fired_time: 15.2329111099, output_fired_time: 5.0292034149, propagate_forward_time: 235.8609771729, propagate_backward_time: 562.3890380859, weight_update_time: 0.2807826996, other_time: 7.8599853516
epoch time: 49.2579231262s, input_fired_time: 0.9254819751, output_fired_time: 0.0000000000, propagate_forward_time: 47.0978584290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2345809937
validation[          , genome  5744] predictions:    6342/  10000 (63.42%), best:    6346/10000 (63.46%), error:     10558.11719, best error:     10434.28516 on epoch:    42, epoch:   44/100, mu: 0.9317404628, learning_rate: 0.0000519651, weight_decay: 0.0000336407

epoch time: 825.3187255859s, input_fired_time: 15.2203273773, output_fired_time: 5.0228848457, propagate_forward_time: 235.4281463623, propagate_backward_time: 561.8395385742, weight_update_time: 0.2793281674, other_time: 7.8078002930
epoch time: 49.2747421265s, input_fired_time: 0.9181510806, output_fired_time: 0.0000000000, propagate_forward_time: 47.1252059937, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2313842773
validation[          , genome  5744] predictions:    6327/  10000 (63.27%), best:    6346/10000 (63.46%), error:     10600.71289, best error:     10434.28516 on epoch:    42, epoch:   45/100, mu: 0.9344532490, learning_rate: 0.0000484332, weight_decay: 0.0000316271

epoch time: 825.5661010742s, input_fired_time: 15.2446756363, output_fired_time: 5.0256237984, propagate_forward_time: 235.8228149414, propagate_backward_time: 561.5851440430, weight_update_time: 0.2809907496, other_time: 7.8878173828
epoch time: 49.3169059753s, input_fired_time: 0.9290588498, output_fired_time: 0.0000000000, propagate_forward_time: 47.1463432312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2415046692
validation[          , genome  5744] predictions:    6331/  10000 (63.31%), best:    6346/10000 (63.46%), error:     10605.87598, best error:     10434.28516 on epoch:    42, epoch:   46/100, mu: 0.9370397329, learning_rate: 0.0000451414, weight_decay: 0.0000297340

epoch time: 825.3880004883s, input_fired_time: 15.2488393784, output_fired_time: 5.0326867104, propagate_forward_time: 235.6355133057, propagate_backward_time: 561.6298828125, weight_update_time: 0.2799036503, other_time: 7.8410644531
epoch time: 49.0786895752s, input_fired_time: 0.9179549217, output_fired_time: 0.0000000000, propagate_forward_time: 46.9256324768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2351036072
validation[          , genome  5744] predictions:    6372/  10000 (63.72%), best:    6346/10000 (63.46%), error:     10538.12598, best error:     10434.28516 on epoch:    42, epoch:   47/100, mu: 0.9395057559, learning_rate: 0.0000420733, weight_decay: 0.0000279542

epoch time: 825.4697265625s, input_fired_time: 15.2493934631, output_fired_time: 5.0300326347, propagate_forward_time: 235.6558685303, propagate_backward_time: 561.7155151367, weight_update_time: 0.2816888392, other_time: 7.8189086914
epoch time: 49.2370300293s, input_fired_time: 0.9296851754, output_fired_time: 0.0000000000, propagate_forward_time: 47.0692062378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2381401062
validation[          , genome  5744] predictions:    6390/  10000 (63.90%), best:    6390/10000 (63.90%), error:     10379.13965, best error:     10379.13965 on epoch:    48, epoch:   48/100, mu: 0.9418569207, learning_rate: 0.0000392138, weight_decay: 0.0000262810

epoch time: 825.4509887695s, input_fired_time: 15.2567949295, output_fired_time: 5.0283174515, propagate_forward_time: 235.7228851318, propagate_backward_time: 561.5579833984, weight_update_time: 0.2814783752, other_time: 7.8850097656
epoch time: 49.3141555786s, input_fired_time: 0.9301999211, output_fired_time: 0.0000000000, propagate_forward_time: 47.1468772888, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2370796204
validation[          , genome  5744] predictions:    6385/  10000 (63.85%), best:    6390/10000 (63.90%), error:     10394.30859, best error:     10379.13965 on epoch:    48, epoch:   49/100, mu: 0.9440986514, learning_rate: 0.0000365485, weight_decay: 0.0000247079

epoch time: 825.2191162109s, input_fired_time: 15.2394418716, output_fired_time: 5.0216279030, propagate_forward_time: 235.4148254395, propagate_backward_time: 561.6538085938, weight_update_time: 0.2809614539, other_time: 7.8894042969
epoch time: 49.1913299561s, input_fired_time: 0.9270070195, output_fired_time: 0.0000000000, propagate_forward_time: 47.0196228027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2447013855
validation[          , genome  5744] predictions:    6387/  10000 (63.87%), best:    6387/10000 (63.87%), error:     10368.16602, best error:     10368.16602 on epoch:    50, epoch:   50/100, mu: 0.9462359548, learning_rate: 0.0000340645, weight_decay: 0.0000232290

epoch time: 825.3628540039s, input_fired_time: 15.2525243759, output_fired_time: 5.0172982216, propagate_forward_time: 235.5628509521, propagate_backward_time: 561.6402587891, weight_update_time: 0.2811223269, other_time: 7.8899536133
epoch time: 49.2327003479s, input_fired_time: 0.9289829135, output_fired_time: 0.0000000000, propagate_forward_time: 47.0701942444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2335243225
validation[          , genome  5744] predictions:    6406/  10000 (64.06%), best:    6406/10000 (64.06%), error:     10267.90527, best error:     10267.90527 on epoch:    51, epoch:   51/100, mu: 0.9482737780, learning_rate: 0.0000317492, weight_decay: 0.0000218386

epoch time: 825.2225341797s, input_fired_time: 15.2531394958, output_fired_time: 5.0310077667, propagate_forward_time: 235.4811096191, propagate_backward_time: 561.5937500000, weight_update_time: 0.2811298668, other_time: 7.8635253906
epoch time: 49.1951484680s, input_fired_time: 0.9287197590, output_fired_time: 0.0000000000, propagate_forward_time: 47.0328712463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2335586548
validation[          , genome  5744] predictions:    6249/  10000 (62.49%), best:    6406/10000 (64.06%), error:     10607.48730, best error:     10267.90527 on epoch:    51, epoch:   52/100, mu: 0.9502167106, learning_rate: 0.0000295914, weight_decay: 0.0000205314

epoch time: 825.1697387695s, input_fired_time: 15.2688589096, output_fired_time: 5.0273060799, propagate_forward_time: 235.4147796631, propagate_backward_time: 561.5806884766, weight_update_time: 0.2811922729, other_time: 7.8781127930
epoch time: 49.2069435120s, input_fired_time: 0.9352309108, output_fired_time: 0.0000000000, propagate_forward_time: 47.0351486206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2365646362
validation[          , genome  5744] predictions:    6449/  10000 (64.49%), best:    6449/10000 (64.49%), error:     10257.08398, best error:     10257.08398 on epoch:    53, epoch:   53/100, mu: 0.9520691633, learning_rate: 0.0000275801, weight_decay: 0.0000193025

epoch time: 825.9604492188s, input_fired_time: 15.2922868729, output_fired_time: 5.0333623886, propagate_forward_time: 235.8841705322, propagate_backward_time: 561.9155273438, weight_update_time: 0.2823601365, other_time: 7.8350830078
epoch time: 49.2399482727s, input_fired_time: 0.9322385788, output_fired_time: 0.0000000000, propagate_forward_time: 47.0600242615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2476844788
validation[          , genome  5744] predictions:    6417/  10000 (64.17%), best:    6449/10000 (64.49%), error:     10297.26074, best error:     10257.08398 on epoch:    53, epoch:   54/100, mu: 0.9538353682, learning_rate: 0.0000257056, weight_decay: 0.0000181471

epoch time: 825.3419189453s, input_fired_time: 15.2745676041, output_fired_time: 5.0350666046, propagate_forward_time: 235.4288024902, propagate_backward_time: 561.7214965820, weight_update_time: 0.2811226845, other_time: 7.8818969727
epoch time: 49.2595558167s, input_fired_time: 0.9341757894, output_fired_time: 0.0000000000, propagate_forward_time: 47.0853118896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2400665283
validation[          , genome  5744] predictions:    6416/  10000 (64.16%), best:    6416/10000 (64.16%), error:     10234.33789, best error:     10234.33789 on epoch:    55, epoch:   55/100, mu: 0.9555193186, learning_rate: 0.0000239585, weight_decay: 0.0000170609

epoch time: 825.6976318359s, input_fired_time: 15.2801170349, output_fired_time: 5.0281147957, propagate_forward_time: 235.6752929688, propagate_backward_time: 561.8164062500, weight_update_time: 0.2822740078, other_time: 7.8977050781
epoch time: 49.1973609924s, input_fired_time: 0.9327370524, output_fired_time: 0.0000000000, propagate_forward_time: 47.0184822083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2461433411
validation[          , genome  5744] predictions:    6464/  10000 (64.64%), best:    6464/10000 (64.64%), error:     10123.06738, best error:     10123.06738 on epoch:    56, epoch:   56/100, mu: 0.9571248889, learning_rate: 0.0000223301, weight_decay: 0.0000160397

epoch time: 825.4671020508s, input_fired_time: 15.2940034866, output_fired_time: 5.0293140411, propagate_forward_time: 235.6208343506, propagate_backward_time: 561.6713867188, weight_update_time: 0.2821945548, other_time: 7.8515625000
epoch time: 49.2293128967s, input_fired_time: 0.9393303990, output_fired_time: 0.0000000000, propagate_forward_time: 47.0391502380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2508316040
validation[          , genome  5744] predictions:    6465/  10000 (64.65%), best:    6464/10000 (64.64%), error:     10160.48340, best error:     10123.06738 on epoch:    56, epoch:   57/100, mu: 0.9586556554, learning_rate: 0.0000208125, weight_decay: 0.0000150796

epoch time: 825.0857543945s, input_fired_time: 15.2976493835, output_fired_time: 5.0227761269, propagate_forward_time: 235.5854339600, propagate_backward_time: 561.3320922852, weight_update_time: 0.2825374603, other_time: 7.8477783203
epoch time: 49.1652107239s, input_fired_time: 0.9376832247, output_fired_time: 0.0000000000, propagate_forward_time: 46.9859657288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2415618896
validation[          , genome  5744] predictions:    6536/  10000 (65.36%), best:    6536/10000 (65.36%), error:     10078.18750, best error:     10078.18750 on epoch:    58, epoch:   58/100, mu: 0.9601151347, learning_rate: 0.0000193979, weight_decay: 0.0000141770

epoch time: 824.4361572266s, input_fired_time: 15.2767238617, output_fired_time: 5.0181760788, propagate_forward_time: 235.2823333740, propagate_backward_time: 560.9419555664, weight_update_time: 0.2825284302, other_time: 7.9169311523
epoch time: 49.1148223877s, input_fired_time: 0.9416648149, output_fired_time: 0.0000000000, propagate_forward_time: 46.9312973022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2418594360
validation[          , genome  5744] predictions:    6431/  10000 (64.31%), best:    6536/10000 (65.36%), error:     10195.59277, best error:     10078.18750 on epoch:    58, epoch:   59/100, mu: 0.9615066648, learning_rate: 0.0000180795, weight_decay: 0.0000133284

epoch time: 824.5136718750s, input_fired_time: 15.3039770126, output_fired_time: 5.0165662766, propagate_forward_time: 235.3763885498, propagate_backward_time: 560.9692993164, weight_update_time: 0.2838707864, other_time: 7.8474731445
epoch time: 49.1883354187s, input_fired_time: 0.9393135905, output_fired_time: 0.0000000000, propagate_forward_time: 47.0108718872, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2381515503
validation[          , genome  5744] predictions:    6540/  10000 (65.40%), best:    6540/10000 (65.40%), error:     10048.05566, best error:     10048.05566 on epoch:    60, epoch:   60/100, mu: 0.9628334045, learning_rate: 0.0000168507, weight_decay: 0.0000125306

epoch time: 824.1550903320s, input_fired_time: 15.2826890945, output_fired_time: 5.0138349533, propagate_forward_time: 235.2272949219, propagate_backward_time: 560.7555541992, weight_update_time: 0.2842199802, other_time: 7.8756713867
epoch time: 49.1704978943s, input_fired_time: 0.9405872822, output_fired_time: 0.0000000000, propagate_forward_time: 46.9768791199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2530326843
validation[          , genome  5744] predictions:    6512/  10000 (65.12%), best:    6512/10000 (65.12%), error:     10004.39453, best error:     10004.39453 on epoch:    61, epoch:   61/100, mu: 0.9640983939, learning_rate: 0.0000157054, weight_decay: 0.0000117806

epoch time: 824.9448242188s, input_fired_time: 15.2969255447, output_fired_time: 5.0137033463, propagate_forward_time: 235.3561401367, propagate_backward_time: 561.3925781250, weight_update_time: 0.2836342156, other_time: 7.8854370117
epoch time: 49.1513786316s, input_fired_time: 0.9388593435, output_fired_time: 0.0000000000, propagate_forward_time: 46.9723548889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2401657104
validation[          , genome  5744] predictions:    6474/  10000 (64.74%), best:    6512/10000 (65.12%), error:     10179.57031, best error:     10004.39453 on epoch:    61, epoch:   62/100, mu: 0.9653044939, learning_rate: 0.0000146380, weight_decay: 0.0000110754

epoch time: 824.2136230469s, input_fired_time: 15.2893276215, output_fired_time: 5.0269436836, propagate_forward_time: 235.1843719482, propagate_backward_time: 560.9036254883, weight_update_time: 0.2834513485, other_time: 7.8093872070
epoch time: 49.1799201965s, input_fired_time: 0.9428573251, output_fired_time: 0.0000000000, propagate_forward_time: 46.9895172119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2475471497
validation[          , genome  5744] predictions:    6530/  10000 (65.30%), best:    6512/10000 (65.12%), error:     10093.58691, best error:     10004.39453 on epoch:    61, epoch:   63/100, mu: 0.9664543867, learning_rate: 0.0000136431, weight_decay: 0.0000104125

epoch time: 825.6830444336s, input_fired_time: 15.3272972107, output_fired_time: 5.0168833733, propagate_forward_time: 235.4020690918, propagate_backward_time: 561.7153320313, weight_update_time: 0.2845129073, other_time: 8.2214355469
epoch time: 49.2042884827s, input_fired_time: 0.9424076676, output_fired_time: 0.0000000000, propagate_forward_time: 46.9806365967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2812423706
validation[          , genome  5744] predictions:    6519/  10000 (65.19%), best:    6512/10000 (65.12%), error:     10005.73340, best error:     10004.39453 on epoch:    61, epoch:   64/100, mu: 0.9675507545, learning_rate: 0.0000127158, weight_decay: 0.0000097892

epoch time: 823.9125976563s, input_fired_time: 15.3020811081, output_fired_time: 5.0189580917, propagate_forward_time: 235.1478271484, propagate_backward_time: 560.5903930664, weight_update_time: 0.2849006653, other_time: 7.8533325195
epoch time: 49.1217765808s, input_fired_time: 0.9428010583, output_fired_time: 0.0000000000, propagate_forward_time: 46.9292984009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2496757507
validation[          , genome  5744] predictions:    6538/  10000 (65.38%), best:    6512/10000 (65.12%), error:     10023.19629, best error:     10004.39453 on epoch:    61, epoch:   65/100, mu: 0.9685961008, learning_rate: 0.0000118516, weight_decay: 0.0000092033

epoch time: 823.6728515625s, input_fired_time: 15.2930555344, output_fired_time: 5.0239186287, propagate_forward_time: 235.0835418701, propagate_backward_time: 560.3891601563, weight_update_time: 0.2847175002, other_time: 7.8831787109
epoch time: 49.1307716370s, input_fired_time: 0.9405646920, output_fired_time: 0.0000000000, propagate_forward_time: 46.9460334778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2441749573
validation[          , genome  5744] predictions:    6498/  10000 (64.98%), best:    6512/10000 (65.12%), error:     10012.19434, best error:     10004.39453 on epoch:    61, epoch:   66/100, mu: 0.9695927501, learning_rate: 0.0000110461, weight_decay: 0.0000086524

epoch time: 823.7623291016s, input_fired_time: 15.3117752075, output_fired_time: 5.0211086273, propagate_forward_time: 235.2441253662, propagate_backward_time: 560.3671875000, weight_update_time: 0.2862240076, other_time: 7.8181152344
epoch time: 49.0470962524s, input_fired_time: 0.9420516491, output_fired_time: 0.0000000000, propagate_forward_time: 46.8697853088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2352600098
validation[          , genome  5744] predictions:    6554/  10000 (65.54%), best:    6554/10000 (65.54%), error:      9940.91113, best error:      9940.91113 on epoch:    67, epoch:   67/100, mu: 0.9705429673, learning_rate: 0.0000102953, weight_decay: 0.0000081345

epoch time: 823.0144042969s, input_fired_time: 15.3120574951, output_fired_time: 5.0216474533, propagate_forward_time: 234.9924316406, propagate_backward_time: 559.8220214844, weight_update_time: 0.2862204015, other_time: 7.8662109375
epoch time: 49.0515174866s, input_fired_time: 0.9396791458, output_fired_time: 0.0000000000, propagate_forward_time: 46.8747787476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2370605469
validation[          , genome  5744] predictions:    6513/  10000 (65.13%), best:    6554/10000 (65.54%), error:     10009.30469, best error:      9940.91113 on epoch:    67, epoch:   68/100, mu: 0.9714489579, learning_rate: 0.0000095956, weight_decay: 0.0000076476

epoch time: 822.1975097656s, input_fired_time: 15.3044776917, output_fired_time: 5.0069642067, propagate_forward_time: 234.7595367432, propagate_backward_time: 559.2529907227, weight_update_time: 0.2889496386, other_time: 7.8735351563
epoch time: 49.0547065735s, input_fired_time: 0.9443204403, output_fired_time: 0.0000000000, propagate_forward_time: 46.8715820313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2388038635
validation[          , genome  5744] predictions:    6438/  10000 (64.38%), best:    6554/10000 (65.54%), error:     10092.90625, best error:      9940.91113 on epoch:    67, epoch:   69/100, mu: 0.9723127484, learning_rate: 0.0000089434, weight_decay: 0.0000071898

epoch time: 822.3335571289s, input_fired_time: 15.2969293594, output_fired_time: 5.0040965080, propagate_forward_time: 234.7192077637, propagate_backward_time: 559.4284667969, weight_update_time: 0.2867605984, other_time: 7.8848876953
epoch time: 49.0665435791s, input_fired_time: 0.9480913877, output_fired_time: 0.0000000000, propagate_forward_time: 46.8797569275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2386970520
validation[          , genome  5744] predictions:    6512/  10000 (65.12%), best:    6554/10000 (65.54%), error:      9988.14160, best error:      9940.91113 on epoch:    67, epoch:   70/100, mu: 0.9731363058, learning_rate: 0.0000083356, weight_decay: 0.0000067595

epoch time: 823.1635131836s, input_fired_time: 15.3263788223, output_fired_time: 5.0142440796, propagate_forward_time: 234.9749145508, propagate_backward_time: 559.9627685547, weight_update_time: 0.2876519561, other_time: 7.8852539063
epoch time: 49.0391006470s, input_fired_time: 0.9450152516, output_fired_time: 0.0000000000, propagate_forward_time: 46.8538780212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2402076721
validation[          , genome  5744] predictions:    6552/  10000 (65.52%), best:    6554/10000 (65.54%), error:      9960.35352, best error:      9940.91113 on epoch:    67, epoch:   71/100, mu: 0.9739215374, learning_rate: 0.0000077690, weight_decay: 0.0000063549

epoch time: 823.5576171875s, input_fired_time: 15.3279466629, output_fired_time: 5.0145888329, propagate_forward_time: 235.1640625000, propagate_backward_time: 560.1463623047, weight_update_time: 0.2889211774, other_time: 7.9046630859
epoch time: 49.3185615540s, input_fired_time: 0.9531295300, output_fired_time: 0.0000000000, propagate_forward_time: 47.1363983154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2290344238
validation[          , genome  5744] predictions:    6592/  10000 (65.92%), best:    6592/10000 (65.92%), error:      9898.82227, best error:      9898.82227 on epoch:    72, epoch:   72/100, mu: 0.9746702313, learning_rate: 0.0000072410, weight_decay: 0.0000059745

epoch time: 824.4098510742s, input_fired_time: 15.3310642242, output_fired_time: 5.0183148384, propagate_forward_time: 235.1988372803, propagate_backward_time: 560.9669189453, weight_update_time: 0.2914187014, other_time: 7.8947143555
epoch time: 49.0419273376s, input_fired_time: 0.9500417113, output_fired_time: 0.0000000000, propagate_forward_time: 46.8568649292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2350196838
validation[          , genome  5744] predictions:    6531/  10000 (65.31%), best:    6592/10000 (65.92%), error:      9978.04883, best error:      9898.82227 on epoch:    72, epoch:   73/100, mu: 0.9753840566, learning_rate: 0.0000067488, weight_decay: 0.0000056169

epoch time: 822.9943237305s, input_fired_time: 15.3148574829, output_fired_time: 5.0122399330, propagate_forward_time: 234.8165740967, propagate_backward_time: 559.9439697266, weight_update_time: 0.2893725634, other_time: 7.9066162109
epoch time: 49.0709457397s, input_fired_time: 0.9474859238, output_fired_time: 0.0000000000, propagate_forward_time: 46.8849029541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2385559082
validation[          , genome  5744] predictions:    6479/  10000 (64.79%), best:    6592/10000 (65.92%), error:     10051.47070, best error:      9898.82227 on epoch:    72, epoch:   74/100, mu: 0.9760646224, learning_rate: 0.0000062902, weight_decay: 0.0000052807

epoch time: 822.8806762695s, input_fired_time: 15.3298587799, output_fired_time: 5.0199933052, propagate_forward_time: 234.7876739502, propagate_backward_time: 559.8924560547, weight_update_time: 0.2899678051, other_time: 7.8507080078
epoch time: 49.0884056091s, input_fired_time: 0.9480484724, output_fired_time: 0.0000000000, propagate_forward_time: 46.9024696350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2378883362
validation[          , genome  5744] predictions:    6604/  10000 (66.04%), best:    6604/10000 (66.04%), error:      9816.66309, best error:      9816.66309 on epoch:    75, epoch:   75/100, mu: 0.9767134786, learning_rate: 0.0000058626, weight_decay: 0.0000049646

epoch time: 822.6282348633s, input_fired_time: 15.3141880035, output_fired_time: 5.0170426369, propagate_forward_time: 234.7540740967, propagate_backward_time: 559.6034545898, weight_update_time: 0.2919636965, other_time: 7.9394531250
epoch time: 49.0709419250s, input_fired_time: 0.9474896789, output_fired_time: 0.0000000000, propagate_forward_time: 46.8790397644, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2444114685
validation[          , genome  5744] predictions:    6524/  10000 (65.24%), best:    6604/10000 (66.04%), error:      9922.53906, best error:      9816.66309 on epoch:    75, epoch:   76/100, mu: 0.9773321748, learning_rate: 0.0000054642, weight_decay: 0.0000046674

epoch time: 822.6250610352s, input_fired_time: 15.3121213913, output_fired_time: 5.0149235725, propagate_forward_time: 234.7817230225, propagate_backward_time: 559.6434326172, weight_update_time: 0.2929802835, other_time: 7.8728027344
epoch time: 49.1583328247s, input_fired_time: 0.9517452121, output_fired_time: 0.0000000000, propagate_forward_time: 46.9680366516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2385520935
validation[          , genome  5744] predictions:    6550/  10000 (65.50%), best:    6604/10000 (66.04%), error:      9908.79102, best error:      9816.66309 on epoch:    75, epoch:   77/100, mu: 0.9779220223, learning_rate: 0.0000050928, weight_decay: 0.0000043881

epoch time: 822.7783813477s, input_fired_time: 15.3147115707, output_fired_time: 5.0146212578, propagate_forward_time: 234.6676788330, propagate_backward_time: 559.8911743164, weight_update_time: 0.2952840030, other_time: 7.8901977539
epoch time: 49.0626869202s, input_fired_time: 0.9502543807, output_fired_time: 0.0000000000, propagate_forward_time: 46.8723945618, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2400398254
validation[          , genome  5744] predictions:    6614/  10000 (66.14%), best:    6614/10000 (66.14%), error:      9805.99805, best error:      9805.99805 on epoch:    78, epoch:   78/100, mu: 0.9784843922, learning_rate: 0.0000047467, weight_decay: 0.0000041254

epoch time: 825.5350952148s, input_fired_time: 15.3654699326, output_fired_time: 5.0322012901, propagate_forward_time: 235.5776672363, propagate_backward_time: 561.6602172852, weight_update_time: 0.2951658666, other_time: 7.8994750977
epoch time: 49.3302803040s, input_fired_time: 0.9522940516, output_fired_time: 0.0000000000, propagate_forward_time: 47.1342010498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2437858582
validation[          , genome  5744] predictions:    6520/  10000 (65.20%), best:    6614/10000 (66.14%), error:      9937.72461, best error:      9805.99805 on epoch:    78, epoch:   79/100, mu: 0.9790205956, learning_rate: 0.0000044240, weight_decay: 0.0000038785

epoch time: 825.8277587891s, input_fired_time: 15.3626575470, output_fired_time: 5.0203070641, propagate_forward_time: 235.5865325928, propagate_backward_time: 561.9605712891, weight_update_time: 0.2964330614, other_time: 7.8976440430
epoch time: 49.2136535645s, input_fired_time: 0.9529312849, output_fired_time: 0.0000000000, propagate_forward_time: 47.0116119385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2491111755
validation[          , genome  5744] predictions:    6597/  10000 (65.97%), best:    6614/10000 (66.14%), error:      9882.88672, best error:      9805.99805 on epoch:    78, epoch:   80/100, mu: 0.9795318246, learning_rate: 0.0000041234, weight_decay: 0.0000036463

epoch time: 825.5509033203s, input_fired_time: 15.3710880280, output_fired_time: 5.0312490463, propagate_forward_time: 235.5214233398, propagate_backward_time: 561.7222290039, weight_update_time: 0.2978182435, other_time: 7.9049072266
epoch time: 49.2177886963s, input_fired_time: 0.9521741271, output_fired_time: 0.0000000000, propagate_forward_time: 47.0221710205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2434425354
validation[          , genome  5744] predictions:    6570/  10000 (65.70%), best:    6614/10000 (66.14%), error:      9910.54297, best error:      9805.99805 on epoch:    78, epoch:   81/100, mu: 0.9800192714, learning_rate: 0.0000038431, weight_decay: 0.0000034281

epoch time: 825.5891113281s, input_fired_time: 15.3555068970, output_fired_time: 5.0218205452, propagate_forward_time: 235.4928741455, propagate_backward_time: 561.8012695313, weight_update_time: 0.2980249524, other_time: 7.9176025391
epoch time: 49.2364883423s, input_fired_time: 0.9540726542, output_fired_time: 0.0000000000, propagate_forward_time: 47.0449333191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2374839783
validation[          , genome  5744] predictions:    6552/  10000 (65.52%), best:    6614/10000 (66.14%), error:      9890.18262, best error:      9805.99805 on epoch:    78, epoch:   82/100, mu: 0.9804840088, learning_rate: 0.0000035819, weight_decay: 0.0000032229

epoch time: 824.7926025391s, input_fired_time: 15.3624095917, output_fired_time: 5.0259976387, propagate_forward_time: 235.3062286377, propagate_backward_time: 561.1958007813, weight_update_time: 0.3005662858, other_time: 7.9021606445
epoch time: 49.1205711365s, input_fired_time: 0.9512588382, output_fired_time: 0.0000000000, propagate_forward_time: 46.9236221313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2456893921
validation[          , genome  5744] predictions:    6559/  10000 (65.59%), best:    6614/10000 (66.14%), error:      9863.65918, best error:      9805.99805 on epoch:    78, epoch:   83/100, mu: 0.9809271097, learning_rate: 0.0000033385, weight_decay: 0.0000030300

epoch time: 824.1936645508s, input_fired_time: 15.3490190506, output_fired_time: 5.0150647163, propagate_forward_time: 235.1707000732, propagate_backward_time: 560.7391357422, weight_update_time: 0.3024353385, other_time: 7.9197387695
epoch time: 49.1162796021s, input_fired_time: 0.9524704814, output_fired_time: 0.0000000000, propagate_forward_time: 46.9203186035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2434921265
validation[          , genome  5744] predictions:    6574/  10000 (65.74%), best:    6614/10000 (66.14%), error:      9850.00586, best error:      9805.99805 on epoch:    78, epoch:   84/100, mu: 0.9813495874, learning_rate: 0.0000031116, weight_decay: 0.0000028486

epoch time: 824.8072509766s, input_fired_time: 15.3635768890, output_fired_time: 5.0203037262, propagate_forward_time: 235.2706451416, propagate_backward_time: 561.0377197266, weight_update_time: 0.3034186661, other_time: 8.1149902344
epoch time: 49.1517524719s, input_fired_time: 0.9540160894, output_fired_time: 0.0000000000, propagate_forward_time: 46.9573631287, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2403717041
validation[          , genome  5744] predictions:    6587/  10000 (65.87%), best:    6587/10000 (65.87%), error:      9790.68555, best error:      9790.68555 on epoch:    85, epoch:   85/100, mu: 0.9817523956, learning_rate: 0.0000029001, weight_decay: 0.0000026781

epoch time: 824.3732299805s, input_fired_time: 15.3650817871, output_fired_time: 5.0216231346, propagate_forward_time: 235.0791168213, propagate_backward_time: 561.0524902344, weight_update_time: 0.3036487997, other_time: 7.8549804688
epoch time: 49.2752037048s, input_fired_time: 0.9542543888, output_fired_time: 0.0000000000, propagate_forward_time: 47.0420150757, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2789344788
validation[          , genome  5744] predictions:    6580/  10000 (65.80%), best:    6587/10000 (65.87%), error:      9843.20898, best error:      9790.68555 on epoch:    85, epoch:   86/100, mu: 0.9821364284, learning_rate: 0.0000027030, weight_decay: 0.0000025178

epoch time: 825.6905517578s, input_fired_time: 15.3742713928, output_fired_time: 5.0315918922, propagate_forward_time: 235.5827178955, propagate_backward_time: 561.7587280273, weight_update_time: 0.3068574965, other_time: 7.9432373047
epoch time: 49.2193641663s, input_fired_time: 0.9533563852, output_fired_time: 0.0000000000, propagate_forward_time: 47.0230178833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2429885864
validation[          , genome  5744] predictions:    6592/  10000 (65.92%), best:    6587/10000 (65.87%), error:      9807.28320, best error:      9790.68555 on epoch:    85, epoch:   87/100, mu: 0.9825025797, learning_rate: 0.0000025193, weight_decay: 0.0000023671

epoch time: 825.1881103516s, input_fired_time: 15.3675575256, output_fired_time: 5.0179553032, propagate_forward_time: 235.4483032227, propagate_backward_time: 561.4535522461, weight_update_time: 0.3089068532, other_time: 7.9007568359
epoch time: 49.1537132263s, input_fired_time: 0.9540647268, output_fired_time: 0.0000000000, propagate_forward_time: 46.9522552490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2473945618
validation[          , genome  5744] predictions:    6592/  10000 (65.92%), best:    6587/10000 (65.87%), error:      9846.52930, best error:      9790.68555 on epoch:    85, epoch:   88/100, mu: 0.9828516841, learning_rate: 0.0000023480, weight_decay: 0.0000022254

epoch time: 825.3359375000s, input_fired_time: 15.3827028275, output_fired_time: 5.0195198059, propagate_forward_time: 235.5089721680, propagate_backward_time: 561.5166625977, weight_update_time: 0.3121760488, other_time: 7.9080810547
epoch time: 49.1632194519s, input_fired_time: 0.9549506307, output_fired_time: 0.0000000000, propagate_forward_time: 46.9665336609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2417335510
validation[          , genome  5744] predictions:    6609/  10000 (66.09%), best:    6609/10000 (66.09%), error:      9786.76270, best error:      9786.76270 on epoch:    89, epoch:   89/100, mu: 0.9831845164, learning_rate: 0.0000021884, weight_decay: 0.0000020922

epoch time: 824.9838867188s, input_fired_time: 15.3837604523, output_fired_time: 5.0306797028, propagate_forward_time: 235.4086914063, propagate_backward_time: 561.2392578125, weight_update_time: 0.3162873089, other_time: 7.9214477539
epoch time: 49.2588348389s, input_fired_time: 0.9563675523, output_fired_time: 0.0000000000, propagate_forward_time: 47.0595855713, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2428817749
validation[          , genome  5744] predictions:    6584/  10000 (65.84%), best:    6609/10000 (66.09%), error:      9811.21094, best error:      9786.76270 on epoch:    89, epoch:   90/100, mu: 0.9835018516, learning_rate: 0.0000020397, weight_decay: 0.0000019670

epoch time: 826.1578369141s, input_fired_time: 15.3987627029, output_fired_time: 5.0309581757, propagate_forward_time: 235.6620330811, propagate_backward_time: 562.1514892578, weight_update_time: 0.3160393536, other_time: 7.9146118164
epoch time: 49.2195358276s, input_fired_time: 0.9561063051, output_fired_time: 0.0000000000, propagate_forward_time: 47.0325813293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2308464050
validation[          , genome  5744] predictions:    6618/  10000 (66.18%), best:    6609/10000 (66.09%), error:      9814.85254, best error:      9786.76270 on epoch:    89, epoch:   91/100, mu: 0.9838044047, learning_rate: 0.0000019011, weight_decay: 0.0000018492

epoch time: 825.3826293945s, input_fired_time: 15.3888959885, output_fired_time: 5.0324873924, propagate_forward_time: 235.5028991699, propagate_backward_time: 561.5382690430, weight_update_time: 0.3185821772, other_time: 7.9201049805
epoch time: 49.0045700073s, input_fired_time: 0.9521749616, output_fired_time: 0.0000000000, propagate_forward_time: 46.8115463257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2408485413
validation[          , genome  5744] predictions:    6600/  10000 (66.00%), best:    6600/10000 (66.00%), error:      9777.27734, best error:      9777.27734 on epoch:    92, epoch:   92/100, mu: 0.9840928912, learning_rate: 0.0000017719, weight_decay: 0.0000017385

epoch time: 824.2801513672s, input_fired_time: 15.3709125519, output_fired_time: 5.0155701637, propagate_forward_time: 235.1629791260, propagate_backward_time: 560.8710937500, weight_update_time: 0.3216950297, other_time: 7.8596191406
epoch time: 49.2867660522s, input_fired_time: 0.9575772882, output_fired_time: 0.0000000000, propagate_forward_time: 47.0976676941, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2315216064
validation[          , genome  5744] predictions:    6614/  10000 (66.14%), best:    6600/10000 (66.00%), error:      9783.37598, best error:      9777.27734 on epoch:    92, epoch:   93/100, mu: 0.9843679667, learning_rate: 0.0000016514, weight_decay: 0.0000016345

epoch time: 827.3040771484s, input_fired_time: 15.4181680679, output_fired_time: 5.0421957970, propagate_forward_time: 235.8915405273, propagate_backward_time: 562.9768676758, weight_update_time: 0.3227913976, other_time: 7.9753417969
epoch time: 49.3032188416s, input_fired_time: 0.9595398903, output_fired_time: 0.0000000000, propagate_forward_time: 47.1085128784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2351646423
validation[          , genome  5744] predictions:    6615/  10000 (66.15%), best:    6615/10000 (66.15%), error:      9762.25391, best error:      9762.25391 on epoch:    94, epoch:   94/100, mu: 0.9846302271, learning_rate: 0.0000015392, weight_decay: 0.0000015366

epoch time: 824.3983154297s, input_fired_time: 15.3687419891, output_fired_time: 5.0224347115, propagate_forward_time: 235.2359619141, propagate_backward_time: 560.8952026367, weight_update_time: 0.3267945945, other_time: 7.8759765625
epoch time: 49.0731124878s, input_fired_time: 0.9523619413, output_fired_time: 0.0000000000, propagate_forward_time: 46.8864021301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2343482971
validation[          , genome  5744] predictions:    6576/  10000 (65.76%), best:    6615/10000 (66.15%), error:      9784.47461, best error:      9762.25391 on epoch:    94, epoch:   95/100, mu: 0.9848802686, learning_rate: 0.0000014346, weight_decay: 0.0000014447

epoch time: 822.4363403320s, input_fired_time: 15.3370285034, output_fired_time: 5.0069994926, propagate_forward_time: 234.7454528809, propagate_backward_time: 559.4520874023, weight_update_time: 0.3287210464, other_time: 7.8947143555
epoch time: 49.0008506775s, input_fired_time: 0.9524858594, output_fired_time: 0.0000000000, propagate_forward_time: 46.8062400818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2421264648
validation[          , genome  5744] predictions:    6590/  10000 (65.90%), best:    6615/10000 (66.15%), error:      9782.82617, best error:      9762.25391 on epoch:    94, epoch:   96/100, mu: 0.9851186872, learning_rate: 0.0000013371, weight_decay: 0.0000013582

epoch time: 827.0342407227s, input_fired_time: 15.4113864899, output_fired_time: 5.0362997055, propagate_forward_time: 235.7448577881, propagate_backward_time: 562.8875732422, weight_update_time: 0.3331971467, other_time: 7.9541015625
epoch time: 49.4528656006s, input_fired_time: 0.9634522200, output_fired_time: 0.0000000000, propagate_forward_time: 47.2557907104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2336235046
validation[          , genome  5744] predictions:    6624/  10000 (66.24%), best:    6624/10000 (66.24%), error:      9748.69336, best error:      9748.69336 on epoch:    97, epoch:   97/100, mu: 0.9853459597, learning_rate: 0.0000012462, weight_decay: 0.0000012769

epoch time: 827.1459960938s, input_fired_time: 15.4271793365, output_fired_time: 5.0436596870, propagate_forward_time: 235.9305419922, propagate_backward_time: 562.8069458008, weight_update_time: 0.3365216255, other_time: 7.9376831055
epoch time: 49.3624343872s, input_fired_time: 0.9643997550, output_fired_time: 0.0000000000, propagate_forward_time: 47.1494827271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2485504150
validation[          , genome  5744] predictions:    6608/  10000 (66.08%), best:    6624/10000 (66.24%), error:      9768.12988, best error:      9748.69336 on epoch:    97, epoch:   98/100, mu: 0.9855626822, learning_rate: 0.0000011615, weight_decay: 0.0000012005

epoch time: 826.7993774414s, input_fired_time: 15.4148254395, output_fired_time: 5.0329051018, propagate_forward_time: 235.7853546143, propagate_backward_time: 562.6058349609, weight_update_time: 0.3396118879, other_time: 7.9604492188
epoch time: 49.2395629883s, input_fired_time: 0.9624328613, output_fired_time: 0.0000000000, propagate_forward_time: 47.0320205688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2451095581
validation[          , genome  5744] predictions:    6599/  10000 (65.99%), best:    6624/10000 (66.24%), error:      9767.42188, best error:      9748.69336 on epoch:    97, epoch:   99/100, mu: 0.9857692719, learning_rate: 0.0000010826, weight_decay: 0.0000011286

epoch time: 825.6760253906s, input_fired_time: 15.3833503723, output_fired_time: 5.0220723152, propagate_forward_time: 235.5068969727, propagate_backward_time: 561.7903442383, weight_update_time: 0.3432179987, other_time: 7.9733276367
epoch time: 49.1908912659s, input_fired_time: 0.9567479491, output_fired_time: 0.0000000000, propagate_forward_time: 46.9924774170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2416648865
validation[          , genome  5744] predictions:    6605/  10000 (66.05%), best:    6624/10000 (66.24%), error:      9773.86816, best error:      9748.69336 on epoch:    97, epoch:  100/100, mu: 0.9859662652, learning_rate: 0.0000010090, weight_decay: 0.0000010611

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 246.5038299561s, input_fired_time: 4.8020977974, output_fired_time: 0.0000000000, propagate_forward_time: 235.5722503662, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1294860840
best training[          , genome  5744] predictions:   36717/  50000 (73.43%), best:    6624/10000 (66.24%), error:     40329.08594, best error:      9748.69336 on epoch:    97, epoch:  101/100, mu: 0.9861540794, learning_rate: 0.0000009404, weight_decay: 0.0000009975
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 49.3132171631s, input_fired_time: 0.9594774842, output_fired_time: 0.0000000000, propagate_forward_time: 47.1126747131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2410659790
   testing[          , genome  5744] predictions:    6624/  10000 (66.24%), best:    6624/10000 (66.24%), error:      9748.69336, best error:      9748.69336 on epoch:    97, epoch:  101/100, mu: 0.9861540794, learning_rate: 0.0000009404, weight_decay: 0.0000009975
backpropagation finished successfully!
13:56:26 (7080): called boinc_finish(0)

</stderr_txt>
]]>