Nameexact_genome_1535714404_162_11960_1
Workunit3940954
Created4 Sep 2018, 14:34:09 UTC
Sent4 Sep 2018, 15:51:16 UTC
Report deadline14 Mar 2019, 13:03:13 UTC
Received12 Sep 2018, 17:41:26 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time2 days 17 hours 37 min 39 sec
CPU time2 days 17 hours 36 min 59 sec
Validate stateInitial
Credit0.00
Device peak FLOPS3.83 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size601.07 MB
Peak swap size620.71 MB
Peak disk usage17.61 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
05889893s, input_fired_time: 2.3299353123, output_fired_time: 0.0000000000, propagate_forward_time: 145.4219207764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1487274170
validation[          , genome 11960] predictions:    6466/  10000 (64.66%), best:    6477/10000 (64.77%), error:     10267.05566, best error:     10124.38086 on epoch:    20, epoch:   22/100, mu: 0.8190648556, learning_rate: 0.0001689555, weight_decay: 0.0001491647

epoch time: 1869.1690673828s, input_fired_time: 38.2258682251, output_fired_time: 13.4045686722, propagate_forward_time: 663.1719360352, propagate_backward_time: 1136.8236083984, weight_update_time: 0.7679777145, other_time: 17.5430908203
epoch time: 133.6134643555s, input_fired_time: 2.1460080147, output_fired_time: 0.0000000000, propagate_forward_time: 128.4582824707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0091705322
validation[          , genome 11960] predictions:    6439/  10000 (64.39%), best:    6477/10000 (64.77%), error:     10304.22266, best error:     10124.38086 on epoch:    20, epoch:   23/100, mu: 0.8266341686, learning_rate: 0.0001564866, weight_decay: 0.0001409406

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1535714404_162_11960.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1535714404_162_11960_1_r157097013_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.527007
read mu: 0.833868
read mu_delta: 0.955718
read initial_learning_rate: 0.000912573
read learning_rate: 0.000144938
read learning_rate_delta: 0.9262
read initial_weight_decay: 0.000519429
read weight_decay: 0.00013317
read weight_decay_delta: 0.944866
read batch_size: 87
read epsilon: 1e-07
read alpha: 0.0759129
read input_dropout_probability: 0.00119516
read hidden_dropout_probability: 0.105772
read velocity_reset: 2037
read epoch: 24
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 20
read number_validation_images: 10000
read best_validation_predictions: 6477
read best_validation_error: 10124.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 11960
read normal distribution: '1 0 0'
generator_str: '275419467'
read generator: 275419467
read generated_by_map:
1 enable_edge 1
reading 159 nodes.
reading 625 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3042.7841796875s, input_fired_time: 44.4434509277344, output_fired_time: 20.737922668457, propagate_forward_time: 1140.74609375, propagate_backward_time: 1814.09387207031, weight_update_time: 1.0427702665329, other_time: 22.7628173828125
epoch time: 233.205825805664s, input_fired_time: 3.21497273445129, output_fired_time: 0, propagate_forward_time: 225.89079284668, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.10006713867188
validation[          , genome 11960] predictions:    6595/  10000 (65.95%), best:    6477/10000 (64.77%), error:     10124.39160, best error:     10124.38086 on epoch:    20, epoch:   24/100, mu: 0.8338683248, learning_rate: 0.0001449379, weight_decay: 0.0001331699

epoch time: 2998.2570800781s, input_fired_time: 44.2048034668, output_fired_time: 20.4971714020, propagate_forward_time: 1122.3837890625, propagate_backward_time: 1788.6079101563, weight_update_time: 1.0421153307, other_time: 22.5634765625
epoch time: 228.4477996826s, input_fired_time: 3.1766815186, output_fired_time: 0.0000000000, propagate_forward_time: 221.2797698975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9913482666
validation[          , genome 11960] predictions:    6354/  10000 (63.54%), best:    6477/10000 (64.77%), error:     10555.76270, best error:     10124.38086 on epoch:    20, epoch:   25/100, mu: 0.8407821059, learning_rate: 0.0001342415, weight_decay: 0.0001258276

epoch time: 2973.2941894531s, input_fired_time: 44.0802574158, output_fired_time: 20.3084659576, propagate_forward_time: 1111.5358886719, propagate_backward_time: 1774.9501953125, weight_update_time: 1.0357725620, other_time: 22.4194335938
epoch time: 227.5853576660s, input_fired_time: 3.1856472492, output_fired_time: 0.0000000000, propagate_forward_time: 220.3769226074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0227813721
validation[          , genome 11960] predictions:    6586/  10000 (65.86%), best:    6586/10000 (65.86%), error:      9994.49414, best error:      9994.49414 on epoch:    26, epoch:   26/100, mu: 0.8473897576, learning_rate: 0.0001243344, weight_decay: 0.0001188902

epoch time: 2979.7121582031s, input_fired_time: 44.0697364807, output_fired_time: 20.4533748627, propagate_forward_time: 1109.5883789063, propagate_backward_time: 1783.0406494141, weight_update_time: 1.0412614346, other_time: 22.5599365234
epoch time: 229.0861663818s, input_fired_time: 3.2098348141, output_fired_time: 0.0000000000, propagate_forward_time: 221.8501892090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0261383057
validation[          , genome 11960] predictions:    6530/  10000 (65.30%), best:    6586/10000 (65.86%), error:     10054.62695, best error:      9994.49414 on epoch:    26, epoch:   27/100, mu: 0.8537048101, learning_rate: 0.0001151586, weight_decay: 0.0001123353

epoch time: 2983.7150878906s, input_fired_time: 44.1582336426, output_fired_time: 20.3825817108, propagate_forward_time: 1114.6046142578, propagate_backward_time: 1782.0125732422, weight_update_time: 1.0368043184, other_time: 22.5571289063
epoch time: 228.3331451416s, input_fired_time: 3.2092070580, output_fired_time: 0.0000000000, propagate_forward_time: 221.1015319824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0223999023
validation[          , genome 11960] predictions:    6632/  10000 (66.32%), best:    6632/10000 (66.32%), error:      9791.22070, best error:      9791.22070 on epoch:    28, epoch:   28/100, mu: 0.8597401977, learning_rate: 0.0001066599, weight_decay: 0.0001061417

epoch time: 2970.1652832031s, input_fired_time: 44.0974235535, output_fired_time: 20.2480316162, propagate_forward_time: 1108.2679443359, propagate_backward_time: 1775.1585693359, weight_update_time: 1.0241249800, other_time: 22.3933105469
epoch time: 225.4338531494s, input_fired_time: 3.1588244438, output_fired_time: 0.0000000000, propagate_forward_time: 218.3148345947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9601898193
validation[          , genome 11960] predictions:    6419/  10000 (64.19%), best:    6632/10000 (66.32%), error:     10381.23730, best error:      9791.22070 on epoch:    28, epoch:   29/100, mu: 0.8655083179, learning_rate: 0.0000987884, weight_decay: 0.0001002896

epoch time: 2926.7145996094s, input_fired_time: 43.9059066772, output_fired_time: 20.1406841278, propagate_forward_time: 1092.2919921875, propagate_backward_time: 1748.0870361328, weight_update_time: 1.0172224045, other_time: 22.2889404297
epoch time: 224.9199829102s, input_fired_time: 3.1553950310, output_fired_time: 0.0000000000, propagate_forward_time: 217.8881378174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8764495850
validation[          , genome 11960] predictions:    6643/  10000 (66.43%), best:    6643/10000 (66.43%), error:      9723.83008, best error:      9723.83008 on epoch:    30, epoch:   30/100, mu: 0.8710210323, learning_rate: 0.0000914978, weight_decay: 0.0000947602

epoch time: 2911.7580566406s, input_fired_time: 43.8407707214, output_fired_time: 20.1687984467, propagate_forward_time: 1086.2941894531, propagate_backward_time: 1739.1478271484, weight_update_time: 1.0195400715, other_time: 22.3065185547
epoch time: 222.4798583984s, input_fired_time: 3.1167442799, output_fired_time: 0.0000000000, propagate_forward_time: 215.4329986572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9301147461
validation[          , genome 11960] predictions:    6526/  10000 (65.26%), best:    6643/10000 (66.43%), error:     10055.04004, best error:      9723.83008 on epoch:    30, epoch:   31/100, mu: 0.8762896061, learning_rate: 0.0000847452, weight_decay: 0.0000895357

epoch time: 2909.7053222656s, input_fired_time: 43.8637428284, output_fired_time: 20.0970821381, propagate_forward_time: 1082.1944580078, propagate_backward_time: 1741.2735595703, weight_update_time: 1.0219774246, other_time: 22.2763671875
epoch time: 222.4805908203s, input_fired_time: 3.1336836815, output_fired_time: 0.0000000000, propagate_forward_time: 215.4267272949, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9201812744
validation[          , genome 11960] predictions:    6505/  10000 (65.05%), best:    6643/10000 (66.43%), error:     10053.21289, best error:      9723.83008 on epoch:    30, epoch:   32/100, mu: 0.8813248873, learning_rate: 0.0000784910, weight_decay: 0.0000845992

epoch time: 2906.3598632813s, input_fired_time: 43.7948112488, output_fired_time: 20.0223846436, propagate_forward_time: 1081.8320312500, propagate_backward_time: 1738.4572753906, weight_update_time: 1.0197981596, other_time: 22.2531738281
epoch time: 223.5235595703s, input_fired_time: 3.1522221565, output_fired_time: 0.0000000000, propagate_forward_time: 216.4016876221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9696502686
validation[          , genome 11960] predictions:    6684/  10000 (66.84%), best:    6684/10000 (66.84%), error:      9626.48242, best error:      9626.48242 on epoch:    33, epoch:   33/100, mu: 0.8861371875, learning_rate: 0.0000726984, weight_decay: 0.0000799348

epoch time: 2893.1694335938s, input_fired_time: 43.7559661865, output_fired_time: 19.8402900696, propagate_forward_time: 1078.4001464844, propagate_backward_time: 1728.9467773438, weight_update_time: 1.0226733685, other_time: 22.2263183594
epoch time: 222.3656616211s, input_fired_time: 3.1346640587, output_fired_time: 0.0000000000, propagate_forward_time: 215.2836151123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9473876953
validation[          , genome 11960] predictions:    6567/  10000 (65.67%), best:    6684/10000 (66.84%), error:      9890.36914, best error:      9626.48242 on epoch:    33, epoch:   34/100, mu: 0.8907364011, learning_rate: 0.0000673332, weight_decay: 0.0000755277

epoch time: 2903.3723144531s, input_fired_time: 43.8485717773, output_fired_time: 20.0845317841, propagate_forward_time: 1083.4913330078, propagate_backward_time: 1733.7335205078, weight_update_time: 1.0201976299, other_time: 22.2143554688
epoch time: 221.4498443604s, input_fired_time: 3.1382968426, output_fired_time: 0.0000000000, propagate_forward_time: 214.4049987793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9065551758
validation[          , genome 11960] predictions:    6702/  10000 (67.02%), best:    6702/10000 (67.02%), error:      9607.12109, best error:      9607.12109 on epoch:    35, epoch:   35/100, mu: 0.8951319456, learning_rate: 0.0000623641, weight_decay: 0.0000713635

epoch time: 2908.6186523438s, input_fired_time: 43.8385848999, output_fired_time: 20.1076774597, propagate_forward_time: 1082.7651367188, propagate_backward_time: 1739.3945312500, weight_update_time: 1.0355329514, other_time: 22.5126953125
epoch time: 227.6909637451s, input_fired_time: 3.2024238110, output_fired_time: 0.0000000000, propagate_forward_time: 220.5481109619, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9404296875
validation[          , genome 11960] predictions:    6480/  10000 (64.80%), best:    6702/10000 (67.02%), error:     10170.31543, best error:      9607.12109 on epoch:    35, epoch:   36/100, mu: 0.8993328810, learning_rate: 0.0000577616, weight_decay: 0.0000674289

epoch time: 2911.3051757813s, input_fired_time: 43.8872566223, output_fired_time: 19.9675064087, propagate_forward_time: 1084.9351806641, propagate_backward_time: 1740.2340087891, weight_update_time: 1.0177259445, other_time: 22.2812500000
epoch time: 213.6849670410s, input_fired_time: 3.0538358688, output_fired_time: 0.0000000000, propagate_forward_time: 206.7982025146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8329315186
validation[          , genome 11960] predictions:    6708/  10000 (67.08%), best:    6708/10000 (67.08%), error:      9456.88379, best error:      9456.88379 on epoch:    37, epoch:   37/100, mu: 0.9033477902, learning_rate: 0.0000534988, weight_decay: 0.0000637113

epoch time: 2870.9589843750s, input_fired_time: 43.7376174927, output_fired_time: 19.7132244110, propagate_forward_time: 1067.3427734375, propagate_backward_time: 1717.9929199219, weight_update_time: 1.0166196823, other_time: 22.1726074219
epoch time: 220.8888702393s, input_fired_time: 3.1499333382, output_fired_time: 0.0000000000, propagate_forward_time: 213.8167572021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9221801758
validation[          , genome 11960] predictions:    6712/  10000 (67.12%), best:    6708/10000 (67.08%), error:      9580.87500, best error:      9456.88379 on epoch:    37, epoch:   38/100, mu: 0.9071848989, learning_rate: 0.0000495506, weight_decay: 0.0000601986

epoch time: 2806.0429687500s, input_fired_time: 43.3939132690, output_fired_time: 19.5795249939, propagate_forward_time: 1045.3294677734, propagate_backward_time: 1676.0667724609, weight_update_time: 0.9884685874, other_time: 21.6733398438
epoch time: 209.1911621094s, input_fired_time: 3.0089626312, output_fired_time: 0.0000000000, propagate_forward_time: 202.4280090332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7541961670
validation[          , genome 11960] predictions:    6702/  10000 (67.02%), best:    6708/10000 (67.08%), error:      9499.23633, best error:      9456.88379 on epoch:    37, epoch:   39/100, mu: 0.9108520746, learning_rate: 0.0000458937, weight_decay: 0.0000568796

epoch time: 2724.0559082031s, input_fired_time: 42.9202499390, output_fired_time: 18.7363414764, propagate_forward_time: 1009.6879272461, propagate_backward_time: 1631.2679443359, weight_update_time: 0.9718919992, other_time: 21.4434814453
epoch time: 208.4644775391s, input_fired_time: 3.0038194656, output_fired_time: 0.0000000000, propagate_forward_time: 201.7445831299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7160797119
validation[          , genome 11960] predictions:    6781/  10000 (67.81%), best:    6781/10000 (67.81%), error:      9411.33008, best error:      9411.33008 on epoch:    40, epoch:   40/100, mu: 0.9143568873, learning_rate: 0.0000425068, weight_decay: 0.0000537435

epoch time: 2637.8991699219s, input_fired_time: 42.4576339722, output_fired_time: 18.1346778870, propagate_forward_time: 969.6222534180, propagate_backward_time: 1586.8024902344, weight_update_time: 0.9395936131, other_time: 20.8820800781
epoch time: 204.8636474609s, input_fired_time: 2.9697985649, output_fired_time: 0.0000000000, propagate_forward_time: 198.2297821045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6640625000
validation[          , genome 11960] predictions:    6720/  10000 (67.20%), best:    6781/10000 (67.81%), error:      9630.30664, best error:      9411.33008 on epoch:    40, epoch:   41/100, mu: 0.9177064896, learning_rate: 0.0000393698, weight_decay: 0.0000507804

epoch time: 2550.1796875000s, input_fired_time: 42.0629653931, output_fired_time: 17.5493507385, propagate_forward_time: 937.6183471680, propagate_backward_time: 1532.4462890625, weight_update_time: 0.9200698137, other_time: 20.5026855469
epoch time: 186.6600799561s, input_fired_time: 2.7678680420, output_fired_time: 0.0000000000, propagate_forward_time: 180.3411102295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5511016846
validation[          , genome 11960] predictions:    6767/  10000 (67.67%), best:    6781/10000 (67.81%), error:      9487.03516, best error:      9411.33008 on epoch:    40, epoch:   42/100, mu: 0.9209077954, learning_rate: 0.0000364643, weight_decay: 0.0000479807

epoch time: 2475.0134277344s, input_fired_time: 41.6505126953, output_fired_time: 17.0840740204, propagate_forward_time: 907.6010131836, propagate_backward_time: 1488.4064941406, weight_update_time: 0.9078928232, other_time: 20.2712402344
epoch time: 197.0842437744s, input_fired_time: 2.8879146576, output_fired_time: 0.0000000000, propagate_forward_time: 190.5739746094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6223602295
validation[          , genome 11960] predictions:    6809/  10000 (68.09%), best:    6809/10000 (68.09%), error:      9324.51074, best error:      9324.51074 on epoch:    43, epoch:   43/100, mu: 0.9239673018, learning_rate: 0.0000337732, weight_decay: 0.0000453353

epoch time: 2381.5097656250s, input_fired_time: 41.2044296265, output_fired_time: 16.5543422699, propagate_forward_time: 870.3123168945, propagate_backward_time: 1433.6632080078, weight_update_time: 0.8809559941, other_time: 19.7755126953
epoch time: 191.6716918945s, input_fired_time: 2.8394308090, output_fired_time: 0.0000000000, propagate_forward_time: 185.2290954590, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6031646729
validation[          , genome 11960] predictions:    6806/  10000 (68.06%), best:    6806/10000 (68.06%), error:      9292.89941, best error:      9292.89941 on epoch:    44, epoch:   44/100, mu: 0.9268913269, learning_rate: 0.0000312808, weight_decay: 0.0000428357

epoch time: 2285.7414550781s, input_fired_time: 40.7155075073, output_fired_time: 15.9963207245, propagate_forward_time: 830.1277465820, propagate_backward_time: 1379.4951171875, weight_update_time: 0.8601624370, other_time: 19.4067382813
epoch time: 149.1618652344s, input_fired_time: 2.3794503212, output_fired_time: 0.0000000000, propagate_forward_time: 143.5895996094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1928100586
validation[          , genome 11960] predictions:    6715/  10000 (67.15%), best:    6806/10000 (68.06%), error:      9560.50586, best error:      9292.89941 on epoch:    44, epoch:   45/100, mu: 0.9296858907, learning_rate: 0.0000289722, weight_decay: 0.0000404740

epoch time: 2332.3864746094s, input_fired_time: 40.9989166260, output_fired_time: 16.2576694489, propagate_forward_time: 851.0488281250, propagate_backward_time: 1404.3999023438, weight_update_time: 0.8733560443, other_time: 19.6811523438
epoch time: 166.8304748535s, input_fired_time: 2.5741639137, output_fired_time: 0.0000000000, propagate_forward_time: 160.9086761475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3476409912
validation[          , genome 11960] predictions:    6760/  10000 (67.60%), best:    6806/10000 (68.06%), error:      9432.44141, best error:      9292.89941 on epoch:    44, epoch:   46/100, mu: 0.9323567152, learning_rate: 0.0000268341, weight_decay: 0.0000382425

epoch time: 2316.4428710938s, input_fired_time: 40.9322319031, output_fired_time: 16.1236572266, propagate_forward_time: 846.1112670898, propagate_backward_time: 1393.7784423828, weight_update_time: 0.8656015396, other_time: 19.4974365234
epoch time: 177.2252960205s, input_fired_time: 2.6875815392, output_fired_time: 0.0000000000, propagate_forward_time: 171.0847930908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4529266357
validation[          , genome 11960] predictions:    6833/  10000 (68.33%), best:    6833/10000 (68.33%), error:      9267.63867, best error:      9267.63867 on epoch:    47, epoch:   47/100, mu: 0.9349092841, learning_rate: 0.0000248537, weight_decay: 0.0000361340

epoch time: 2284.5280761719s, input_fired_time: 40.7665863037, output_fired_time: 15.8584012985, propagate_forward_time: 834.3705444336, propagate_backward_time: 1374.0821533203, weight_update_time: 0.8628964424, other_time: 19.4503173828
epoch time: 155.6620788574s, input_fired_time: 2.4569845200, output_fired_time: 0.0000000000, propagate_forward_time: 149.9290313721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2760620117
validation[          , genome 11960] predictions:    6736/  10000 (67.36%), best:    6833/10000 (68.33%), error:      9451.59375, best error:      9267.63867 on epoch:    47, epoch:   48/100, mu: 0.9373487830, learning_rate: 0.0000230195, weight_decay: 0.0000341418

epoch time: 2198.6181640625s, input_fired_time: 40.3258171082, output_fired_time: 15.3436059952, propagate_forward_time: 797.8952636719, propagate_backward_time: 1325.8564453125, weight_update_time: 0.8471135497, other_time: 19.1970214844
epoch time: 149.6821746826s, input_fired_time: 2.3896667957, output_fired_time: 0.0000000000, propagate_forward_time: 144.0850830078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2074279785
validation[          , genome 11960] predictions:    6704/  10000 (67.04%), best:    6833/10000 (68.33%), error:      9563.06250, best error:      9267.63867 on epoch:    47, epoch:   49/100, mu: 0.9396802783, learning_rate: 0.0000213207, weight_decay: 0.0000322594

epoch time: 2204.8557128906s, input_fired_time: 40.3382873535, output_fired_time: 15.3845043182, propagate_forward_time: 797.6545410156, propagate_backward_time: 1332.3529052734, weight_update_time: 0.8424358964, other_time: 19.1253662109
epoch time: 178.6650238037s, input_fired_time: 2.7097814083, output_fired_time: 0.0000000000, propagate_forward_time: 172.5017852783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4534606934
validation[          , genome 11960] predictions:    6780/  10000 (67.80%), best:    6833/10000 (68.33%), error:      9459.19629, best error:      9267.63867 on epoch:    47, epoch:   50/100, mu: 0.9419085383, learning_rate: 0.0000197472, weight_decay: 0.0000304808

epoch time: 2199.8691406250s, input_fired_time: 40.3606224060, output_fired_time: 15.4557104111, propagate_forward_time: 797.1712646484, propagate_backward_time: 1327.7984619141, weight_update_time: 0.8404403329, other_time: 19.0830078125
epoch time: 170.2806243896s, input_fired_time: 2.6244845390, output_fired_time: 0.0000000000, propagate_forward_time: 164.2592620850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3968811035
validation[          , genome 11960] predictions:    6821/  10000 (68.21%), best:    6833/10000 (68.33%), error:      9281.21777, best error:      9267.63867 on epoch:    47, epoch:   51/100, mu: 0.9440380931, learning_rate: 0.0000182899, weight_decay: 0.0000288002

epoch time: 2089.2971191406s, input_fired_time: 39.7532997131, output_fired_time: 14.6914339066, propagate_forward_time: 751.1325073242, propagate_backward_time: 1265.0280761719, weight_update_time: 0.8204157352, other_time: 18.6916503906
epoch time: 143.8330993652s, input_fired_time: 2.3416650295, output_fired_time: 0.0000000000, propagate_forward_time: 138.2985687256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1928710938
validation[          , genome 11960] predictions:    6848/  10000 (68.48%), best:    6848/10000 (68.48%), error:      9249.15723, best error:      9249.15723 on epoch:    52, epoch:   52/100, mu: 0.9460733533, learning_rate: 0.0000169401, weight_decay: 0.0000272124

epoch time: 2034.3100585938s, input_fired_time: 39.4963798523, output_fired_time: 14.3713932037, propagate_forward_time: 729.7638549805, propagate_backward_time: 1232.2365722656, weight_update_time: 0.8031237125, other_time: 18.4418945313
epoch time: 152.3576354980s, input_fired_time: 2.4364900589, output_fired_time: 0.0000000000, propagate_forward_time: 146.6751251221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2460174561
validation[          , genome 11960] predictions:    6833/  10000 (68.33%), best:    6833/10000 (68.33%), error:      9228.91406, best error:      9228.91406 on epoch:    53, epoch:   53/100, mu: 0.9480184913, learning_rate: 0.0000156899, weight_decay: 0.0000257120

epoch time: 2140.6569824219s, input_fired_time: 40.0755844116, output_fired_time: 15.0841884613, propagate_forward_time: 772.2263793945, propagate_backward_time: 1294.4230957031, weight_update_time: 0.8276116252, other_time: 18.8476562500
epoch time: 182.1838531494s, input_fired_time: 2.7585699558, output_fired_time: 0.0000000000, propagate_forward_time: 175.9581604004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4671173096
validation[          , genome 11960] predictions:    6854/  10000 (68.54%), best:    6854/10000 (68.54%), error:      9152.44727, best error:      9152.44727 on epoch:    54, epoch:   54/100, mu: 0.9498775005, learning_rate: 0.0000145320, weight_decay: 0.0000242944

epoch time: 2051.1264648438s, input_fired_time: 39.6090354919, output_fired_time: 14.4434461594, propagate_forward_time: 738.7314453125, propagate_backward_time: 1239.7698974609, weight_update_time: 0.8099306822, other_time: 18.5726318359
epoch time: 160.8065948486s, input_fired_time: 2.5259051323, output_fired_time: 0.0000000000, propagate_forward_time: 154.9662170410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3144683838
validation[          , genome 11960] predictions:    6838/  10000 (68.38%), best:    6854/10000 (68.54%), error:      9170.80273, best error:      9152.44727 on epoch:    54, epoch:   55/100, mu: 0.9516541958, learning_rate: 0.0000134595, weight_decay: 0.0000229549

epoch time: 2037.1104736328s, input_fired_time: 39.5569648743, output_fired_time: 14.4127101898, propagate_forward_time: 731.6555175781, propagate_backward_time: 1232.9797363281, weight_update_time: 0.8054628968, other_time: 18.5054931641
epoch time: 140.0621185303s, input_fired_time: 2.3093323708, output_fired_time: 0.0000000000, propagate_forward_time: 134.5910186768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1617736816
validation[          , genome 11960] predictions:    6820/  10000 (68.20%), best:    6854/10000 (68.54%), error:      9315.59570, best error:      9152.44727 on epoch:    54, epoch:   56/100, mu: 0.9533522129, learning_rate: 0.0000124662, weight_decay: 0.0000216893

epoch time: 1896.2347412109s, input_fired_time: 38.8318824768, output_fired_time: 13.5888090134, propagate_forward_time: 672.8026733398, propagate_backward_time: 1153.1668701172, weight_update_time: 0.7709862590, other_time: 17.8443603516
epoch time: 164.9224243164s, input_fired_time: 2.5714476109, output_fired_time: 0.0000000000, propagate_forward_time: 158.9917297363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3592529297
validation[          , genome 11960] predictions:    6804/  10000 (68.04%), best:    6854/10000 (68.54%), error:      9287.30469, best error:      9152.44727 on epoch:    54, epoch:   57/100, mu: 0.9549750686, learning_rate: 0.0000115462, weight_decay: 0.0000204935

epoch time: 2111.1508789063s, input_fired_time: 39.9125862122, output_fired_time: 14.8701906204, propagate_forward_time: 759.2863769531, propagate_backward_time: 1278.3027343750, weight_update_time: 0.8227401972, other_time: 18.7790527344
epoch time: 231.3819427490s, input_fired_time: 3.2968854904, output_fired_time: 0.0000000000, propagate_forward_time: 224.1721801758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9128723145
validation[          , genome 11960] predictions:    6837/  10000 (68.37%), best:    6854/10000 (68.54%), error:      9186.26270, best error:      9152.44727 on epoch:    54, epoch:   58/100, mu: 0.9565260410, learning_rate: 0.0000106941, weight_decay: 0.0000193636

epoch time: 1992.1638183594s, input_fired_time: 39.3544425964, output_fired_time: 14.1130037308, propagate_forward_time: 713.8146362305, propagate_backward_time: 1206.5239257813, weight_update_time: 0.7945585251, other_time: 18.3576660156
epoch time: 133.7488861084s, input_fired_time: 2.2500526905, output_fired_time: 0.0000000000, propagate_forward_time: 128.4390106201, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0598297119
validation[          , genome 11960] predictions:    6862/  10000 (68.62%), best:    6854/10000 (68.54%), error:      9180.01465, best error:      9152.44727 on epoch:    54, epoch:   59/100, mu: 0.9580083489, learning_rate: 0.0000099049, weight_decay: 0.0000182960

epoch time: 2088.3845214844s, input_fired_time: 39.8536567688, output_fired_time: 14.6947250366, propagate_forward_time: 752.0207519531, propagate_backward_time: 1263.1147460938, weight_update_time: 0.8180764914, other_time: 18.7005615234
epoch time: 140.0555725098s, input_fired_time: 2.3127465248, output_fired_time: 0.0000000000, propagate_forward_time: 134.6145324707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1282958984
validation[          , genome 11960] predictions:    6887/  10000 (68.87%), best:    6887/10000 (68.87%), error:      9130.21875, best error:      9130.21875 on epoch:    60, epoch:   60/100, mu: 0.9594249725, learning_rate: 0.0000091739, weight_decay: 0.0000172873

epoch time: 2001.8992919922s, input_fired_time: 39.3920173645, output_fired_time: 14.1629257202, propagate_forward_time: 715.9897460938, propagate_backward_time: 1214.0058593750, weight_update_time: 0.7962409258, other_time: 18.3487548828
epoch time: 157.4339447021s, input_fired_time: 2.5041294098, output_fired_time: 0.0000000000, propagate_forward_time: 151.6491088867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2807006836
validation[          , genome 11960] predictions:    6898/  10000 (68.98%), best:    6898/10000 (68.98%), error:      9075.55664, best error:      9075.55664 on epoch:    61, epoch:   61/100, mu: 0.9607788920, learning_rate: 0.0000084969, weight_decay: 0.0000163341

epoch time: 2060.3581542969s, input_fired_time: 39.7158164978, output_fired_time: 14.5806732178, propagate_forward_time: 739.4758911133, propagate_backward_time: 1248.0379638672, weight_update_time: 0.8078829646, other_time: 18.5477294922
epoch time: 176.9585113525s, input_fired_time: 2.7184181213, output_fired_time: 0.0000000000, propagate_forward_time: 170.7819519043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4581451416
validation[          , genome 11960] predictions:    6914/  10000 (69.14%), best:    6898/10000 (68.98%), error:      9079.04297, best error:      9075.55664 on epoch:    61, epoch:   62/100, mu: 0.9620728493, learning_rate: 0.0000078698, weight_decay: 0.0000154336

epoch time: 2016.5437011719s, input_fired_time: 39.5103225708, output_fired_time: 14.2308959961, propagate_forward_time: 723.1903686523, propagate_backward_time: 1221.1875000000, weight_update_time: 0.8003451824, other_time: 18.4245605469
epoch time: 165.8822174072s, input_fired_time: 2.5981369019, output_fired_time: 0.0000000000, propagate_forward_time: 159.9200286865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3640594482
validation[          , genome 11960] predictions:    6886/  10000 (68.86%), best:    6898/10000 (68.98%), error:      9117.82129, best error:      9075.55664 on epoch:    61, epoch:   63/100, mu: 0.9633095264, learning_rate: 0.0000072890, weight_decay: 0.0000145826

epoch time: 2060.3120117188s, input_fired_time: 39.7236747742, output_fired_time: 14.5487651825, propagate_forward_time: 737.7175903320, propagate_backward_time: 1249.7379150391, weight_update_time: 0.8092215061, other_time: 18.5841064453
epoch time: 156.7285919189s, input_fired_time: 2.5018894672, output_fired_time: 0.0000000000, propagate_forward_time: 150.9757843018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2509155273
validation[          , genome 11960] predictions:    6861/  10000 (68.61%), best:    6898/10000 (68.98%), error:      9124.18652, best error:      9075.55664 on epoch:    61, epoch:   64/100, mu: 0.9644914269, learning_rate: 0.0000067511, weight_decay: 0.0000137786

epoch time: 2171.6928710938s, input_fired_time: 40.3356437683, output_fired_time: 15.2377576828, propagate_forward_time: 785.6881103516, propagate_backward_time: 1311.4356689453, weight_update_time: 0.8356398344, other_time: 18.9956054688
epoch time: 149.6035156250s, input_fired_time: 2.4278149605, output_fired_time: 0.0000000000, propagate_forward_time: 143.9503784180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2253265381
validation[          , genome 11960] predictions:    6891/  10000 (68.91%), best:    6891/10000 (68.91%), error:      9075.32715, best error:      9075.32715 on epoch:    65, epoch:   65/100, mu: 0.9656209946, learning_rate: 0.0000062528, weight_decay: 0.0000130190

epoch time: 2129.2365722656s, input_fired_time: 40.1430320740, output_fired_time: 14.9946708679, propagate_forward_time: 769.6454467773, propagate_backward_time: 1285.6269531250, weight_update_time: 0.8268188238, other_time: 18.8264160156
epoch time: 172.8189849854s, input_fired_time: 2.6799049377, output_fired_time: 0.0000000000, propagate_forward_time: 166.7446136475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3944702148
validation[          , genome 11960] predictions:    6842/  10000 (68.42%), best:    6891/10000 (68.91%), error:      9085.27832, best error:      9075.32715 on epoch:    65, epoch:   66/100, mu: 0.9667005539, learning_rate: 0.0000057914, weight_decay: 0.0000123012

epoch time: 2350.8537597656s, input_fired_time: 41.2913131714, output_fired_time: 16.3430767059, propagate_forward_time: 859.2946777344, propagate_backward_time: 1414.2554931641, weight_update_time: 0.8762093782, other_time: 19.6693115234
epoch time: 174.2008209229s, input_fired_time: 2.6901187897, output_fired_time: 0.0000000000, propagate_forward_time: 168.0733032227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4373931885
validation[          , genome 11960] predictions:    6858/  10000 (68.58%), best:    6891/10000 (68.91%), error:      9119.66797, best error:      9075.32715 on epoch:    65, epoch:   67/100, mu: 0.9677323103, learning_rate: 0.0000053640, weight_decay: 0.0000116229

epoch time: 2151.5451660156s, input_fired_time: 40.2733230591, output_fired_time: 15.1075086594, propagate_forward_time: 778.9219970703, propagate_backward_time: 1298.3184814453, weight_update_time: 0.8307814598, other_time: 18.9238281250
epoch time: 187.7726745605s, input_fired_time: 2.8485612869, output_fired_time: 0.0000000000, propagate_forward_time: 181.3639526367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5601654053
validation[          , genome 11960] predictions:    6880/  10000 (68.80%), best:    6880/10000 (68.80%), error:      9068.36621, best error:      9068.36621 on epoch:    68, epoch:   68/100, mu: 0.9687183499, learning_rate: 0.0000049681, weight_decay: 0.0000109821

epoch time: 2186.8679199219s, input_fired_time: 40.4735755920, output_fired_time: 15.3704738617, propagate_forward_time: 794.8809814453, propagate_backward_time: 1317.0974121094, weight_update_time: 0.8401870728, other_time: 19.0455322266
epoch time: 165.3988800049s, input_fired_time: 2.6012821198, output_fired_time: 0.0000000000, propagate_forward_time: 159.4576721191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3399200439
validation[          , genome 11960] predictions:    6932/  10000 (69.32%), best:    6932/10000 (69.32%), error:      8944.73926, best error:      8944.73926 on epoch:    69, epoch:   69/100, mu: 0.9696607590, learning_rate: 0.0000046015, weight_decay: 0.0000103766

epoch time: 2250.5732421875s, input_fired_time: 40.8185081482, output_fired_time: 15.7282876968, propagate_forward_time: 819.5706787109, propagate_backward_time: 1355.1811523438, weight_update_time: 0.8523573875, other_time: 19.2745361328
epoch time: 189.1764831543s, input_fired_time: 2.8612473011, output_fired_time: 0.0000000000, propagate_forward_time: 182.7711944580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5440368652
validation[          , genome 11960] predictions:    6926/  10000 (69.26%), best:    6932/10000 (69.32%), error:      8972.92188, best error:      8944.73926 on epoch:    69, epoch:   70/100, mu: 0.9705614448, learning_rate: 0.0000042619, weight_decay: 0.0000098045

epoch time: 2273.8657226563s, input_fired_time: 40.9154624939, output_fired_time: 15.7919807434, propagate_forward_time: 829.3784790039, propagate_backward_time: 1368.3767089844, weight_update_time: 0.8599697351, other_time: 19.4030761719
epoch time: 191.0742034912s, input_fired_time: 2.8759894371, output_fired_time: 0.0000000000, propagate_forward_time: 184.6492614746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5489501953
validation[          , genome 11960] predictions:    6915/  10000 (69.15%), best:    6932/10000 (69.32%), error:      8985.73047, best error:      8944.73926 on epoch:    69, epoch:   71/100, mu: 0.9714221954, learning_rate: 0.0000039474, weight_decay: 0.0000092640

epoch time: 2245.8215332031s, input_fired_time: 40.7493247986, output_fired_time: 15.6900253296, propagate_forward_time: 815.1578979492, propagate_backward_time: 1354.9359130859, weight_update_time: 0.8527698517, other_time: 19.2884521484
epoch time: 222.4552307129s, input_fired_time: 3.2169978619, output_fired_time: 0.0000000000, propagate_forward_time: 215.3930969238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8451385498
validation[          , genome 11960] predictions:    6919/  10000 (69.19%), best:    6932/10000 (69.32%), error:      8968.63672, best error:      8944.73926 on epoch:    69, epoch:   72/100, mu: 0.9722448587, learning_rate: 0.0000036560, weight_decay: 0.0000087532

epoch time: 2281.5405273438s, input_fired_time: 40.9917907715, output_fired_time: 15.9323225021, propagate_forward_time: 831.1183471680, propagate_backward_time: 1374.1348876953, weight_update_time: 0.8575734496, other_time: 19.3631591797
epoch time: 165.4500427246s, input_fired_time: 2.6090040207, output_fired_time: 0.0000000000, propagate_forward_time: 159.4971466064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3438873291
validation[          , genome 11960] predictions:    6937/  10000 (69.37%), best:    6932/10000 (69.32%), error:      9009.32129, best error:      8944.73926 on epoch:    69, epoch:   73/100, mu: 0.9730311036, learning_rate: 0.0000033862, weight_decay: 0.0000082706

epoch time: 2229.1103515625s, input_fired_time: 40.7494239807, output_fired_time: 15.5936737061, propagate_forward_time: 813.9323120117, propagate_backward_time: 1339.5957031250, weight_update_time: 0.8509064317, other_time: 19.2390136719
epoch time: 178.6640472412s, input_fired_time: 2.7511608601, output_fired_time: 0.0000000000, propagate_forward_time: 172.4432678223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4696197510
validation[          , genome 11960] predictions:    6942/  10000 (69.42%), best:    6942/10000 (69.42%), error:      8939.40527, best error:      8939.40527 on epoch:    74, epoch:   74/100, mu: 0.9737825394, learning_rate: 0.0000031363, weight_decay: 0.0000078146

epoch time: 2279.6721191406s, input_fired_time: 40.9631500244, output_fired_time: 15.9225654602, propagate_forward_time: 830.3833618164, propagate_backward_time: 1372.9852294922, weight_update_time: 0.8625687361, other_time: 19.4178466797
epoch time: 140.0762939453s, input_fired_time: 2.3342659473, output_fired_time: 0.0000000000, propagate_forward_time: 134.6205291748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1215057373
validation[          , genome 11960] predictions:    6970/  10000 (69.70%), best:    6970/10000 (69.70%), error:      8907.14355, best error:      8907.14355 on epoch:    75, epoch:   75/100, mu: 0.9745006561, learning_rate: 0.0000029049, weight_decay: 0.0000073837

epoch time: 2147.2229003906s, input_fired_time: 40.2660140991, output_fired_time: 15.0910806656, propagate_forward_time: 774.0106811523, propagate_backward_time: 1299.0155029297, weight_update_time: 0.8251512051, other_time: 18.8394775391
epoch time: 175.9691467285s, input_fired_time: 2.7168910503, output_fired_time: 0.0000000000, propagate_forward_time: 169.8081359863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4441223145
validation[          , genome 11960] predictions:    6935/  10000 (69.35%), best:    6970/10000 (69.70%), error:      9003.52441, best error:      8907.14355 on epoch:    75, epoch:   76/100, mu: 0.9751870036, learning_rate: 0.0000026905, weight_decay: 0.0000069766

epoch time: 2107.2312011719s, input_fired_time: 40.0556793213, output_fired_time: 14.8575410843, propagate_forward_time: 757.1726074219, propagate_backward_time: 1276.4471435547, weight_update_time: 0.8196159601, other_time: 18.6983642578
epoch time: 166.6785430908s, input_fired_time: 2.6218781471, output_fired_time: 0.0000000000, propagate_forward_time: 160.6973419189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3593292236
validation[          , genome 11960] predictions:    6954/  10000 (69.54%), best:    6970/10000 (69.70%), error:      8930.16504, best error:      8907.14355 on epoch:    75, epoch:   77/100, mu: 0.9758429527, learning_rate: 0.0000024919, weight_decay: 0.0000065920

epoch time: 2091.7619628906s, input_fired_time: 39.9599304199, output_fired_time: 14.6950664520, propagate_forward_time: 751.5573120117, propagate_backward_time: 1266.8243408203, weight_update_time: 0.8195841312, other_time: 18.7252197266
epoch time: 181.0109558105s, input_fired_time: 2.7804639339, output_fired_time: 0.0000000000, propagate_forward_time: 174.7410888672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4894104004
validation[          , genome 11960] predictions:    6968/  10000 (69.68%), best:    6968/10000 (69.68%), error:      8874.26465, best error:      8874.26465 on epoch:    78, epoch:   78/100, mu: 0.9764698744, learning_rate: 0.0000023080, weight_decay: 0.0000062285

epoch time: 2219.5617675781s, input_fired_time: 40.7179145813, output_fired_time: 15.4831657410, propagate_forward_time: 808.5011596680, propagate_backward_time: 1335.6875000000, weight_update_time: 0.8446064591, other_time: 19.1718750000
epoch time: 157.0976562500s, input_fired_time: 2.5230295658, output_fired_time: 0.0000000000, propagate_forward_time: 151.3057403564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2688903809
validation[          , genome 11960] predictions:    6951/  10000 (69.51%), best:    6968/10000 (69.68%), error:      8949.17188, best error:      8874.26465 on epoch:    78, epoch:   79/100, mu: 0.9770690203, learning_rate: 0.0000021377, weight_decay: 0.0000058851

epoch time: 2185.9614257813s, input_fired_time: 40.5283508301, output_fired_time: 15.3147869110, propagate_forward_time: 792.0308227539, propagate_backward_time: 1318.9486083984, weight_update_time: 0.8401959538, other_time: 19.1390380859
epoch time: 180.7339935303s, input_fired_time: 2.7709729671, output_fired_time: 0.0000000000, propagate_forward_time: 174.4897460938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4732818604
validation[          , genome 11960] predictions:    6895/  10000 (68.95%), best:    6968/10000 (69.68%), error:      9053.79688, best error:      8874.26465 on epoch:    78, epoch:   80/100, mu: 0.9776416421, learning_rate: 0.0000019799, weight_decay: 0.0000055607

epoch time: 2063.6940917969s, input_fired_time: 39.8367958069, output_fired_time: 14.5620508194, propagate_forward_time: 740.3045043945, propagate_backward_time: 1250.3666992188, weight_update_time: 0.8120136261, other_time: 18.6240234375
epoch time: 179.3403930664s, input_fired_time: 2.7678177357, output_fired_time: 0.0000000000, propagate_forward_time: 173.0857543945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4868164063
validation[          , genome 11960] predictions:    6958/  10000 (69.58%), best:    6968/10000 (69.68%), error:      8879.15723, best error:      8874.26465 on epoch:    78, epoch:   81/100, mu: 0.9781888723, learning_rate: 0.0000018338, weight_decay: 0.0000052541

epoch time: 2002.8763427734s, input_fired_time: 39.5750579834, output_fired_time: 14.2347574234, propagate_forward_time: 717.7653808594, propagate_backward_time: 1212.9726562500, weight_update_time: 0.7961840034, other_time: 18.3284912109
epoch time: 136.2679290771s, input_fired_time: 2.3002431393, output_fired_time: 0.0000000000, propagate_forward_time: 130.8729400635, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0947418213
validation[          , genome 11960] predictions:    6987/  10000 (69.87%), best:    6968/10000 (69.68%), error:      8874.51660, best error:      8874.26465 on epoch:    78, epoch:   82/100, mu: 0.9787119031, learning_rate: 0.0000016985, weight_decay: 0.0000049644

epoch time: 2122.3898925781s, input_fired_time: 40.1582412720, output_fired_time: 14.9203147888, propagate_forward_time: 763.0833740234, propagate_backward_time: 1285.4665527344, weight_update_time: 0.8219470978, other_time: 18.7613525391
epoch time: 151.8890991211s, input_fired_time: 2.4653995037, output_fired_time: 0.0000000000, propagate_forward_time: 146.2046051025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2191009521
validation[          , genome 11960] predictions:    6981/  10000 (69.81%), best:    6968/10000 (69.68%), error:      8910.48633, best error:      8874.26465 on epoch:    78, epoch:   83/100, mu: 0.9792117476, learning_rate: 0.0000015731, weight_decay: 0.0000046907

epoch time: 1991.8503417969s, input_fired_time: 39.4984703064, output_fired_time: 14.1046934128, propagate_forward_time: 712.7741699219, propagate_backward_time: 1207.2329101563, weight_update_time: 0.7927673459, other_time: 18.2401123047
epoch time: 175.6568603516s, input_fired_time: 2.7322156429, output_fired_time: 0.0000000000, propagate_forward_time: 169.5093841553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4152679443
validation[          , genome 11960] predictions:    6949/  10000 (69.49%), best:    6949/10000 (69.49%), error:      8864.40137, best error:      8864.40137 on epoch:    84, epoch:   84/100, mu: 0.9796894789, learning_rate: 0.0000014570, weight_decay: 0.0000044321

epoch time: 1988.8607177734s, input_fired_time: 39.5137481689, output_fired_time: 14.1255493164, propagate_forward_time: 712.8309936523, propagate_backward_time: 1204.0627441406, weight_update_time: 0.7934707999, other_time: 18.3276367188
epoch time: 160.4060058594s, input_fired_time: 2.5678369999, output_fired_time: 0.0000000000, propagate_forward_time: 154.5568847656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2812805176
validation[          , genome 11960] predictions:    6958/  10000 (69.58%), best:    6958/10000 (69.58%), error:      8858.22461, best error:      8858.22461 on epoch:    85, epoch:   85/100, mu: 0.9801460505, learning_rate: 0.0000013495, weight_decay: 0.0000041877

epoch time: 1957.9083251953s, input_fired_time: 39.2940025330, output_fired_time: 13.8937520981, propagate_forward_time: 696.4619140625, propagate_backward_time: 1190.0340576172, weight_update_time: 0.7886906266, other_time: 18.2246093750
epoch time: 133.5420379639s, input_fired_time: 2.2739958763, output_fired_time: 0.0000000000, propagate_forward_time: 128.1950378418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0729980469
validation[          , genome 11960] predictions:    6951/  10000 (69.51%), best:    6958/10000 (69.58%), error:      8879.40039, best error:      8858.22461 on epoch:    85, epoch:   86/100, mu: 0.9805824161, learning_rate: 0.0000012499, weight_decay: 0.0000039568

epoch time: 1824.7249755859s, input_fired_time: 38.6317253113, output_fired_time: 13.0886888504, propagate_forward_time: 643.2879638672, propagate_backward_time: 1112.0729980469, weight_update_time: 0.7561585903, other_time: 17.6435546875
epoch time: 133.2836456299s, input_fired_time: 2.2707915306, output_fired_time: 0.0000000000, propagate_forward_time: 127.9697036743, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0431442261
validation[          , genome 11960] predictions:    6982/  10000 (69.82%), best:    6958/10000 (69.58%), error:      8861.63086, best error:      8858.22461 on epoch:    85, epoch:   87/100, mu: 0.9809994698, learning_rate: 0.0000011577, weight_decay: 0.0000037387

epoch time: 1825.9281005859s, input_fired_time: 38.6273422241, output_fired_time: 13.0913267136, propagate_forward_time: 644.0468750000, propagate_backward_time: 1112.5279541016, weight_update_time: 0.7568597198, other_time: 17.6346435547
epoch time: 133.7518005371s, input_fired_time: 2.2777535915, output_fired_time: 0.0000000000, propagate_forward_time: 128.4236297607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0504150391
validation[          , genome 11960] predictions:    6982/  10000 (69.82%), best:    6958/10000 (69.58%), error:      8871.12207, best error:      8858.22461 on epoch:    85, epoch:   88/100, mu: 0.9813980460, learning_rate: 0.0000010722, weight_decay: 0.0000035325

epoch time: 1825.7767333984s, input_fired_time: 38.6358985901, output_fired_time: 13.1098957062, propagate_forward_time: 644.2799072266, propagate_backward_time: 1112.1048583984, weight_update_time: 0.7567042708, other_time: 17.6462402344
epoch time: 133.3297271729s, input_fired_time: 2.2741839886, output_fired_time: 0.0000000000, propagate_forward_time: 127.9986877441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0568542480
validation[          , genome 11960] predictions:    6967/  10000 (69.67%), best:    6958/10000 (69.58%), error:      8867.28125, best error:      8858.22461 on epoch:    85, epoch:   89/100, mu: 0.9817789793, learning_rate: 0.0000009931, weight_decay: 0.0000033378

epoch time: 1818.1087646484s, input_fired_time: 38.5799369812, output_fired_time: 13.0486640930, propagate_forward_time: 640.7680053711, propagate_backward_time: 1108.1317138672, weight_update_time: 0.7545425892, other_time: 17.5804443359
epoch time: 133.2376251221s, input_fired_time: 2.2708771229, output_fired_time: 0.0000000000, propagate_forward_time: 127.9185028076, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0482482910
validation[          , genome 11960] predictions:    6984/  10000 (69.84%), best:    6958/10000 (69.58%), error:      8860.06543, best error:      8858.22461 on epoch:    85, epoch:   90/100, mu: 0.9821430445, learning_rate: 0.0000009198, weight_decay: 0.0000031537

epoch time: 1817.1414794922s, input_fired_time: 38.5663452148, output_fired_time: 13.0434188843, propagate_forward_time: 640.5808715820, propagate_backward_time: 1107.4361572266, weight_update_time: 0.7511413693, other_time: 17.5147705078
epoch time: 133.3197326660s, input_fired_time: 2.2723999023, output_fired_time: 0.0000000000, propagate_forward_time: 127.9894790649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0578536987
validation[          , genome 11960] predictions:    6975/  10000 (69.75%), best:    6958/10000 (69.58%), error:      8877.47363, best error:      8858.22461 on epoch:    85, epoch:   91/100, mu: 0.9824909568, learning_rate: 0.0000008519, weight_decay: 0.0000029799

epoch time: 1816.6823730469s, input_fired_time: 38.5604400635, output_fired_time: 13.0422153473, propagate_forward_time: 640.5227661133, propagate_backward_time: 1107.0739746094, weight_update_time: 0.7520902157, other_time: 17.4829101563
epoch time: 133.2080688477s, input_fired_time: 2.2714393139, output_fired_time: 0.0000000000, propagate_forward_time: 127.8993453979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0372848511
validation[          , genome 11960] predictions:    6976/  10000 (69.76%), best:    6958/10000 (69.58%), error:      8889.69141, best error:      8858.22461 on epoch:    85, epoch:   92/100, mu: 0.9828234911, learning_rate: 0.0000007891, weight_decay: 0.0000028156

epoch time: 1816.1076660156s, input_fired_time: 38.5533218384, output_fired_time: 13.0379018784, propagate_forward_time: 640.0402221680, propagate_backward_time: 1107.0322265625, weight_update_time: 0.7517122030, other_time: 17.4440917969
epoch time: 133.3598175049s, input_fired_time: 2.2767398357, output_fired_time: 0.0000000000, propagate_forward_time: 128.0303649902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0527191162
validation[          , genome 11960] predictions:    6973/  10000 (69.73%), best:    6958/10000 (69.58%), error:      8859.61914, best error:      8858.22461 on epoch:    85, epoch:   93/100, mu: 0.9831413031, learning_rate: 0.0000007308, weight_decay: 0.0000026603

epoch time: 1816.1385498047s, input_fired_time: 38.5643348694, output_fired_time: 13.0388288498, propagate_forward_time: 640.3147583008, propagate_backward_time: 1106.7459716797, weight_update_time: 0.7526478171, other_time: 17.4747314453
epoch time: 133.3039855957s, input_fired_time: 2.2736277580, output_fired_time: 0.0000000000, propagate_forward_time: 127.9787216187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0516433716
validation[          , genome 11960] predictions:    6968/  10000 (69.68%), best:    6958/10000 (69.58%), error:      8863.87598, best error:      8858.22461 on epoch:    85, epoch:   94/100, mu: 0.9834449887, learning_rate: 0.0000006769, weight_decay: 0.0000025137

epoch time: 1815.4960937500s, input_fired_time: 38.5491867065, output_fired_time: 13.0385923386, propagate_forward_time: 639.7750244141, propagate_backward_time: 1106.6590576172, weight_update_time: 0.7521071434, other_time: 17.4742431641
epoch time: 133.1062011719s, input_fired_time: 2.2740223408, output_fired_time: 0.0000000000, propagate_forward_time: 127.8045806885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0276031494
validation[          , genome 11960] predictions:    6998/  10000 (69.98%), best:    6998/10000 (69.98%), error:      8833.26563, best error:      8833.26563 on epoch:    95, epoch:   95/100, mu: 0.9837352633, learning_rate: 0.0000006269, weight_decay: 0.0000023751

epoch time: 1815.5834960938s, input_fired_time: 38.5546760559, output_fired_time: 13.0538320541, propagate_forward_time: 639.8981933594, propagate_backward_time: 1106.6431884766, weight_update_time: 0.7546682954, other_time: 17.4335937500
epoch time: 133.2148284912s, input_fired_time: 2.2712266445, output_fired_time: 0.0000000000, propagate_forward_time: 127.8686523438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0749511719
validation[          , genome 11960] predictions:    6991/  10000 (69.91%), best:    6998/10000 (69.98%), error:      8836.14063, best error:      8833.26563 on epoch:    95, epoch:   96/100, mu: 0.9840126634, learning_rate: 0.0000005807, weight_decay: 0.0000022441

epoch time: 1815.6094970703s, input_fired_time: 38.5591583252, output_fired_time: 13.0366287231, propagate_forward_time: 640.1126098633, propagate_backward_time: 1106.4558105469, weight_update_time: 0.7512252927, other_time: 17.4453125000
epoch time: 133.1049957275s, input_fired_time: 2.2733609676, output_fired_time: 0.0000000000, propagate_forward_time: 127.8020172119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0296173096
validation[          , genome 11960] predictions:    6993/  10000 (69.93%), best:    6993/10000 (69.93%), error:      8825.27148, best error:      8825.27148 on epoch:    97, epoch:   97/100, mu: 0.9842777848, learning_rate: 0.0000005378, weight_decay: 0.0000021204

epoch time: 1816.0705566406s, input_fired_time: 38.5998535156, output_fired_time: 13.0412893295, propagate_forward_time: 639.7656860352, propagate_backward_time: 1107.1630859375, weight_update_time: 0.7523862123, other_time: 17.5007324219
epoch time: 133.2420043945s, input_fired_time: 2.2837839127, output_fired_time: 0.0000000000, propagate_forward_time: 127.9062728882, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0519485474
validation[          , genome 11960] predictions:    6994/  10000 (69.94%), best:    6994/10000 (69.94%), error:      8823.17090, best error:      8823.17090 on epoch:    98, epoch:   98/100, mu: 0.9845311642, learning_rate: 0.0000004981, weight_decay: 0.0000020035

epoch time: 1816.3669433594s, input_fired_time: 38.6164016724, output_fired_time: 13.0467844009, propagate_forward_time: 640.0770874023, propagate_backward_time: 1107.0556640625, weight_update_time: 0.7528031468, other_time: 17.5710449219
epoch time: 133.1603240967s, input_fired_time: 2.2755591869, output_fired_time: 0.0000000000, propagate_forward_time: 127.8596038818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0251617432
validation[          , genome 11960] predictions:    6988/  10000 (69.88%), best:    6994/10000 (69.94%), error:      8823.98047, best error:      8823.17090 on epoch:    98, epoch:   99/100, mu: 0.9847733378, learning_rate: 0.0000004614, weight_decay: 0.0000018930

epoch time: 1815.8079833984s, input_fired_time: 38.5753669739, output_fired_time: 13.0381050110, propagate_forward_time: 639.8178710938, propagate_backward_time: 1106.8621826172, weight_update_time: 0.7526749969, other_time: 17.5145263672
epoch time: 133.1551055908s, input_fired_time: 2.2748756409, output_fired_time: 0.0000000000, propagate_forward_time: 127.8602294922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0200042725
validation[          , genome 11960] predictions:    6996/  10000 (69.96%), best:    6994/10000 (69.94%), error:      8833.60156, best error:      8823.17090 on epoch:    98, epoch:  100/100, mu: 0.9850047827, learning_rate: 0.0000004273, weight_decay: 0.0000017887

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 665.6461791992s, input_fired_time: 11.3721456528, output_fired_time: 0.0000000000, propagate_forward_time: 639.0601806641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.2138671875
best training[          , genome 11960] predictions:   38309/  50000 (76.62%), best:    6994/10000 (69.94%), error:     36802.16016, best error:      8823.17090 on epoch:    98, epoch:  101/100, mu: 0.9852259755, learning_rate: 0.0000003958, weight_decay: 0.0000016900
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 133.1679229736s, input_fired_time: 2.2725188732, output_fired_time: 0.0000000000, propagate_forward_time: 127.8421401978, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0532608032
   testing[          , genome 11960] predictions:    6994/  10000 (69.94%), best:    6994/10000 (69.94%), error:      8823.17090, best error:      8823.17090 on epoch:    98, epoch:  101/100, mu: 0.9852259755, learning_rate: 0.0000003958, weight_decay: 0.0000016900
backpropagation finished successfully!
19:40:46 (13860): called boinc_finish(0)

</stderr_txt>
]]>