Nameexact_genome_1542383404_189_6093_0
Workunit4093504
Created16 Nov 2018, 19:25:21 UTC
Sent16 Nov 2018, 19:45:18 UTC
Report deadline3 Feb 2019, 18:28:28 UTC
Received20 Nov 2018, 15:59:43 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID71624
Run time21 hours 26 min 13 sec
CPU time20 hours 44 min 42 sec
Validate stateValid
Credit19,736.66
Device peak FLOPS3.44 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
och:   28/100, mu: 0.8773496151, learning_rate: 0.0000014339, weight_decay: 0.0001204980

epoch time: 1785.1301269531s, input_fired_time: 25.0949497223, output_fired_time: 9.5049438477, propagate_forward_time: 509.8392639160, propagate_backward_time: 1216.6948242188, weight_update_time: 2.2209391594, other_time: 23.9962158203
epoch time: 107.6128692627s, input_fired_time: 0.5450936556, output_fired_time: 0.0000000000, propagate_forward_time: 102.7882232666, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2795486450
validation[          , genome  6093] predictions:    4722/  10000 (47.22%), best:    6103/10000 (61.03%), error:     16481.05469, best error:     11607.63281 on epoch:     0, epoch:   29/100, mu: 0.8830995560, learning_rate: 0.0000013378, weight_decay: 0.0001148128

epoch time: 1784.9936523438s, input_fired_time: 24.9772853851, output_fired_time: 7.4960842133, propagate_forward_time: 518.0730590820, propagate_backward_time: 1221.7591552734, weight_update_time: 0.2005426288, other_time: 12.6881103516
epoch time: 107.8179168701s, input_fired_time: 1.5399155617, output_fired_time: 0.0000000000, propagate_forward_time: 103.9819183350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2960815430
validation[          , genome  6093] predictions:    4678/  10000 (46.78%), best:    6103/10000 (61.03%), error:     16533.98633, best error:     11607.63281 on epoch:     0, epoch:   30/100, mu: 0.8885560036, learning_rate: 0.0000012481, weight_decay: 0.0001093957

epoch time: 1779.8637695313s, input_fired_time: 30.1039657593, output_fired_time: 6.4624409676, propagate_forward_time: 513.7662963867, propagate_backward_time: 1203.6335449219, weight_update_time: 2.2149868011, other_time: 25.8974609375
epoch time: 107.2917480469s, input_fired_time: 0.5377023220, output_fired_time: 0.0000000000, propagate_forward_time: 100.4481506348, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3058929443
validation[          , genome  6093] predictions:    4737/  10000 (47.37%), best:    6103/10000 (61.03%), error:     16465.74805, best error:     11607.63281 on epoch:     0, epoch:   31/100, mu: 0.8937339783, learning_rate: 0.0000011645, weight_decay: 0.0001042343

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542383404_189_6093.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542383404_189_6093_0_r1357179898_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.501546
read mu: 0.898648
read mu_delta: 0.948958
read initial_learning_rate: 1e-05
read learning_rate: 1.08645e-06
read learning_rate_delta: 0.932986
read initial_weight_decay: 0.000466332
read weight_decay: 9.93163e-05
read weight_decay_delta: 0.952819
read batch_size: 98
read epsilon: 1e-07
read alpha: 0.100211
read input_dropout_probability: 0.0014138
read hidden_dropout_probability: 0.109498
read velocity_reset: 1795
read epoch: 32
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6103
read best_validation_error: 11607.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6093
read normal distribution: '1 -1.50125062465668 0.132667437195778'
generator_str: '1428734913'
read generator: 1428734913
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 297 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1799.8583984375s, input_fired_time: 19.0694828033447, output_fired_time: 6.46207904815674, propagate_forward_time: 532.972473144531, propagate_backward_time: 1214.34680175781, weight_update_time: 0.209371209144592, other_time: 27.0076904296875
epoch time: 108.491058349609s, input_fired_time: 0.538230419158936, output_fired_time: 0, propagate_forward_time: 106.569664001465, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.38316345214844
validation[          , genome  6093] predictions:    4772/  10000 (47.72%), best:    6103/10000 (61.03%), error:     16454.07227, best error:     11607.63281 on epoch:     0, epoch:   32/100, mu: 0.8986476660, learning_rate: 0.0000010865, weight_decay: 0.0000993163

epoch time: 1806.4124755859s, input_fired_time: 26.9211902618, output_fired_time: 7.4277067184, propagate_forward_time: 516.3832397461, propagate_backward_time: 1239.1579589844, weight_update_time: 0.1992580444, other_time: 16.5224609375
epoch time: 107.8691253662s, input_fired_time: 0.5365203619, output_fired_time: 0.0000000000, propagate_forward_time: 104.1554412842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1771621704
validation[          , genome  6093] predictions:    4774/  10000 (47.74%), best:    6103/10000 (61.03%), error:     16444.42188, best error:     11607.63281 on epoch:     0, epoch:   33/100, mu: 0.9033105373, learning_rate: 0.0000010136, weight_decay: 0.0000946304

epoch time: 1743.2371826172s, input_fired_time: 24.7804794312, output_fired_time: 5.4051723480, propagate_forward_time: 498.5908203125, propagate_backward_time: 1188.8413085938, weight_update_time: 0.1922999471, other_time: 25.6193847656
epoch time: 105.6062240601s, input_fired_time: 2.5459902287, output_fired_time: 0.0000000000, propagate_forward_time: 100.7883377075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2718963623
validation[          , genome  6093] predictions:    4733/  10000 (47.33%), best:    6103/10000 (61.03%), error:     16433.47461, best error:     11607.63281 on epoch:     0, epoch:   34/100, mu: 0.9077354074, learning_rate: 0.0000009457, weight_decay: 0.0000901656

epoch time: 1743.3730468750s, input_fired_time: 23.7949085236, output_fired_time: 8.4145526886, propagate_forward_time: 514.7030639648, propagate_backward_time: 1182.9239501953, weight_update_time: 0.1908322722, other_time: 13.5364990234
epoch time: 107.8292465210s, input_fired_time: 2.5461103916, output_fired_time: 0.0000000000, propagate_forward_time: 101.9955673218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2875671387
validation[          , genome  6093] predictions:    4769/  10000 (47.69%), best:    6103/10000 (61.03%), error:     16384.38086, best error:     11607.63281 on epoch:     0, epoch:   35/100, mu: 0.9119343758, learning_rate: 0.0000008823, weight_decay: 0.0000859115

epoch time: 1746.1425781250s, input_fired_time: 25.7965602875, output_fired_time: 7.4237141609, propagate_forward_time: 498.4222717285, propagate_backward_time: 1193.8774414063, weight_update_time: 0.1918791980, other_time: 20.6226806641
epoch time: 106.9358215332s, input_fired_time: 0.5378184319, output_fired_time: 0.0000000000, propagate_forward_time: 103.1463394165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2516632080
validation[          , genome  6093] predictions:    4785/  10000 (47.85%), best:    6103/10000 (61.03%), error:     16413.23047, best error:     11607.63281 on epoch:     0, epoch:   36/100, mu: 0.9159190655, learning_rate: 0.0000008232, weight_decay: 0.0000818581

epoch time: 1821.7386474609s, input_fired_time: 22.3746623993, output_fired_time: 10.4011020660, propagate_forward_time: 566.5449829102, propagate_backward_time: 1207.6916503906, weight_update_time: 0.1973700672, other_time: 14.7263183594
epoch time: 117.0945358276s, input_fired_time: 2.6475305557, output_fired_time: 0.0000000000, propagate_forward_time: 113.0823135376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3646926880
validation[          , genome  6093] predictions:    4724/  10000 (47.24%), best:    6103/10000 (61.03%), error:     16416.28125, best error:     11607.63281 on epoch:     0, epoch:   37/100, mu: 0.9197003245, learning_rate: 0.0000007680, weight_decay: 0.0000779959

epoch time: 1807.3041992188s, input_fired_time: 20.2251052856, output_fired_time: 10.5220041275, propagate_forward_time: 517.2462768555, propagate_backward_time: 1236.1315917969, weight_update_time: 2.2068891525, other_time: 23.1791992188
epoch time: 109.9349441528s, input_fired_time: 0.5499098897, output_fired_time: 0.0000000000, propagate_forward_time: 104.0374679565, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3475646973
validation[          , genome  6093] predictions:    4712/  10000 (47.12%), best:    6103/10000 (61.03%), error:     16447.26367, best error:     11607.63281 on epoch:     0, epoch:   38/100, mu: 0.9232885838, learning_rate: 0.0000007166, weight_decay: 0.0000743159

epoch time: 1804.6655273438s, input_fired_time: 25.9372940063, output_fired_time: 11.3593807220, propagate_forward_time: 529.4781494141, propagate_backward_time: 1212.6719970703, weight_update_time: 2.2093789577, other_time: 25.2187500000
epoch time: 109.0769424438s, input_fired_time: 0.5510202050, output_fired_time: 0.0000000000, propagate_forward_time: 107.2611007690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2648239136
validation[          , genome  6093] predictions:    4794/  10000 (47.94%), best:    6103/10000 (61.03%), error:     16343.26758, best error:     11607.63281 on epoch:     0, epoch:   39/100, mu: 0.9266936779, learning_rate: 0.0000006686, weight_decay: 0.0000708096

epoch time: 1804.1413574219s, input_fired_time: 27.0972976685, output_fired_time: 8.4277276993, propagate_forward_time: 528.6861572266, propagate_backward_time: 1219.8576660156, weight_update_time: 0.1987950057, other_time: 20.0725097656
epoch time: 110.5362472534s, input_fired_time: 0.5634435415, output_fired_time: 0.0000000000, propagate_forward_time: 108.6817932129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2910079956
validation[          , genome  6093] predictions:    4762/  10000 (47.62%), best:    6103/10000 (61.03%), error:     16362.87695, best error:     11607.63281 on epoch:     0, epoch:   40/100, mu: 0.9299249649, learning_rate: 0.0000006238, weight_decay: 0.0000674687

epoch time: 1816.5043945313s, input_fired_time: 23.2212085724, output_fired_time: 6.6396064758, propagate_forward_time: 541.9411621094, propagate_backward_time: 1224.0374755859, weight_update_time: 0.1983251721, other_time: 20.6649169922
epoch time: 112.8948059082s, input_fired_time: 0.5568827987, output_fired_time: 0.0000000000, propagate_forward_time: 111.0093078613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3286132813
validation[          , genome  6093] predictions:    4784/  10000 (47.84%), best:    6103/10000 (61.03%), error:     16395.11719, best error:     11607.63281 on epoch:     0, epoch:   41/100, mu: 0.9329913259, learning_rate: 0.0000005820, weight_decay: 0.0000642854

epoch time: 1813.3520507813s, input_fired_time: 29.2019195557, output_fired_time: 8.5632400513, propagate_forward_time: 534.7715454102, propagate_backward_time: 1222.7355957031, weight_update_time: 0.2106254250, other_time: 18.0798339844
epoch time: 108.5090942383s, input_fired_time: 2.5489723682, output_fired_time: 0.0000000000, propagate_forward_time: 102.6965942383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2635269165
validation[          , genome  6093] predictions:    4792/  10000 (47.92%), best:    6103/10000 (61.03%), error:     16353.76660, best error:     11607.63281 on epoch:     0, epoch:   42/100, mu: 0.9359011650, learning_rate: 0.0000005430, weight_decay: 0.0000612523

epoch time: 1828.2598876953s, input_fired_time: 22.2587871552, output_fired_time: 8.5342006683, propagate_forward_time: 544.9910888672, propagate_backward_time: 1232.4583740234, weight_update_time: 0.2018147707, other_time: 20.0174560547
epoch time: 109.9530868530s, input_fired_time: 1.5601022243, output_fired_time: 0.0000000000, propagate_forward_time: 103.0892105103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3037719727
validation[          , genome  6093] predictions:    4755/  10000 (47.55%), best:    6103/10000 (61.03%), error:     16399.33203, best error:     11607.63281 on epoch:     0, epoch:   43/100, mu: 0.9386625290, learning_rate: 0.0000005066, weight_decay: 0.0000583624

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542383404_189_6093.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542383404_189_6093_0_r1357179898_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.501546
read mu: 0.941283
read mu_delta: 0.948958
read initial_learning_rate: 1e-05
read learning_rate: 4.72624e-07
read learning_rate_delta: 0.932986
read initial_weight_decay: 0.000466332
read weight_decay: 5.56087e-05
read weight_decay_delta: 0.952819
read batch_size: 98
read epsilon: 1e-07
read alpha: 0.100211
read input_dropout_probability: 0.0014138
read hidden_dropout_probability: 0.109498
read velocity_reset: 1795
read epoch: 44
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6103
read best_validation_error: 11607.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6093
read normal distribution: '1 -1.50125062465668 0.132667437195778'
generator_str: '479756154'
read generator: 479756154
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 297 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1943.74597167969s, input_fired_time: 23.862476348877, output_fired_time: 5.88057327270508, propagate_forward_time: 573.277526855469, propagate_backward_time: 1321.01647949219, weight_update_time: 0.216149479150772, other_time: 19.7088623046875
epoch time: 117.716934204102s, input_fired_time: 0.579188168048859, output_fired_time: 0, propagate_forward_time: 110.683494567871, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.45425415039063
validation[          , genome  6093] predictions:    4802/  10000 (48.02%), best:    6103/10000 (61.03%), error:     16368.40625, best error:     11607.63281 on epoch:     0, epoch:   44/100, mu: 0.9412829280, learning_rate: 0.0000004726, weight_decay: 0.0000556087

epoch time: 1886.2142333984s, input_fired_time: 25.6055831909, output_fired_time: 9.7196779251, propagate_forward_time: 537.8387451172, propagate_backward_time: 1291.6510009766, weight_update_time: 0.2133678198, other_time: 21.3991699219
epoch time: 114.8434829712s, input_fired_time: 0.5747067928, output_fired_time: 0.0000000000, propagate_forward_time: 109.7929382324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4758377075
validation[          , genome  6093] predictions:    4766/  10000 (47.66%), best:    6103/10000 (61.03%), error:     16436.04883, best error:     11607.63281 on epoch:     0, epoch:   45/100, mu: 0.9437695742, learning_rate: 0.0000004410, weight_decay: 0.0000529850

epoch time: 1880.1737060547s, input_fired_time: 25.7837505341, output_fired_time: 10.7079963684, propagate_forward_time: 536.1116333008, propagate_backward_time: 1294.1688232422, weight_update_time: 0.2060229182, other_time: 13.4014892578
epoch time: 116.4638061523s, input_fired_time: 3.6069550514, output_fired_time: 0.0000000000, propagate_forward_time: 111.4825744629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3742752075
validation[          , genome  6093] predictions:    4776/  10000 (47.76%), best:    6103/10000 (61.03%), error:     16422.11719, best error:     11607.63281 on epoch:     0, epoch:   46/100, mu: 0.9461292624, learning_rate: 0.0000004114, weight_decay: 0.0000504851

epoch time: 1881.6650390625s, input_fired_time: 33.7141189575, output_fired_time: 6.6719088554, propagate_forward_time: 543.4010009766, propagate_backward_time: 1276.4482421875, weight_update_time: 0.2118823826, other_time: 21.4298095703
epoch time: 115.7247238159s, input_fired_time: 2.6006143093, output_fired_time: 0.0000000000, propagate_forward_time: 109.7235412598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4005661011
validation[          , genome  6093] predictions:    4776/  10000 (47.76%), best:    6103/10000 (61.03%), error:     16382.51270, best error:     11607.63281 on epoch:     0, epoch:   47/100, mu: 0.9483685493, learning_rate: 0.0000003838, weight_decay: 0.0000481031

epoch time: 1885.1956787109s, input_fired_time: 19.6332111359, output_fired_time: 8.6058454514, propagate_forward_time: 558.2121582031, propagate_backward_time: 1278.4154052734, weight_update_time: 0.2094778270, other_time: 20.3291015625
epoch time: 117.5586547852s, input_fired_time: 0.5809771419, output_fired_time: 0.0000000000, propagate_forward_time: 113.5525054932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4251708984
validation[          , genome  6093] predictions:    4815/  10000 (48.15%), best:    6103/10000 (61.03%), error:     16311.90625, best error:     11607.63281 on epoch:     0, epoch:   48/100, mu: 0.9504935145, learning_rate: 0.0000003581, weight_decay: 0.0000458336

epoch time: 1884.2332763672s, input_fired_time: 36.6870803833, output_fired_time: 9.7862777710, propagate_forward_time: 524.5269775391, propagate_backward_time: 1292.8244628906, weight_update_time: 0.2065854669, other_time: 20.4084472656
epoch time: 118.0275421143s, input_fired_time: 0.5976805687, output_fired_time: 0.0000000000, propagate_forward_time: 111.1001281738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3297348022
validation[          , genome  6093] predictions:    4820/  10000 (48.20%), best:    6103/10000 (61.03%), error:     16318.16016, best error:     11607.63281 on epoch:     0, epoch:   49/100, mu: 0.9525099993, learning_rate: 0.0000003341, weight_decay: 0.0000436711

epoch time: 1881.6467285156s, input_fired_time: 28.6323947906, output_fired_time: 6.5517096519, propagate_forward_time: 545.2441406250, propagate_backward_time: 1281.8197021484, weight_update_time: 2.2174303532, other_time: 19.3986816406
epoch time: 115.6916580200s, input_fired_time: 0.5963838696, output_fired_time: 0.0000000000, propagate_forward_time: 113.7233963013, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3718795776
validation[          , genome  6093] predictions:    4776/  10000 (47.76%), best:    6103/10000 (61.03%), error:     16367.25098, best error:     11607.63281 on epoch:     0, epoch:   50/100, mu: 0.9544236064, learning_rate: 0.0000003117, weight_decay: 0.0000416106

epoch time: 1882.3566894531s, input_fired_time: 23.6061954498, output_fired_time: 16.7954654694, propagate_forward_time: 553.3248291016, propagate_backward_time: 1270.1870117188, weight_update_time: 0.2175396830, other_time: 18.4432373047
epoch time: 116.0431518555s, input_fired_time: 2.5837199688, output_fired_time: 0.0000000000, propagate_forward_time: 109.0925979614, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3668365479
validation[          , genome  6093] predictions:    4777/  10000 (47.77%), best:    6103/10000 (61.03%), error:     16349.72949, best error:     11607.63281 on epoch:     0, epoch:   51/100, mu: 0.9562395215, learning_rate: 0.0000002908, weight_decay: 0.0000396474

epoch time: 1876.7301025391s, input_fired_time: 23.6355094910, output_fired_time: 6.6761593819, propagate_forward_time: 541.8457031250, propagate_backward_time: 1280.2170410156, weight_update_time: 0.2097150832, other_time: 24.3557128906
epoch time: 116.2627563477s, input_fired_time: 0.5770894289, output_fired_time: 0.0000000000, propagate_forward_time: 112.3135833740, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3720855713
validation[          , genome  6093] predictions:    4799/  10000 (47.99%), best:    6103/10000 (61.03%), error:     16400.86719, best error:     11607.63281 on epoch:     0, epoch:   52/100, mu: 0.9579627514, learning_rate: 0.0000002713, weight_decay: 0.0000377767

epoch time: 1876.9144287109s, input_fired_time: 17.6559505463, output_fired_time: 7.6338019371, propagate_forward_time: 551.4479980469, propagate_backward_time: 1277.8135986328, weight_update_time: 0.2061718851, other_time: 22.3630371094
epoch time: 114.9361038208s, input_fired_time: 0.5790038109, output_fired_time: 0.0000000000, propagate_forward_time: 112.0396728516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3174285889
validation[          , genome  6093] predictions:    4791/  10000 (47.91%), best:    6103/10000 (61.03%), error:     16382.88184, best error:     11607.63281 on epoch:     0, epoch:   53/100, mu: 0.9595980048, learning_rate: 0.0000002532, weight_decay: 0.0000359944

epoch time: 1879.8083496094s, input_fired_time: 29.3382587433, output_fired_time: 8.6859292984, propagate_forward_time: 544.4418945313, propagate_backward_time: 1272.1781005859, weight_update_time: 0.2129788101, other_time: 25.1641845703
epoch time: 113.5068206787s, input_fired_time: 1.4808940887, output_fired_time: 0.0000000000, propagate_forward_time: 110.6995315552, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3263931274
validation[          , genome  6093] predictions:    4849/  10000 (48.49%), best:    6103/10000 (61.03%), error:     16359.30176, best error:     11607.63281 on epoch:     0, epoch:   54/100, mu: 0.9611498117, learning_rate: 0.0000002362, weight_decay: 0.0000342961

epoch time: 1871.5450439453s, input_fired_time: 28.6222019196, output_fired_time: 8.7251844406, propagate_forward_time: 542.7489013672, propagate_backward_time: 1258.0948486328, weight_update_time: 0.2041173577, other_time: 33.3538818359
epoch time: 115.9371643066s, input_fired_time: 3.5212547779, output_fired_time: 0.0000000000, propagate_forward_time: 106.0067062378, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4092025757
validation[          , genome  6093] predictions:    4808/  10000 (48.08%), best:    6103/10000 (61.03%), error:     16362.06250, best error:     11607.63281 on epoch:     0, epoch:   55/100, mu: 0.9626224041, learning_rate: 0.0000002204, weight_decay: 0.0000326780

epoch time: 1879.0316162109s, input_fired_time: 28.5025215149, output_fired_time: 7.5485081673, propagate_forward_time: 539.7885131836, propagate_backward_time: 1270.9208984375, weight_update_time: 0.2086450458, other_time: 32.2712402344
epoch time: 116.2829513550s, input_fired_time: 1.5838670731, output_fired_time: 0.0000000000, propagate_forward_time: 112.3036117554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3954696655
validation[          , genome  6093] predictions:    4814/  10000 (48.14%), best:    6103/10000 (61.03%), error:     16358.65137, best error:     11607.63281 on epoch:     0, epoch:   56/100, mu: 0.9640198350, learning_rate: 0.0000002056, weight_decay: 0.0000311362

epoch time: 1884.9589843750s, input_fired_time: 35.7466392517, output_fired_time: 8.7877292633, propagate_forward_time: 541.6464233398, propagate_backward_time: 1272.3405761719, weight_update_time: 0.2221452892, other_time: 26.4377441406
epoch time: 115.3423614502s, input_fired_time: 2.5852763653, output_fired_time: 0.0000000000, propagate_forward_time: 109.3886566162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3684310913
validation[          , genome  6093] predictions:    4793/  10000 (47.93%), best:    6103/10000 (61.03%), error:     16316.33887, best error:     11607.63281 on epoch:     0, epoch:   57/100, mu: 0.9653459191, learning_rate: 0.0000001918, weight_decay: 0.0000296671

epoch time: 1877.5760498047s, input_fired_time: 28.6684017181, output_fired_time: 8.6235475540, propagate_forward_time: 542.6932983398, propagate_backward_time: 1278.3648681641, weight_update_time: 0.2032932937, other_time: 19.2259521484
epoch time: 114.7258987427s, input_fired_time: 2.5971353054, output_fired_time: 0.0000000000, propagate_forward_time: 106.7199401855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4088211060
validation[          , genome  6093] predictions:    4822/  10000 (48.22%), best:    6103/10000 (61.03%), error:     16345.54199, best error:     11607.63281 on epoch:     0, epoch:   58/100, mu: 0.9666043520, learning_rate: 0.0000001790, weight_decay: 0.0000282674

epoch time: 1870.3276367188s, input_fired_time: 25.5920543671, output_fired_time: 5.6965150833, propagate_forward_time: 536.9671630859, propagate_backward_time: 1283.7949218750, weight_update_time: 0.2017646283, other_time: 18.2769775391
epoch time: 116.6129913330s, input_fired_time: 0.5856788158, output_fired_time: 0.0000000000, propagate_forward_time: 112.6034088135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4239044189
validation[          , genome  6093] predictions:    4848/  10000 (48.48%), best:    6103/10000 (61.03%), error:     16354.73535, best error:     11607.63281 on epoch:     0, epoch:   59/100, mu: 0.9677985311, learning_rate: 0.0000001670, weight_decay: 0.0000269337

epoch time: 1876.4208984375s, input_fired_time: 31.4284267426, output_fired_time: 4.6976337433, propagate_forward_time: 549.4014892578, propagate_backward_time: 1268.6115722656, weight_update_time: 0.2087373734, other_time: 22.2817382813
epoch time: 115.2422332764s, input_fired_time: 0.5879096389, output_fired_time: 0.0000000000, propagate_forward_time: 107.2273101807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4270172119
validation[          , genome  6093] predictions:    4795/  10000 (47.95%), best:    6103/10000 (61.03%), error:     16359.08887, best error:     11607.63281 on epoch:     0, epoch:   60/100, mu: 0.9689317346, learning_rate: 0.0000001558, weight_decay: 0.0000256629

epoch time: 1874.1845703125s, input_fired_time: 19.5422706604, output_fired_time: 14.6904783249, propagate_forward_time: 548.8502197266, propagate_backward_time: 1274.8105468750, weight_update_time: 0.2059667408, other_time: 16.2911376953
epoch time: 115.2601699829s, input_fired_time: 0.5681745410, output_fired_time: 0.0000000000, propagate_forward_time: 106.2063140869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.4856796265
validation[          , genome  6093] predictions:    4807/  10000 (48.07%), best:    6103/10000 (61.03%), error:     16358.76074, best error:     11607.63281 on epoch:     0, epoch:   61/100, mu: 0.9700071216, learning_rate: 0.0000001453, weight_decay: 0.0000244521

epoch time: 1875.4375000000s, input_fired_time: 31.3956222534, output_fired_time: 7.7169766426, propagate_forward_time: 547.2779541016, propagate_backward_time: 1268.6850585938, weight_update_time: 0.2097758949, other_time: 20.3619384766
epoch time: 116.1019287109s, input_fired_time: 0.5941411257, output_fired_time: 0.0000000000, propagate_forward_time: 112.1364822388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3713073730
validation[          , genome  6093] predictions:    4801/  10000 (48.01%), best:    6103/10000 (61.03%), error:     16377.00879, best error:     11607.63281 on epoch:     0, epoch:   62/100, mu: 0.9710276127, learning_rate: 0.0000001356, weight_decay: 0.0000232984

epoch time: 1873.7805175781s, input_fired_time: 33.3323516846, output_fired_time: 10.6743659973, propagate_forward_time: 531.2106933594, propagate_backward_time: 1279.5209960938, weight_update_time: 0.2112000585, other_time: 19.0421142578
epoch time: 115.0122375488s, input_fired_time: 0.5913782716, output_fired_time: 0.0000000000, propagate_forward_time: 112.1297302246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2911300659
validation[          , genome  6093] predictions:    4804/  10000 (48.04%), best:    6103/10000 (61.03%), error:     16429.70313, best error:     11607.63281 on epoch:     0, epoch:   63/100, mu: 0.9719960093, learning_rate: 0.0000001265, weight_decay: 0.0000221992

epoch time: 1874.1363525391s, input_fired_time: 25.6883354187, output_fired_time: 10.6786088943, propagate_forward_time: 555.4221191406, propagate_backward_time: 1267.2187500000, weight_update_time: 0.2032711208, other_time: 15.1285400391
epoch time: 115.0224304199s, input_fired_time: 1.5672671795, output_fired_time: 0.0000000000, propagate_forward_time: 111.0891723633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3659896851
validation[          , genome  6093] predictions:    4830/  10000 (48.30%), best:    6103/10000 (61.03%), error:     16391.60547, best error:     11607.63281 on epoch:     0, epoch:   64/100, mu: 0.9729149938, learning_rate: 0.0000001180, weight_decay: 0.0000211518

epoch time: 1871.6726074219s, input_fired_time: 24.7494983673, output_fired_time: 6.5549054146, propagate_forward_time: 551.7233886719, propagate_backward_time: 1269.3656005859, weight_update_time: 2.2175912857, other_time: 19.2791748047
epoch time: 115.0027923584s, input_fired_time: 0.5689663887, output_fired_time: 0.0000000000, propagate_forward_time: 112.0761108398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3577117920
validation[          , genome  6093] predictions:    4732/  10000 (47.32%), best:    6103/10000 (61.03%), error:     16479.59180, best error:     11607.63281 on epoch:     0, epoch:   65/100, mu: 0.9737870693, learning_rate: 0.0000001101, weight_decay: 0.0000201538

epoch time: 1879.6101074219s, input_fired_time: 28.6005725861, output_fired_time: 5.7050647736, propagate_forward_time: 541.2564697266, propagate_backward_time: 1273.7416992188, weight_update_time: 0.2055124193, other_time: 30.3062744141
epoch time: 114.9775390625s, input_fired_time: 2.5892767906, output_fired_time: 0.0000000000, propagate_forward_time: 111.0220642090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3661956787
validation[          , genome  6093] predictions:    4813/  10000 (48.13%), best:    6103/10000 (61.03%), error:     16385.56055, best error:     11607.63281 on epoch:     0, epoch:   66/100, mu: 0.9746146202, learning_rate: 0.0000001027, weight_decay: 0.0000192029

epoch time: 1873.7324218750s, input_fired_time: 29.7197875977, output_fired_time: 8.6704425812, propagate_forward_time: 542.3782348633, propagate_backward_time: 1266.6040039063, weight_update_time: 0.2225079983, other_time: 26.3601074219
epoch time: 114.5480575562s, input_fired_time: 0.5910976529, output_fired_time: 0.0000000000, propagate_forward_time: 108.5272674561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4296951294
validation[          , genome  6093] predictions:    4810/  10000 (48.10%), best:    6103/10000 (61.03%), error:     16419.78711, best error:     11607.63281 on epoch:     0, epoch:   67/100, mu: 0.9753999114, learning_rate: 0.0000000959, weight_decay: 0.0000182969

epoch time: 1882.7216796875s, input_fired_time: 27.5823879242, output_fired_time: 7.6033644676, propagate_forward_time: 554.8126831055, propagate_backward_time: 1271.3601074219, weight_update_time: 0.2080041915, other_time: 21.3630371094
epoch time: 115.1667633057s, input_fired_time: 2.5856182575, output_fired_time: 0.0000000000, propagate_forward_time: 108.1574935913, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4236526489
validation[          , genome  6093] predictions:    4787/  10000 (47.87%), best:    6103/10000 (61.03%), error:     16407.97266, best error:     11607.63281 on epoch:     0, epoch:   68/100, mu: 0.9761451483, learning_rate: 0.0000000894, weight_decay: 0.0000174336

epoch time: 1882.0479736328s, input_fired_time: 28.7070026398, output_fired_time: 10.6833534241, propagate_forward_time: 525.3950195313, propagate_backward_time: 1294.9172363281, weight_update_time: 0.2229909748, other_time: 22.3453369141
epoch time: 114.3429565430s, input_fired_time: 0.5859422088, output_fired_time: 0.0000000000, propagate_forward_time: 106.3324279785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4245834351
validation[          , genome  6093] predictions:    4779/  10000 (47.79%), best:    6103/10000 (61.03%), error:     16419.51172, best error:     11607.63281 on epoch:     0, epoch:   69/100, mu: 0.9768523574, learning_rate: 0.0000000834, weight_decay: 0.0000166111

epoch time: 1884.1772460938s, input_fired_time: 22.6091365814, output_fired_time: 7.7250742912, propagate_forward_time: 547.3556518555, propagate_backward_time: 1289.0959472656, weight_update_time: 0.2084006816, other_time: 17.3913574219
epoch time: 115.3380661011s, input_fired_time: 1.5688053370, output_fired_time: 0.0000000000, propagate_forward_time: 109.3891220093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3801422119
validation[          , genome  6093] predictions:    4817/  10000 (48.17%), best:    6103/10000 (61.03%), error:     16411.08789, best error:     11607.63281 on epoch:     0, epoch:   70/100, mu: 0.9775234461, learning_rate: 0.0000000779, weight_decay: 0.0000158273

epoch time: 1842.4594726563s, input_fired_time: 29.3464813232, output_fired_time: 9.7620496750, propagate_forward_time: 546.3688354492, propagate_backward_time: 1237.2208251953, weight_update_time: 1.2358468771, other_time: 19.7613525391
epoch time: 109.4169921875s, input_fired_time: 1.5425964594, output_fired_time: 0.0000000000, propagate_forward_time: 106.6340332031, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2403640747
validation[          , genome  6093] predictions:    4790/  10000 (47.90%), best:    6103/10000 (61.03%), error:     16460.92969, best error:     11607.63281 on epoch:     0, epoch:   71/100, mu: 0.9781602621, learning_rate: 0.0000000726, weight_decay: 0.0000150806

epoch time: 1764.1346435547s, input_fired_time: 26.0490341187, output_fired_time: 10.4538717270, propagate_forward_time: 507.7857666016, propagate_backward_time: 1199.1229248047, weight_update_time: 0.1988681257, other_time: 20.7230224609
epoch time: 107.4832687378s, input_fired_time: 4.5499167442, output_fired_time: 0.0000000000, propagate_forward_time: 98.6764373779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2569122314
validation[          , genome  6093] predictions:    4837/  10000 (48.37%), best:    6103/10000 (61.03%), error:     16444.84570, best error:     11607.63281 on epoch:     0, epoch:   72/100, mu: 0.9787645936, learning_rate: 0.0000000678, weight_decay: 0.0000143691

epoch time: 1782.3870849609s, input_fired_time: 24.9657974243, output_fired_time: 10.6099309921, propagate_forward_time: 525.3714599609, propagate_backward_time: 1194.5855712891, weight_update_time: 0.1957352906, other_time: 26.8542480469
epoch time: 110.0582504272s, input_fired_time: 0.5466545820, output_fired_time: 0.0000000000, propagate_forward_time: 108.2422180176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2693786621
validation[          , genome  6093] predictions:    4812/  10000 (48.12%), best:    6103/10000 (61.03%), error:     16434.86914, best error:     11607.63281 on epoch:     0, epoch:   73/100, mu: 0.9793380499, learning_rate: 0.0000000632, weight_decay: 0.0000136911

epoch time: 1799.5385742188s, input_fired_time: 26.0266437531, output_fired_time: 9.4967737198, propagate_forward_time: 532.5676269531, propagate_backward_time: 1212.8331298828, weight_update_time: 0.1942027658, other_time: 18.6143798828
epoch time: 112.7467651367s, input_fired_time: 1.5588731766, output_fired_time: 0.0000000000, propagate_forward_time: 109.8908767700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2970123291
validation[          , genome  6093] predictions:    4847/  10000 (48.47%), best:    6103/10000 (61.03%), error:     16438.16211, best error:     11607.63281 on epoch:     0, epoch:   74/100, mu: 0.9798822403, learning_rate: 0.0000000590, weight_decay: 0.0000130451

epoch time: 1784.8073730469s, input_fired_time: 29.9879341125, output_fired_time: 11.5352983475, propagate_forward_time: 510.4379882813, propagate_backward_time: 1218.1076660156, weight_update_time: 0.2027870268, other_time: 14.7385253906
epoch time: 110.8376312256s, input_fired_time: 2.5857012272, output_fired_time: 0.0000000000, propagate_forward_time: 101.9769744873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2749557495
validation[          , genome  6093] predictions:    4807/  10000 (48.07%), best:    6103/10000 (61.03%), error:     16455.52734, best error:     11607.63281 on epoch:     0, epoch:   75/100, mu: 0.9803986549, learning_rate: 0.0000000550, weight_decay: 0.0000124297

epoch time: 1760.5373535156s, input_fired_time: 20.0355720520, output_fired_time: 6.4705553055, propagate_forward_time: 520.8966674805, propagate_backward_time: 1188.4761962891, weight_update_time: 0.1938561350, other_time: 24.6583251953
epoch time: 109.6341781616s, input_fired_time: 0.5405505300, output_fired_time: 0.0000000000, propagate_forward_time: 105.8070831299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2865447998
validation[          , genome  6093] predictions:    4809/  10000 (48.09%), best:    6103/10000 (61.03%), error:     16470.97852, best error:     11607.63281 on epoch:     0, epoch:   76/100, mu: 0.9808887243, learning_rate: 0.0000000513, weight_decay: 0.0000118432

epoch time: 1786.9171142578s, input_fired_time: 24.0310535431, output_fired_time: 10.5860633850, propagate_forward_time: 503.4836120605, propagate_backward_time: 1225.2335205078, weight_update_time: 0.1914446205, other_time: 23.5828857422
epoch time: 137.4554901123s, input_fired_time: 2.7189047337, output_fired_time: 0.0000000000, propagate_forward_time: 132.0980529785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6385345459
validation[          , genome  6093] predictions:    4830/  10000 (48.30%), best:    6103/10000 (61.03%), error:     16481.68945, best error:     11607.63281 on epoch:     0, epoch:   77/100, mu: 0.9813537598, learning_rate: 0.0000000479, weight_decay: 0.0000112844

epoch time: 1757.7188720703s, input_fired_time: 26.9249191284, output_fired_time: 11.4504375458, propagate_forward_time: 503.3042907715, propagate_backward_time: 1199.3861083984, weight_update_time: 0.1925718337, other_time: 16.6530761719
epoch time: 106.7642898560s, input_fired_time: 0.5346017480, output_fired_time: 0.0000000000, propagate_forward_time: 102.9634780884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2662124634
validation[          , genome  6093] predictions:    4819/  10000 (48.19%), best:    6103/10000 (61.03%), error:     16465.44336, best error:     11607.63281 on epoch:     0, epoch:   78/100, mu: 0.9817950726, learning_rate: 0.0000000447, weight_decay: 0.0000107520

epoch time: 1747.1030273438s, input_fired_time: 16.8938903809, output_fired_time: 5.3815593719, propagate_forward_time: 523.5850219727, propagate_backward_time: 1184.6518554688, weight_update_time: 0.1966513395, other_time: 16.5905761719
epoch time: 106.6509246826s, input_fired_time: 0.5316091180, output_fired_time: 0.0000000000, propagate_forward_time: 103.8785247803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2407913208
validation[          , genome  6093] predictions:    4815/  10000 (48.15%), best:    6103/10000 (61.03%), error:     16489.69727, best error:     11607.63281 on epoch:     0, epoch:   79/100, mu: 0.9822138548, learning_rate: 0.0000000417, weight_decay: 0.0000102447

epoch time: 1745.1394042969s, input_fired_time: 18.9210319519, output_fired_time: 3.4264345169, propagate_forward_time: 525.2490234375, propagate_backward_time: 1181.9079589844, weight_update_time: 0.1939985156, other_time: 15.6350097656
epoch time: 106.7560653687s, input_fired_time: 1.5397527218, output_fired_time: 0.0000000000, propagate_forward_time: 101.9663543701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2499618530
validation[          , genome  6093] predictions:    4815/  10000 (48.15%), best:    6103/10000 (61.03%), error:     16476.95117, best error:     11607.63281 on epoch:     0, epoch:   80/100, mu: 0.9826112986, learning_rate: 0.0000000389, weight_decay: 0.0000097613

epoch time: 1749.0788574219s, input_fired_time: 20.8948478699, output_fired_time: 10.4595508575, propagate_forward_time: 511.4921569824, propagate_backward_time: 1190.6601562500, weight_update_time: 0.1954493225, other_time: 15.5720214844
epoch time: 105.8572463989s, input_fired_time: 0.5334388018, output_fired_time: 0.0000000000, propagate_forward_time: 103.0797119141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2440948486
validation[          , genome  6093] predictions:    4796/  10000 (47.96%), best:    6103/10000 (61.03%), error:     16486.51758, best error:     11607.63281 on epoch:     0, epoch:   81/100, mu: 0.9829884171, learning_rate: 0.0000000363, weight_decay: 0.0000093008

epoch time: 1742.4508056641s, input_fired_time: 19.7622356415, output_fired_time: 7.4055185318, propagate_forward_time: 504.4400329590, propagate_backward_time: 1190.2807617188, weight_update_time: 0.1931905150, other_time: 20.5622558594
epoch time: 107.8366699219s, input_fired_time: 1.5422246456, output_fired_time: 0.0000000000, propagate_forward_time: 105.0333251953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2611236572
validation[          , genome  6093] predictions:    4838/  10000 (48.38%), best:    6103/10000 (61.03%), error:     16480.69336, best error:     11607.63281 on epoch:     0, epoch:   82/100, mu: 0.9833462834, learning_rate: 0.0000000339, weight_decay: 0.0000088620

epoch time: 1746.1103515625s, input_fired_time: 20.7523365021, output_fired_time: 8.4053411484, propagate_forward_time: 501.1668090820, propagate_backward_time: 1199.3016357422, weight_update_time: 0.1896695495, other_time: 16.4842529297
epoch time: 105.6591720581s, input_fired_time: 0.5370566845, output_fired_time: 0.0000000000, propagate_forward_time: 100.8654632568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2566528320
validation[          , genome  6093] predictions:    4829/  10000 (48.29%), best:    6103/10000 (61.03%), error:     16517.52148, best error:     11607.63281 on epoch:     0, epoch:   83/100, mu: 0.9836859107, learning_rate: 0.0000000316, weight_decay: 0.0000084438

epoch time: 1745.3553466797s, input_fired_time: 21.8902492523, output_fired_time: 11.4440879822, propagate_forward_time: 497.3583984375, propagate_backward_time: 1188.1779785156, weight_update_time: 1.0984508991, other_time: 26.4846191406
epoch time: 104.5074615479s, input_fired_time: 1.5371356010, output_fired_time: 0.0000000000, propagate_forward_time: 98.6782455444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2920837402
validation[          , genome  6093] predictions:    4816/  10000 (48.16%), best:    6103/10000 (61.03%), error:     16478.66992, best error:     11607.63281 on epoch:     0, epoch:   84/100, mu: 0.9840081930, learning_rate: 0.0000000295, weight_decay: 0.0000080455

epoch time: 1754.3648681641s, input_fired_time: 20.9664745331, output_fired_time: 6.4228959084, propagate_forward_time: 523.5317993164, propagate_backward_time: 1186.9996337891, weight_update_time: 0.1906240135, other_time: 16.4442138672
epoch time: 107.3539428711s, input_fired_time: 0.5452497005, output_fired_time: 0.0000000000, propagate_forward_time: 97.4911499023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.3175430298
validation[          , genome  6093] predictions:    4818/  10000 (48.18%), best:    6103/10000 (61.03%), error:     16487.78320, best error:     11607.63281 on epoch:     0, epoch:   85/100, mu: 0.9843140244, learning_rate: 0.0000000275, weight_decay: 0.0000076659

epoch time: 1759.6273193359s, input_fired_time: 34.7064628601, output_fired_time: 7.4233407974, propagate_forward_time: 495.6985473633, propagate_backward_time: 1206.1313476563, weight_update_time: 0.1973706186, other_time: 15.6677246094
epoch time: 107.3548049927s, input_fired_time: 0.5384168625, output_fired_time: 0.0000000000, propagate_forward_time: 102.5417327881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2746582031
validation[          , genome  6093] predictions:    4836/  10000 (48.36%), best:    6103/10000 (61.03%), error:     16514.07813, best error:     11607.63281 on epoch:     0, epoch:   86/100, mu: 0.9846042395, learning_rate: 0.0000000257, weight_decay: 0.0000073042

epoch time: 1756.7504882813s, input_fired_time: 30.9156608582, output_fired_time: 7.4246668816, propagate_forward_time: 500.5776672363, propagate_backward_time: 1199.1967773438, weight_update_time: 0.1961657703, other_time: 18.6357421875
epoch time: 107.9151763916s, input_fired_time: 0.5330989957, output_fired_time: 0.0000000000, propagate_forward_time: 98.0496673584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.3324127197
validation[          , genome  6093] predictions:    4803/  10000 (48.03%), best:    6103/10000 (61.03%), error:     16499.40820, best error:     11607.63281 on epoch:     0, epoch:   87/100, mu: 0.9848796725, learning_rate: 0.0000000239, weight_decay: 0.0000069595

epoch time: 1752.1479492188s, input_fired_time: 31.4951076508, output_fired_time: 13.5052757263, propagate_forward_time: 515.2249145508, propagate_backward_time: 1175.2922363281, weight_update_time: 0.1899781674, other_time: 16.6303710938
epoch time: 106.8098297119s, input_fired_time: 4.5545587540, output_fired_time: 0.0000000000, propagate_forward_time: 96.0530395508, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2022323608
validation[          , genome  6093] predictions:    4837/  10000 (48.37%), best:    6103/10000 (61.03%), error:     16510.39453, best error:     11607.63281 on epoch:     0, epoch:   88/100, mu: 0.9851410389, learning_rate: 0.0000000223, weight_decay: 0.0000066312

epoch time: 1739.4978027344s, input_fired_time: 24.7651367188, output_fired_time: 7.4327926636, propagate_forward_time: 499.6857299805, propagate_backward_time: 1185.0458984375, weight_update_time: 0.1914490163, other_time: 22.5683593750
epoch time: 105.3791961670s, input_fired_time: 0.5313602686, output_fired_time: 0.0000000000, propagate_forward_time: 101.5717086792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2761306763
validation[          , genome  6093] predictions:    4816/  10000 (48.16%), best:    6103/10000 (61.03%), error:     16527.69531, best error:     11607.63281 on epoch:     0, epoch:   89/100, mu: 0.9853890538, learning_rate: 0.0000000208, weight_decay: 0.0000063183

epoch time: 1739.4351806641s, input_fired_time: 33.8945274353, output_fired_time: 10.4234771729, propagate_forward_time: 499.7982788086, propagate_backward_time: 1172.9873046875, weight_update_time: 0.1912544370, other_time: 22.3315429688
epoch time: 104.4345779419s, input_fired_time: 0.5279400349, output_fired_time: 0.0000000000, propagate_forward_time: 102.6541290283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2525100708
validation[          , genome  6093] predictions:    4819/  10000 (48.19%), best:    6103/10000 (61.03%), error:     16521.38477, best error:     11607.63281 on epoch:     0, epoch:   90/100, mu: 0.9856244326, learning_rate: 0.0000000194, weight_decay: 0.0000060202

epoch time: 1727.5574951172s, input_fired_time: 17.7828998566, output_fired_time: 7.3898344040, propagate_forward_time: 526.3052978516, propagate_backward_time: 1160.7698974609, weight_update_time: 0.1920267493, other_time: 15.3094482422
epoch time: 105.3731460571s, input_fired_time: 2.5419800282, output_fired_time: 0.0000000000, propagate_forward_time: 100.6131973267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2179718018
validation[          , genome  6093] predictions:    4832/  10000 (48.32%), best:    6103/10000 (61.03%), error:     16524.51563, best error:     11607.63281 on epoch:     0, epoch:   91/100, mu: 0.9858477712, learning_rate: 0.0000000181, weight_decay: 0.0000057362

epoch time: 1726.1882324219s, input_fired_time: 22.8332672119, output_fired_time: 7.3960566521, propagate_forward_time: 518.9447021484, propagate_backward_time: 1161.6701660156, weight_update_time: 0.1891077459, other_time: 15.3441162109
epoch time: 105.3933486938s, input_fired_time: 2.4365293980, output_fired_time: 0.0000000000, propagate_forward_time: 98.6990814209, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2577362061
validation[          , genome  6093] predictions:    4818/  10000 (48.18%), best:    6103/10000 (61.03%), error:     16527.09375, best error:     11607.63281 on epoch:     0, epoch:   92/100, mu: 0.9860597253, learning_rate: 0.0000000169, weight_decay: 0.0000054655

epoch time: 1733.1186523438s, input_fired_time: 26.7988929749, output_fired_time: 14.4266557693, propagate_forward_time: 496.2802124023, propagate_backward_time: 1176.2153320313, weight_update_time: 0.1908240318, other_time: 19.3974609375
epoch time: 105.3573989868s, input_fired_time: 0.5309136510, output_fired_time: 0.0000000000, propagate_forward_time: 96.5676574707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.2588272095
validation[          , genome  6093] predictions:    4829/  10000 (48.29%), best:    6103/10000 (61.03%), error:     16553.53906, best error:     11607.63281 on epoch:     0, epoch:   93/100, mu: 0.9862608314, learning_rate: 0.0000000158, weight_decay: 0.0000052077

epoch time: 1735.1937255859s, input_fired_time: 19.8131828308, output_fired_time: 5.4210586548, propagate_forward_time: 501.4224243164, propagate_backward_time: 1193.0974121094, weight_update_time: 0.1914721280, other_time: 15.4396972656
epoch time: 105.4229888916s, input_fired_time: 2.5380997658, output_fired_time: 0.0000000000, propagate_forward_time: 101.6993789673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1855087280
validation[          , genome  6093] predictions:    4824/  10000 (48.24%), best:    6103/10000 (61.03%), error:     16538.92773, best error:     11607.63281 on epoch:     0, epoch:   94/100, mu: 0.9864516854, learning_rate: 0.0000000147, weight_decay: 0.0000049619

epoch time: 1731.4550781250s, input_fired_time: 19.6941699982, output_fired_time: 8.3776645660, propagate_forward_time: 502.5570373535, propagate_backward_time: 1178.3369140625, weight_update_time: 0.1923496276, other_time: 22.4892578125
epoch time: 107.4569320679s, input_fired_time: 0.5424262881, output_fired_time: 0.0000000000, propagate_forward_time: 105.7192535400, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1952514648
validation[          , genome  6093] predictions:    4837/  10000 (48.37%), best:    6103/10000 (61.03%), error:     16553.95313, best error:     11607.63281 on epoch:     0, epoch:   95/100, mu: 0.9866328239, learning_rate: 0.0000000137, weight_decay: 0.0000047278

epoch time: 1736.7906494141s, input_fired_time: 22.6252574921, output_fired_time: 7.3937096596, propagate_forward_time: 518.8209838867, propagate_backward_time: 1170.4899902344, weight_update_time: 0.1929267347, other_time: 17.4606933594
epoch time: 105.6297607422s, input_fired_time: 2.5350377560, output_fired_time: 0.0000000000, propagate_forward_time: 98.8484115601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2463150024
validation[          , genome  6093] predictions:    4833/  10000 (48.33%), best:    6103/10000 (61.03%), error:     16572.47266, best error:     11607.63281 on epoch:     0, epoch:   96/100, mu: 0.9868046641, learning_rate: 0.0000000128, weight_decay: 0.0000045048

epoch time: 1726.6306152344s, input_fired_time: 23.6986198425, output_fired_time: 12.3345394135, propagate_forward_time: 507.8678588867, propagate_backward_time: 1165.2851562500, weight_update_time: 0.1921994388, other_time: 17.4443359375
epoch time: 105.2487258911s, input_fired_time: 1.5266121626, output_fired_time: 0.0000000000, propagate_forward_time: 101.4927444458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2293701172
validation[          , genome  6093] predictions:    4822/  10000 (48.22%), best:    6103/10000 (61.03%), error:     16554.71875, best error:     11607.63281 on epoch:     0, epoch:   97/100, mu: 0.9869677424, learning_rate: 0.0000000120, weight_decay: 0.0000042922

epoch time: 1734.2529296875s, input_fired_time: 23.6982536316, output_fired_time: 3.3857038021, propagate_forward_time: 489.4065856934, propagate_backward_time: 1200.3154296875, weight_update_time: 0.1932394654, other_time: 17.4468994141
epoch time: 107.8595886230s, input_fired_time: 1.5411797762, output_fired_time: 0.0000000000, propagate_forward_time: 103.0892410278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2291641235
validation[          , genome  6093] predictions:    4830/  10000 (48.30%), best:    6103/10000 (61.03%), error:     16557.37500, best error:     11607.63281 on epoch:     0, epoch:   98/100, mu: 0.9871225357, learning_rate: 0.0000000112, weight_decay: 0.0000040897

epoch time: 1733.7542724609s, input_fired_time: 20.8120269775, output_fired_time: 8.3842792511, propagate_forward_time: 502.3959655762, propagate_backward_time: 1174.8144531250, weight_update_time: 0.1906625926, other_time: 27.3475341797
epoch time: 106.3907546997s, input_fired_time: 3.5401422977, output_fired_time: 0.0000000000, propagate_forward_time: 100.6249008179, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2257080078
validation[          , genome  6093] predictions:    4825/  10000 (48.25%), best:    6103/10000 (61.03%), error:     16571.91406, best error:     11607.63281 on epoch:     0, epoch:   99/100, mu: 0.9872694016, learning_rate: 0.0000000104, weight_decay: 0.0000038968

epoch time: 1728.9473876953s, input_fired_time: 24.7860546112, output_fired_time: 7.3851156235, propagate_forward_time: 499.5613403320, propagate_backward_time: 1179.9873046875, weight_update_time: 0.1850406826, other_time: 17.2275390625
epoch time: 106.6402282715s, input_fired_time: 1.5301780701, output_fired_time: 0.0000000000, propagate_forward_time: 98.8621597290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2478866577
validation[          , genome  6093] predictions:    4827/  10000 (48.27%), best:    6103/10000 (61.03%), error:     16580.88477, best error:     11607.63281 on epoch:     0, epoch:  100/100, mu: 0.9874087572, learning_rate: 0.0000000097, weight_decay: 0.0000037129

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 530.7747802734s, input_fired_time: 8.2271013260, output_fired_time: 0.0000000000, propagate_forward_time: 508.4077453613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.1399230957
best training[          , genome  6093] predictions:   32916/  50000 (65.83%), best:    6103/10000 (61.03%), error:     53524.22656, best error:     11607.63281 on epoch:     0, epoch:  101/100, mu: 0.9875410199, learning_rate: 0.0000000091, weight_decay: 0.0000035377
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 107.8608093262s, input_fired_time: 0.6379928589, output_fired_time: 0.0000000000, propagate_forward_time: 103.8281097412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3947067261
   testing[          , genome  6093] predictions:    6103/  10000 (61.03%), best:    6103/10000 (61.03%), error:     11607.63281, best error:     11607.63281 on epoch:     0, epoch:  101/100, mu: 0.9875410199, learning_rate: 0.0000000091, weight_decay: 0.0000035377
backpropagation finished successfully!
02:54:34 (14592): called boinc_finish(0)

</stderr_txt>
]]>