Nameexact_genome_1518178202_49_18417_0
Workunit2993179
Created9 Feb 2018, 22:54:05 UTC
Sent9 Feb 2018, 23:34:41 UTC
Report deadline13 Apr 2018, 22:08:55 UTC
Received15 Feb 2018, 16:52:00 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID68550
Run time2 days 1 hours 43 min 50 sec
CPU time1 days 23 hours 53 min 18 sec
Validate stateChecked, but no consensus yet
Credit0.00
Device peak FLOPS2.59 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size190.44 MB
Peak swap size194.17 MB
Peak disk usage9.76 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
tor
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.964987
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000638085
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.55234e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 58
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 9909
read best_validation_error: 298.324
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1772779337'
read generator: 1772779337
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.964987
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000638085
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.55234e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 58
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 9909
read best_validation_error: 298.324
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1772779337'
read generator: 1772779337
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.964987
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000638085
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.55234e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 58
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 9909
read best_validation_error: 298.324
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1772779337'
read generator: 1772779337
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.964987
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000638085
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.55234e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 58
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 9909
read best_validation_error: 298.324
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1772779337'
read generator: 1772779337
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.964987
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000638085
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.55234e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 58
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 9909
read best_validation_error: 298.324
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1772779337'
read generator: 1772779337
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.964987
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000638085
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 2.55234e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 58
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 9909
read best_validation_error: 298.324
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1772779337'
read generator: 1772779337
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 2276.94384765625s, input_fired_time: 31.2525939941406, output_fired_time: 29.1933898925781, propagate_forward_time: 837.002380371094, propagate_backward_time: 1348.45751953125, weight_update_time: 1.73923683166504, other_time: 31.037841796875
epoch time: 184.497009277344s, input_fired_time: 3.7778959274292, output_fired_time: 0, propagate_forward_time: 172.112991333008, propagate_backward_time: 0, weight_update_time: 0, other_time: 8.60612487792969
validation[          , genome 18417] predictions:    9917/  10000 (99.17%), best:    9917/10000 (99.17%), error:       289.65033, best error:       289.65033 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 2329.5981445313s, input_fired_time: 28.9812622070, output_fired_time: 25.1770248413, propagate_forward_time: 863.8391113281, propagate_backward_time: 1385.4022216797, weight_update_time: 1.8411723375, other_time: 26.1986083984
epoch time: 182.4881286621s, input_fired_time: 2.7697594166, output_fired_time: 0.0000000000, propagate_forward_time: 174.5426940918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1756744385
validation[          , genome 18417] predictions:    9891/  10000 (98.91%), best:    9917/10000 (99.17%), error:       365.34695, best error:       289.65033 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 2313.5913085938s, input_fired_time: 31.9062805176, output_fired_time: 28.7956237793, propagate_forward_time: 852.9906005859, propagate_backward_time: 1373.3402099609, weight_update_time: 2.8372879028, other_time: 26.5585937500
epoch time: 178.4999847412s, input_fired_time: 3.6791496277, output_fired_time: 0.0000000000, propagate_forward_time: 164.6292572021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.1915740967
validation[          , genome 18417] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       306.42123, best error:       289.65033 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 2283.1977539063s, input_fired_time: 29.0358676910, output_fired_time: 30.9311943054, propagate_forward_time: 852.0871582031, propagate_backward_time: 1340.2935791016, weight_update_time: 2.7553079128, other_time: 30.8499755859
epoch time: 178.1246032715s, input_fired_time: 2.7969183922, output_fired_time: 0.0000000000, propagate_forward_time: 170.5160369873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8116455078
validation[          , genome 18417] predictions:    9907/  10000 (99.07%), best:    9917/10000 (99.17%), error:       296.08557, best error:       289.65033 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 2277.4731445313s, input_fired_time: 30.5558452606, output_fired_time: 27.4775714874, propagate_forward_time: 843.8779907227, propagate_backward_time: 1348.6354980469, weight_update_time: 2.0975892544, other_time: 26.9262695313
epoch time: 173.9727478027s, input_fired_time: 4.5144224167, output_fired_time: 0.0000000000, propagate_forward_time: 164.6294708252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8288574219
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       291.64001, best error:       289.65033 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 2273.2756347656s, input_fired_time: 28.7445716858, output_fired_time: 24.8645515442, propagate_forward_time: 859.9658813477, propagate_backward_time: 1330.7142333984, weight_update_time: 3.8455131054, other_time: 28.9864501953
epoch time: 176.6735382080s, input_fired_time: 2.5945117474, output_fired_time: 0.0000000000, propagate_forward_time: 169.1284332275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9505920410
validation[          , genome 18417] predictions:    9894/  10000 (98.94%), best:    9917/10000 (99.17%), error:       337.26804, best error:       289.65033 on epoch:    58, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 2410.8911132813s, input_fired_time: 28.4740676880, output_fired_time: 32.3862915039, propagate_forward_time: 856.1961669922, propagate_backward_time: 1467.3575439453, weight_update_time: 1.6359159946, other_time: 26.4770507813
epoch time: 174.6587982178s, input_fired_time: 2.6761243343, output_fired_time: 0.0000000000, propagate_forward_time: 167.4504394531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5322418213
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       302.80466, best error:       289.65033 on epoch:    58, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 2235.1203613281s, input_fired_time: 29.4924850464, output_fired_time: 24.7145195007, propagate_forward_time: 844.8117065430, propagate_backward_time: 1307.4492187500, weight_update_time: 3.7881407738, other_time: 28.6523437500
epoch time: 182.3339233398s, input_fired_time: 5.0463523865, output_fired_time: 0.0000000000, propagate_forward_time: 172.6177215576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6698455811
validation[          , genome 18417] predictions:    9903/  10000 (99.03%), best:    9917/10000 (99.17%), error:       293.97925, best error:       289.65033 on epoch:    58, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 2309.2763671875s, input_fired_time: 31.8987789154, output_fired_time: 25.5537471771, propagate_forward_time: 877.4144287109, propagate_backward_time: 1342.6574707031, weight_update_time: 2.7059314251, other_time: 31.7520751953
epoch time: 172.2490692139s, input_fired_time: 2.5746178627, output_fired_time: 0.0000000000, propagate_forward_time: 165.0643310547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6101226807
validation[          , genome 18417] predictions:    9917/  10000 (99.17%), best:    9917/10000 (99.17%), error:       272.22107, best error:       272.22107 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 2240.0825195313s, input_fired_time: 24.5636386871, output_fired_time: 27.9002323151, propagate_forward_time: 815.3575439453, propagate_backward_time: 1341.2722167969, weight_update_time: 3.7547075748, other_time: 30.9888916016
epoch time: 180.9008026123s, input_fired_time: 3.6992242336, output_fired_time: 0.0000000000, propagate_forward_time: 170.3190460205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.8825378418
validation[          , genome 18417] predictions:    9908/  10000 (99.08%), best:    9917/10000 (99.17%), error:       295.70798, best error:       272.22107 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/mnist_training_50k.bin'
boincified validation filename: '../../projects/csgrid.org_csg/mnist_validation_10k.bin'
boincified testing filename: '../../projects/csgrid.org_csg/mnist_testing_new.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1518178202_49_18417_0_r99060357_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.975024
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000382045
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.52818e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 68
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 66
read number_validation_images: 10000
read best_validation_predictions: 9917
read best_validation_error: 272.221
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 18417
read normal distribution: '1 -1.08829855918884 2.05284738540649'
generator_str: '1940406961'
read generator: 1940406961
read generated_by_map:
1 crossover 1
reading 145 nodes.
reading 569 edges.
number input nodes: 1
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 4923 images.
reading image set with 5742 images.
reading image set with 4958 images.
reading image set with 5131 images.
reading image set with 4842 images.
reading image set with 4421 images.
reading image set with 4918 images.
reading image set with 5265 images.
reading image set with 4851 images.
reading image set with 4949 images.
image_size: 1x28x28 = 784
read 50000 images.
    class    0: 4923
    class    1: 5742
    class    2: 4958
    class    3: 5131
    class    4: 4842
    class    5: 4421
    class    6: 4918
    class    7: 5265
    class    8: 4851
    class    9: 4949
calculating averages and standard deviations for images
average pixel value for channel 0: 0.130530551075935
pixel variance for channel 0: 0.0948646068572998
pixel standard deviation for channel 0: 0.308000981807709
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 1
width: 28
height: 28
reading image set with 980 images.
reading image set with 1135 images.
reading image set with 1032 images.
reading image set with 1010 images.
reading image set with 982 images.
reading image set with 892 images.
reading image set with 958 images.
reading image set with 1028 images.
reading image set with 974 images.
reading image set with 1009 images.
image_size: 1x28x28 = 784
read 10000 images.
    class    0: 980
    class    1: 1135
    class    2: 1032
    class    3: 1010
    class    4: 982
    class    5: 892
    class    6: 958
    class    7: 1028
    class    8: 974
    class    9: 1009
loaded images
starting backpropagation!
epoch time: 2123.92504882813s, input_fired_time: 23.7801456451416, output_fired_time: 25.6956653594971, propagate_forward_time: 786.978759765625, propagate_backward_time: 1264.58337402344, weight_update_time: 1.62104380130768, other_time: 22.8873291015625
epoch time: 180.381195068359s, input_fired_time: 2.86992430686951, output_fired_time: 0, propagate_forward_time: 171.547836303711, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.96343994140625
validation[          , genome 18417] predictions:    9795/  10000 (97.95%), best:    9917/10000 (99.17%), error:       735.12726, best error:       272.22107 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

resetting weights to those on epoch: 66
epoch time: 2276.0358886719s, input_fired_time: 25.8486480713, output_fired_time: 32.7410469055, propagate_forward_time: 848.6784667969, propagate_backward_time: 1342.1502685547, weight_update_time: 2.7891273499, other_time: 26.6175537109
epoch time: 171.7420349121s, input_fired_time: 2.5788486004, output_fired_time: 0.0000000000, propagate_forward_time: 165.6098632813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5533294678
validation[          , genome 18417] predictions:    9882/  10000 (98.82%), best:    9917/10000 (99.17%), error:       384.98346, best error:       272.22107 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 2220.9504394531s, input_fired_time: 27.0312652588, output_fired_time: 25.6968002319, propagate_forward_time: 820.9756469727, propagate_backward_time: 1324.3168945313, weight_update_time: 1.6664514542, other_time: 22.9299316406
epoch time: 176.4847106934s, input_fired_time: 3.8395137787, output_fired_time: 0.0000000000, propagate_forward_time: 164.9220428467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.7231597900
validation[          , genome 18417] predictions:    9904/  10000 (99.04%), best:    9917/10000 (99.17%), error:       332.98422, best error:       272.22107 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 2210.1652832031s, input_fired_time: 27.8443660736, output_fired_time: 31.8652191162, propagate_forward_time: 843.2680053711, propagate_backward_time: 1281.9774169922, weight_update_time: 2.7289514542, other_time: 25.2100830078
epoch time: 179.2466583252s, input_fired_time: 3.7742927074, output_fired_time: 0.0000000000, propagate_forward_time: 169.8041381836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6682281494
validation[          , genome 18417] predictions:    9911/  10000 (99.11%), best:    9917/10000 (99.17%), error:       313.84033, best error:       272.22107 on epoch:    66, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 2112.2573242188s, input_fired_time: 23.0174636841, output_fired_time: 29.6513328552, propagate_forward_time: 801.1825561523, propagate_backward_time: 1227.6129150391, weight_update_time: 2.6228480339, other_time: 30.7928466797
epoch time: 163.6058654785s, input_fired_time: 4.5334076881, output_fired_time: 0.0000000000, propagate_forward_time: 154.7615051270, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3109588623
validation[          , genome 18417] predictions:    9908/  10000 (99.08%), best:    9917/10000 (99.17%), error:       310.96738, best error:       272.22107 on epoch:    66, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 2151.2182617188s, input_fired_time: 20.2642822266, output_fired_time: 33.0831222534, propagate_forward_time: 804.9523925781, propagate_backward_time: 1268.4816894531, weight_update_time: 2.6881873608, other_time: 24.4370117188
epoch time: 186.8705139160s, input_fired_time: 3.9428529739, output_fired_time: 0.0000000000, propagate_forward_time: 177.4314422607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4962158203
validation[          , genome 18417] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       309.66690, best error:       272.22107 on epoch:    66, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 2348.2365722656s, input_fired_time: 27.5254287720, output_fired_time: 33.7769279480, propagate_forward_time: 889.5445556641, propagate_backward_time: 1368.7264404297, weight_update_time: 2.9145169258, other_time: 28.6633300781
epoch time: 196.2834930420s, input_fired_time: 3.9737818241, output_fired_time: 0.0000000000, propagate_forward_time: 187.1122589111, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1974487305
validation[          , genome 18417] predictions:    9907/  10000 (99.07%), best:    9917/10000 (99.17%), error:       303.74469, best error:       272.22107 on epoch:    66, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 2199.2612304688s, input_fired_time: 27.2946777344, output_fired_time: 26.8272285461, propagate_forward_time: 827.3353271484, propagate_backward_time: 1288.0977783203, weight_update_time: 1.5809584856, other_time: 29.7062988281
epoch time: 164.6918029785s, input_fired_time: 4.5955200195, output_fired_time: 0.0000000000, propagate_forward_time: 153.9108428955, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1854400635
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       306.18539, best error:       272.22107 on epoch:    66, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 2076.1450195313s, input_fired_time: 28.8871154785, output_fired_time: 30.2292327881, propagate_forward_time: 764.0904541016, propagate_backward_time: 1230.5441894531, weight_update_time: 1.6100074053, other_time: 22.3940429688
epoch time: 164.8308105469s, input_fired_time: 3.5473821163, output_fired_time: 0.0000000000, propagate_forward_time: 156.8483581543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4350738525
validation[          , genome 18417] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       307.52286, best error:       272.22107 on epoch:    66, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 2089.2548828125s, input_fired_time: 25.9890518188, output_fired_time: 26.0271701813, propagate_forward_time: 788.7338867188, propagate_backward_time: 1225.6386718750, weight_update_time: 2.5481710434, other_time: 22.8660888672
epoch time: 161.6105499268s, input_fired_time: 3.4156131744, output_fired_time: 0.0000000000, propagate_forward_time: 154.9967346191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1981964111
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       311.89487, best error:       272.22107 on epoch:    66, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 2175.0026855469s, input_fired_time: 23.2861804962, output_fired_time: 30.6016960144, propagate_forward_time: 807.5528564453, propagate_backward_time: 1287.3780517578, weight_update_time: 1.6412944794, other_time: 26.1838378906
epoch time: 184.3792419434s, input_fired_time: 3.9103281498, output_fired_time: 0.0000000000, propagate_forward_time: 175.8151855469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6537322998
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       316.03534, best error:       272.22107 on epoch:    66, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 2212.0297851563s, input_fired_time: 26.1151618958, output_fired_time: 29.8401889801, propagate_forward_time: 836.1182250977, propagate_backward_time: 1292.3946533203, weight_update_time: 1.8401479721, other_time: 27.5616455078
epoch time: 170.8633728027s, input_fired_time: 2.9167702198, output_fired_time: 0.0000000000, propagate_forward_time: 163.2080383301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7385711670
validation[          , genome 18417] predictions:    9906/  10000 (99.06%), best:    9917/10000 (99.17%), error:       310.77249, best error:       272.22107 on epoch:    66, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 2324.1262207031s, input_fired_time: 25.5364093781, output_fired_time: 30.4304409027, propagate_forward_time: 884.3215942383, propagate_backward_time: 1352.9322509766, weight_update_time: 2.7438652515, other_time: 30.9056396484
epoch time: 175.4436492920s, input_fired_time: 2.9552559853, output_fired_time: 0.0000000000, propagate_forward_time: 167.8588562012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6295318604
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       315.32492, best error:       272.22107 on epoch:    66, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 2492.2048339844s, input_fired_time: 34.2992439270, output_fired_time: 30.3984775543, propagate_forward_time: 937.4797973633, propagate_backward_time: 1446.6457519531, weight_update_time: 3.0699675083, other_time: 43.3815917969
epoch time: 203.8050689697s, input_fired_time: 4.2560329437, output_fired_time: 0.0000000000, propagate_forward_time: 189.8095092773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.7395324707
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       317.40332, best error:       272.22107 on epoch:    66, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 2479.2910156250s, input_fired_time: 35.9393005371, output_fired_time: 35.3844451904, propagate_forward_time: 925.5308227539, propagate_backward_time: 1452.5701904297, weight_update_time: 2.0455324650, other_time: 29.8663330078
epoch time: 203.2871704102s, input_fired_time: 5.0773930550, output_fired_time: 0.0000000000, propagate_forward_time: 194.5181884766, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6915893555
validation[          , genome 18417] predictions:    9914/  10000 (99.14%), best:    9917/10000 (99.17%), error:       310.08221, best error:       272.22107 on epoch:    66, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 2087.7570800781s, input_fired_time: 23.8859634399, output_fired_time: 30.5529766083, propagate_forward_time: 785.9741210938, propagate_backward_time: 1221.9920654297, weight_update_time: 2.5740461349, other_time: 25.3519287109
epoch time: 156.6367645264s, input_fired_time: 3.4902038574, output_fired_time: 0.0000000000, propagate_forward_time: 150.1374969482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0090637207
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       312.35730, best error:       272.22107 on epoch:    66, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 2057.9655761719s, input_fired_time: 21.5239849091, output_fired_time: 24.0743103027, propagate_forward_time: 791.5872802734, propagate_backward_time: 1197.0871582031, weight_update_time: 1.5659651756, other_time: 23.6928710938
epoch time: 174.7119445801s, input_fired_time: 4.8210134506, output_fired_time: 0.0000000000, propagate_forward_time: 165.0997467041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7911834717
validation[          , genome 18417] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       308.42465, best error:       272.22107 on epoch:    66, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 2369.0888671875s, input_fired_time: 30.3641681671, output_fired_time: 32.1581535339, propagate_forward_time: 888.3168334961, propagate_backward_time: 1388.2780761719, weight_update_time: 1.9498987198, other_time: 29.9714355469
epoch time: 181.6123962402s, input_fired_time: 5.8019294739, output_fired_time: 0.0000000000, propagate_forward_time: 167.7646331787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0458374023
validation[          , genome 18417] predictions:    9911/  10000 (99.11%), best:    9917/10000 (99.17%), error:       308.59943, best error:       272.22107 on epoch:    66, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 2307.8898925781s, input_fired_time: 25.3384342194, output_fired_time: 28.3454627991, propagate_forward_time: 874.2560424805, propagate_backward_time: 1351.4952392578, weight_update_time: 1.7821377516, other_time: 28.4547119141
epoch time: 162.9565887451s, input_fired_time: 2.6174647808, output_fired_time: 0.0000000000, propagate_forward_time: 155.8845977783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4545288086
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       303.82150, best error:       272.22107 on epoch:    66, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 2000.6175537109s, input_fired_time: 29.1429519653, output_fired_time: 25.3721561432, propagate_forward_time: 740.5192871094, propagate_backward_time: 1182.6295166016, weight_update_time: 1.5904067755, other_time: 22.9536132813
epoch time: 157.2747192383s, input_fired_time: 3.5576562881, output_fired_time: 0.0000000000, propagate_forward_time: 150.4190979004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2979583740
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       308.97107, best error:       272.22107 on epoch:    66, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 2005.5488281250s, input_fired_time: 25.2533054352, output_fired_time: 26.4792461395, propagate_forward_time: 760.5393676758, propagate_backward_time: 1172.6765136719, weight_update_time: 1.5419687033, other_time: 20.6003417969
epoch time: 155.1451568604s, input_fired_time: 3.3844780922, output_fired_time: 0.0000000000, propagate_forward_time: 147.6936798096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0670013428
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       314.09348, best error:       272.22107 on epoch:    66, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1974.6250000000s, input_fired_time: 23.8071861267, output_fired_time: 23.3442554474, propagate_forward_time: 742.9713745117, propagate_backward_time: 1157.9125976563, weight_update_time: 2.6403212547, other_time: 26.5895996094
epoch time: 156.7946929932s, input_fired_time: 2.4068539143, output_fired_time: 0.0000000000, propagate_forward_time: 148.0969390869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2908935547
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       312.89557, best error:       272.22107 on epoch:    66, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1996.4150390625s, input_fired_time: 20.0544528961, output_fired_time: 23.3862705231, propagate_forward_time: 764.1545410156, propagate_backward_time: 1164.7491455078, weight_update_time: 2.6347918510, other_time: 24.0706787109
epoch time: 160.7881927490s, input_fired_time: 3.4847514629, output_fired_time: 0.0000000000, propagate_forward_time: 153.4593048096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8441314697
validation[          , genome 18417] predictions:    9907/  10000 (99.07%), best:    9917/10000 (99.17%), error:       311.23959, best error:       272.22107 on epoch:    66, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 2004.2272949219s, input_fired_time: 26.2053508759, output_fired_time: 25.5411968231, propagate_forward_time: 756.3306274414, propagate_backward_time: 1172.9202880859, weight_update_time: 3.7439231873, other_time: 23.2298583984
epoch time: 156.4787597656s, input_fired_time: 3.3748383522, output_fired_time: 0.0000000000, propagate_forward_time: 150.0576934814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0462341309
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       314.53943, best error:       272.22107 on epoch:    66, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1974.4411621094s, input_fired_time: 20.8242797852, output_fired_time: 26.2783527374, propagate_forward_time: 749.4055786133, propagate_backward_time: 1158.7106933594, weight_update_time: 1.5369846821, other_time: 19.2224121094
epoch time: 155.0295104980s, input_fired_time: 2.3814668655, output_fired_time: 0.0000000000, propagate_forward_time: 147.5167694092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1312713623
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       308.92764, best error:       272.22107 on epoch:    66, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1974.1751708984s, input_fired_time: 21.8423271179, output_fired_time: 25.8956489563, propagate_forward_time: 747.2558593750, propagate_backward_time: 1152.2617187500, weight_update_time: 1.5337401628, other_time: 26.9196777344
epoch time: 159.4711761475s, input_fired_time: 3.5562858582, output_fired_time: 0.0000000000, propagate_forward_time: 151.8670654297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0478210449
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       311.62170, best error:       272.22107 on epoch:    66, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1975.4484863281s, input_fired_time: 21.7849178314, output_fired_time: 22.1016273499, propagate_forward_time: 742.7183227539, propagate_backward_time: 1162.6489257813, weight_update_time: 1.5303287506, other_time: 26.1945800781
epoch time: 151.9980926514s, input_fired_time: 2.3495094776, output_fired_time: 0.0000000000, propagate_forward_time: 145.6357116699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0128784180
validation[          , genome 18417] predictions:    9911/  10000 (99.11%), best:    9917/10000 (99.17%), error:       310.79892, best error:       272.22107 on epoch:    66, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1945.2668457031s, input_fired_time: 21.5166282654, output_fired_time: 22.8203182220, propagate_forward_time: 729.5491333008, propagate_backward_time: 1149.1079101563, weight_update_time: 1.5162570477, other_time: 22.2729492188
epoch time: 155.2918853760s, input_fired_time: 5.4308571815, output_fired_time: 0.0000000000, propagate_forward_time: 145.8554992676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0055236816
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       316.82269, best error:       272.22107 on epoch:    66, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1955.4971923828s, input_fired_time: 24.5543880463, output_fired_time: 23.0137195587, propagate_forward_time: 745.8282470703, propagate_backward_time: 1139.9267578125, weight_update_time: 1.5309228897, other_time: 22.1740722656
epoch time: 150.4430236816s, input_fired_time: 3.3397691250, output_fired_time: 0.0000000000, propagate_forward_time: 144.0655059814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0377502441
validation[          , genome 18417] predictions:    9910/  10000 (99.10%), best:    9917/10000 (99.17%), error:       309.27911, best error:       272.22107 on epoch:    66, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1955.7491455078s, input_fired_time: 20.5148735046, output_fired_time: 23.8732242584, propagate_forward_time: 731.8245849609, propagate_backward_time: 1156.5629882813, weight_update_time: 2.5152583122, other_time: 22.9735107422
epoch time: 153.8662261963s, input_fired_time: 3.3944149017, output_fired_time: 0.0000000000, propagate_forward_time: 147.3879699707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0838470459
validation[          , genome 18417] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       311.75839, best error:       272.22107 on epoch:    66, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1947.0006103516s, input_fired_time: 24.3203811646, output_fired_time: 24.5506935120, propagate_forward_time: 723.2995605469, propagate_backward_time: 1153.7613525391, weight_update_time: 1.5145670176, other_time: 21.0686035156
epoch time: 154.8366241455s, input_fired_time: 2.3583230972, output_fired_time: 0.0000000000, propagate_forward_time: 146.4515991211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0267028809
validation[          , genome 18417] predictions:    9913/  10000 (99.13%), best:    9917/10000 (99.17%), error:       306.11600, best error:       272.22107 on epoch:    66, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1955.7449951172s, input_fired_time: 24.5527572632, output_fired_time: 22.0547866821, propagate_forward_time: 736.1036376953, propagate_backward_time: 1152.0136718750, weight_update_time: 1.5294784307, other_time: 21.0201416016
epoch time: 153.1848754883s, input_fired_time: 3.3495662212, output_fired_time: 0.0000000000, propagate_forward_time: 144.7636260986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0716857910
validation[          , genome 18417] predictions:    9909/  10000 (99.09%), best:    9917/10000 (99.17%), error:       306.06943, best error:       272.22107 on epoch:    66, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1961.8231201172s, input_fired_time: 18.5904884338, output_fired_time: 25.0048980713, propagate_forward_time: 755.2867431641, propagate_backward_time: 1143.9051513672, weight_update_time: 3.5010178089, other_time: 19.0358886719
epoch time: 152.9250335693s, input_fired_time: 3.4599804878, output_fired_time: 0.0000000000, propagate_forward_time: 145.4403076172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0247497559
validation[          , genome 18417] predictions:    9912/  10000 (99.12%), best:    9917/10000 (99.17%), error:       305.26743, best error:       272.22107 on epoch:    66, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 769.9349365234s, input_fired_time: 14.3621454239, output_fired_time: 0.0000000000, propagate_forward_time: 736.3264160156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 19.2463989258
best training[          , genome 18417] predictions:   49999/  50000 (100.00%), best:    9917/10000 (99.17%), error:        24.47493, best error:       272.22107 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 154.6937103271s, input_fired_time: 2.3438329697, output_fired_time: 0.0000000000, propagate_forward_time: 147.3355255127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0143585205
   testing[          , genome 18417] predictions:    9919/  10000 (99.19%), best:    9917/10000 (99.17%), error:       234.87839, best error:       272.22107 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
17:04:46 (4692): called boinc_finish(0)

</stderr_txt>
]]>