Nameexact_genome_1542649503_178_6335_1
Workunit4099372
Created20 Nov 2018, 2:08:49 UTC
Sent20 Nov 2018, 2:09:10 UTC
Report deadline4 Feb 2019, 3:43:23 UTC
Received23 Nov 2018, 0:49:19 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID78968
Run time1 days 20 hours 51 min 1 sec
CPU time1 days 20 hours 33 min 31 sec
Validate stateValid
Credit19,016.36
Device peak FLOPS2.20 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size569.53 MB
Peak swap size589.37 MB
Peak disk usage17.06 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
ading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.872009
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 5.42245e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 5.93436e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 29
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 25
read number_validation_images: 10000
read best_validation_predictions: 6404
read best_validation_error: 10549.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '1942494043'
read generator: 1942494043
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3065.66235351563s, input_fired_time: 37.3379173278809, output_fired_time: 15.2296285629272, propagate_forward_time: 1163.64978027344, propagate_backward_time: 1822.26611328125, weight_update_time: 0.870067656040192, other_time: 27.1788330078125
epoch time: 224.93766784668s, input_fired_time: 2.44834876060486, output_fired_time: 0, propagate_forward_time: 218.148727416992, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.34059143066406
validation[          , genome  6335] predictions:    6234/  10000 (62.34%), best:    6404/10000 (64.04%), error:     10984.88477, best error:     10549.25098 on epoch:    25, epoch:   29/50, mu: 0.8720089793, learning_rate: 0.0000542245, weight_decay: 0.0000593436

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.877728
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 4.99128e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 5.50492e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 30
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 25
read number_validation_images: 10000
read best_validation_predictions: 6404
read best_validation_error: 10549.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '55691020'
read generator: 55691020
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3026.93505859375s, input_fired_time: 37.3757133483887, output_fired_time: 15.3372554779053, propagate_forward_time: 1139.35583496094, propagate_backward_time: 1807.90686035156, weight_update_time: 0.883522272109985, other_time: 26.95947265625
epoch time: 233.959457397461s, input_fired_time: 2.55754637718201, output_fired_time: 0, propagate_forward_time: 226.994506835938, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.40740966796875
validation[          , genome  6335] predictions:    6418/  10000 (64.18%), best:    6418/10000 (64.18%), error:     10470.75879, best error:     10470.75879 on epoch:    30, epoch:   30/50, mu: 0.8777275681, learning_rate: 0.0000499128, weight_decay: 0.0000550492

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.883169
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 4.59439e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 5.10656e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 31
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 30
read number_validation_images: 10000
read best_validation_predictions: 6418
read best_validation_error: 10470.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '1136705951'
read generator: 1136705951
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.883169
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 4.59439e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 5.10656e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 31
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 30
read number_validation_images: 10000
read best_validation_predictions: 6418
read best_validation_error: 10470.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '1136705951'
read generator: 1136705951
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.883169
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 4.59439e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 5.10656e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 31
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 30
read number_validation_images: 10000
read best_validation_predictions: 6418
read best_validation_error: 10470.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '1136705951'
read generator: 1136705951
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.883169
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 4.59439e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 5.10656e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 31
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 30
read number_validation_images: 10000
read best_validation_predictions: 6418
read best_validation_error: 10470.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '1136705951'
read generator: 1136705951
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3074.61865234375s, input_fired_time: 37.2737731933594, output_fired_time: 15.5481309890747, propagate_forward_time: 1160.92602539063, propagate_backward_time: 1833.93395996094, weight_update_time: 0.877549171447754, other_time: 26.9368896484375
epoch time: 242.533767700195s, input_fired_time: 2.61870551109314, output_fired_time: 0, propagate_forward_time: 235.25080871582, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.66426086425781
validation[          , genome  6335] predictions:    6340/  10000 (63.40%), best:    6418/10000 (64.18%), error:     10696.57129, best error:     10470.75879 on epoch:    30, epoch:   31/50, mu: 0.8831689954, learning_rate: 0.0000459439, weight_decay: 0.0000510656

epoch time: 3121.6054687500s, input_fired_time: 37.5987472534, output_fired_time: 15.7105445862, propagate_forward_time: 1182.3759765625, propagate_backward_time: 1858.4884033203, weight_update_time: 0.9008274674, other_time: 27.4320068359
epoch time: 242.9129638672s, input_fired_time: 2.6065888405, output_fired_time: 0.0000000000, propagate_forward_time: 235.4738311768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8325500488
validation[          , genome  6335] predictions:    6418/  10000 (64.18%), best:    6418/10000 (64.18%), error:     10483.64648, best error:     10470.75879 on epoch:    30, epoch:   32/50, mu: 0.8883467317, learning_rate: 0.0000422907, weight_decay: 0.0000473702

epoch time: 3081.7614746094s, input_fired_time: 37.3190498352, output_fired_time: 15.6985721588, propagate_forward_time: 1164.9173583984, propagate_backward_time: 1836.2420654297, weight_update_time: 0.9066511393, other_time: 27.5844726563
epoch time: 237.6010894775s, input_fired_time: 2.5560021400, output_fired_time: 0.0000000000, propagate_forward_time: 230.4954986572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5495910645
validation[          , genome  6335] predictions:    6449/  10000 (64.49%), best:    6449/10000 (64.49%), error:     10376.51563, best error:     10376.51563 on epoch:    33, epoch:   33/50, mu: 0.8932735324, learning_rate: 0.0000389279, weight_decay: 0.0000439423

epoch time: 3051.6650390625s, input_fired_time: 37.2905082703, output_fired_time: 15.4083299637, propagate_forward_time: 1150.0651855469, propagate_backward_time: 1821.7354736328, weight_update_time: 0.8858827949, other_time: 27.1654052734
epoch time: 232.7531127930s, input_fired_time: 2.5959746838, output_fired_time: 0.0000000000, propagate_forward_time: 225.6439056396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5132293701
validation[          , genome  6335] predictions:    6329/  10000 (63.29%), best:    6449/10000 (64.49%), error:     10532.24707, best error:     10376.51563 on epoch:    33, epoch:   34/50, mu: 0.8979614973, learning_rate: 0.0000358326, weight_decay: 0.0000407624

epoch time: 3026.3330078125s, input_fired_time: 38.5116424561, output_fired_time: 15.2536191940, propagate_forward_time: 1139.0256347656, propagate_backward_time: 1806.3134765625, weight_update_time: 0.8832365274, other_time: 27.2285156250
epoch time: 233.1617584229s, input_fired_time: 2.6060869694, output_fired_time: 0.0000000000, propagate_forward_time: 225.8608398438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6948242188
validation[          , genome  6335] predictions:    6521/  10000 (65.21%), best:    6521/10000 (65.21%), error:     10133.65918, best error:     10133.65918 on epoch:    35, epoch:   35/50, mu: 0.9024223089, learning_rate: 0.0000329833, weight_decay: 0.0000378126

epoch time: 3113.8605957031s, input_fired_time: 38.6784820557, output_fired_time: 15.7204532623, propagate_forward_time: 1171.6311035156, propagate_backward_time: 1860.2321777344, weight_update_time: 0.8901627660, other_time: 27.5983886719
epoch time: 239.0039367676s, input_fired_time: 2.5907337666, output_fired_time: 0.0000000000, propagate_forward_time: 231.9279174805, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4852905273
validation[          , genome  6335] predictions:    6542/  10000 (65.42%), best:    6542/10000 (65.42%), error:     10074.91602, best error:     10074.91602 on epoch:    36, epoch:   36/50, mu: 0.9066668749, learning_rate: 0.0000303606, weight_decay: 0.0000350763

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.910706
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 2.79465e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 3.2538e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 37
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6542
read best_validation_error: 10074.9
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '944156089'
read generator: 944156089
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2983.158203125s, input_fired_time: 38.1848945617676, output_fired_time: 14.9688148498535, propagate_forward_time: 1121.306640625, propagate_backward_time: 1782.43408203125, weight_update_time: 0.853668868541718, other_time: 26.263916015625
epoch time: 238.101409912109s, input_fired_time: 2.61322474479675, output_fired_time: 0, propagate_forward_time: 230.872436523438, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.61575317382813
validation[          , genome  6335] predictions:    6538/  10000 (65.38%), best:    6538/10000 (65.38%), error:     10042.75879, best error:     10042.75879 on epoch:    37, epoch:   37/50, mu: 0.9107057452, learning_rate: 0.0000279465, weight_decay: 0.0000325380

epoch time: 3048.3535156250s, input_fired_time: 38.8375129700, output_fired_time: 15.3280010223, propagate_forward_time: 1147.3940429688, propagate_backward_time: 1820.2093505859, weight_update_time: 0.8702471852, other_time: 26.5848388672
epoch time: 226.5768432617s, input_fired_time: 2.5129454136, output_fired_time: 0.0000000000, propagate_forward_time: 219.6843261719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3795776367
validation[          , genome  6335] predictions:    6590/  10000 (65.90%), best:    6590/10000 (65.90%), error:     10023.40820, best error:     10023.40820 on epoch:    38, epoch:   38/50, mu: 0.9145488739, learning_rate: 0.0000257243, weight_decay: 0.0000301834

epoch time: 3044.3764648438s, input_fired_time: 38.8484153748, output_fired_time: 15.3443441391, propagate_forward_time: 1148.5589599609, propagate_backward_time: 1815.5969238281, weight_update_time: 0.8428815007, other_time: 26.0279541016
epoch time: 237.9123535156s, input_fired_time: 2.6394021511, output_fired_time: 0.0000000000, propagate_forward_time: 230.7571716309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5157775879
validation[          , genome  6335] predictions:    6467/  10000 (64.67%), best:    6590/10000 (65.90%), error:     10241.71973, best error:     10023.40820 on epoch:    38, epoch:   39/50, mu: 0.9182057381, learning_rate: 0.0000236788, weight_decay: 0.0000279992

epoch time: 3068.4777832031s, input_fired_time: 38.1635589600, output_fired_time: 15.4602699280, propagate_forward_time: 1160.2575683594, propagate_backward_time: 1827.5356445313, weight_update_time: 0.8892661333, other_time: 27.0607910156
epoch time: 249.9073944092s, input_fired_time: 2.7150306702, output_fired_time: 0.0000000000, propagate_forward_time: 242.4333953857, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7589721680
validation[          , genome  6335] predictions:    6524/  10000 (65.24%), best:    6590/10000 (65.90%), error:     10186.84766, best error:     10023.40820 on epoch:    38, epoch:   40/50, mu: 0.9216853380, learning_rate: 0.0000217960, weight_decay: 0.0000259730

epoch time: 3086.2670898438s, input_fired_time: 37.8514671326, output_fired_time: 15.4553251266, propagate_forward_time: 1159.7812500000, propagate_backward_time: 1845.8908691406, weight_update_time: 0.9029740095, other_time: 27.2880859375
epoch time: 235.7740783691s, input_fired_time: 2.5923070908, output_fired_time: 0.0000000000, propagate_forward_time: 228.3992767334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7825012207
validation[          , genome  6335] predictions:    6426/  10000 (64.26%), best:    6590/10000 (65.90%), error:     10309.19336, best error:     10023.40820 on epoch:    38, epoch:   41/50, mu: 0.9249963164, learning_rate: 0.0000200629, weight_decay: 0.0000240935

epoch time: 3125.6223144531s, input_fired_time: 38.8623695374, output_fired_time: 15.7985944748, propagate_forward_time: 1173.2053222656, propagate_backward_time: 1869.8637695313, weight_update_time: 0.8830927610, other_time: 27.8923339844
epoch time: 230.9254302979s, input_fired_time: 2.5723860264, output_fired_time: 0.0000000000, propagate_forward_time: 223.8988647461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4541778564
validation[          , genome  6335] predictions:    6383/  10000 (63.83%), best:    6590/10000 (65.90%), error:     10416.26074, best error:     10023.40820 on epoch:    38, epoch:   42/50, mu: 0.9281468391, learning_rate: 0.0000184676, weight_decay: 0.0000223500

epoch time: 3090.3178710938s, input_fired_time: 39.4986763000, output_fired_time: 15.9403829575, propagate_forward_time: 1163.3427734375, propagate_backward_time: 1843.5740966797, weight_update_time: 0.8942340612, other_time: 27.9617919922
epoch time: 240.0678253174s, input_fired_time: 2.6527826786, output_fired_time: 0.0000000000, propagate_forward_time: 232.5811309814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8339080811
validation[          , genome  6335] predictions:    6564/  10000 (65.64%), best:    6564/10000 (65.64%), error:     10014.20508, best error:     10014.20508 on epoch:    43, epoch:   43/50, mu: 0.9311446548, learning_rate: 0.0000169991, weight_decay: 0.0000207326

epoch time: 3037.9055175781s, input_fired_time: 38.7410087585, output_fired_time: 15.3007202148, propagate_forward_time: 1145.3300781250, propagate_backward_time: 1811.7634277344, weight_update_time: 0.8627917767, other_time: 26.7702636719
epoch time: 239.7505493164s, input_fired_time: 2.6846096516, output_fired_time: 0.0000000000, propagate_forward_time: 232.2013092041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8646240234
validation[          , genome  6335] predictions:    6488/  10000 (64.88%), best:    6564/10000 (65.64%), error:     10200.36621, best error:     10014.20508 on epoch:    43, epoch:   44/50, mu: 0.9339971542, learning_rate: 0.0000156474, weight_decay: 0.0000192323

epoch time: 3077.3200683594s, input_fired_time: 38.7918281555, output_fired_time: 15.2781753540, propagate_forward_time: 1159.2926025391, propagate_backward_time: 1836.7182617188, weight_update_time: 0.8779059649, other_time: 27.2393798828
epoch time: 243.2081146240s, input_fired_time: 2.6466863155, output_fired_time: 0.0000000000, propagate_forward_time: 235.7626037598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7988281250
validation[          , genome  6335] predictions:    6646/  10000 (66.46%), best:    6646/10000 (66.46%), error:      9883.01270, best error:      9883.01270 on epoch:    45, epoch:   45/50, mu: 0.9367114305, learning_rate: 0.0000144032, weight_decay: 0.0000178406

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.939294
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 1.32579e-05
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 1.65495e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 46
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6646
read best_validation_error: 9883.01
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '1604993452'
read generator: 1604993452
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2822.72485351563s, input_fired_time: 34.8355484008789, output_fired_time: 14.8855209350586, propagate_forward_time: 1069.63745117188, propagate_backward_time: 1677.67687988281, weight_update_time: 0.874147057533264, other_time: 25.6895751953125
epoch time: 219.761047363281s, input_fired_time: 2.43895649909973, output_fired_time: 0, propagate_forward_time: 213.076858520508, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.2452392578125
validation[          , genome  6335] predictions:    6597/  10000 (65.97%), best:    6597/10000 (65.97%), error:      9873.79492, best error:      9873.79492 on epoch:    46, epoch:   46/50, mu: 0.9392941594, learning_rate: 0.0000132579, weight_decay: 0.0000165495

epoch time: 2842.6862792969s, input_fired_time: 35.2351913452, output_fired_time: 14.6804580688, propagate_forward_time: 1076.1246337891, propagate_backward_time: 1690.5003662109, weight_update_time: 0.9011945724, other_time: 26.1457519531
epoch time: 232.9123229980s, input_fired_time: 2.5441458225, output_fired_time: 0.0000000000, propagate_forward_time: 225.8542327881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5139465332
validation[          , genome  6335] predictions:    6385/  10000 (63.85%), best:    6597/10000 (65.97%), error:     10414.32324, best error:      9873.79492 on epoch:    46, epoch:   47/50, mu: 0.9417517185, learning_rate: 0.0000122037, weight_decay: 0.0000153519

epoch time: 2728.5239257813s, input_fired_time: 33.7175025940, output_fired_time: 13.9551963806, propagate_forward_time: 1024.2399902344, propagate_backward_time: 1632.3804931641, weight_update_time: 0.8408166766, other_time: 24.2308349609
epoch time: 219.6557159424s, input_fired_time: 2.3880896568, output_fired_time: 0.0000000000, propagate_forward_time: 213.1644592285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1031646729
validation[          , genome  6335] predictions:    6664/  10000 (66.64%), best:    6664/10000 (66.64%), error:      9841.16602, best error:      9841.16602 on epoch:    48, epoch:   48/50, mu: 0.9440901279, learning_rate: 0.0000112333, weight_decay: 0.0000142410

epoch time: 2770.2817382813s, input_fired_time: 33.7715187073, output_fired_time: 14.1014213562, propagate_forward_time: 1044.7501220703, propagate_backward_time: 1653.4573974609, weight_update_time: 0.8115226030, other_time: 24.2014160156
epoch time: 223.4276275635s, input_fired_time: 2.5075728893, output_fired_time: 0.0000000000, propagate_forward_time: 216.8287200928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0913391113
validation[          , genome  6335] predictions:    6648/  10000 (66.48%), best:    6648/10000 (66.48%), error:      9813.05762, best error:      9813.05762 on epoch:    49, epoch:   49/50, mu: 0.9463152289, learning_rate: 0.0000103401, weight_decay: 0.0000132104

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542649503_178_6335_1_r1942989269_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.491631
read mu: 0.948433
read mu_delta: 0.951533
read initial_learning_rate: 0.0005994
read learning_rate: 9.51791e-06
read learning_rate_delta: 0.920485
read initial_weight_decay: 0.000524127
read weight_decay: 1.22545e-05
read weight_decay_delta: 0.927635
read batch_size: 101
read epsilon: 1e-07
read alpha: 0.0861825
read input_dropout_probability: 0.00112612
read hidden_dropout_probability: 0.107785
read velocity_reset: 2125
read epoch: 50
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 49
read number_validation_images: 10000
read best_validation_predictions: 6648
read best_validation_error: 9813.06
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6335
read normal distribution: '1 0.149309203028679 0.476610124111176'
generator_str: '948281866'
read generator: 948281866
read generated_by_map:
1 crossover 1
reading 121 nodes.
reading 651 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2672.68920898438s, input_fired_time: 33.814281463623, output_fired_time: 14.0235328674316, propagate_forward_time: 1011.73645019531, propagate_backward_time: 1589.61096191406, weight_update_time: 0.767951428890228, other_time: 23.504150390625
epoch time: 217.540603637695s, input_fired_time: 2.33720970153809, output_fired_time: 0, propagate_forward_time: 211.00569152832, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.19770812988281
validation[          , genome  6335] predictions:    6627/  10000 (66.27%), best:    6648/10000 (66.48%), error:     10030.80176, best error:      9813.05762 on epoch:    49, epoch:   50/50, mu: 0.9484325051, learning_rate: 0.0000095179, weight_decay: 0.0000122545

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1071.6325683594s, input_fired_time: 12.1005792618, output_fired_time: 0.0000000000, propagate_forward_time: 1037.6097412109, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 21.9222412109
best training[          , genome  6335] predictions:   36066/  50000 (72.13%), best:    6648/10000 (66.48%), error:     42770.55078, best error:      9813.05762 on epoch:    49, epoch:   51/50, mu: 0.9504471421, learning_rate: 0.0000087611, weight_decay: 0.0000113677
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 216.1505889893s, input_fired_time: 2.3592534065, output_fired_time: 0.0000000000, propagate_forward_time: 209.6808471680, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1104888916
   testing[          , genome  6335] predictions:    6648/  10000 (66.48%), best:    6648/10000 (66.48%), error:      9813.05762, best error:      9813.05762 on epoch:    49, epoch:   51/50, mu: 0.9504471421, learning_rate: 0.0000087611, weight_decay: 0.0000113677
backpropagation finished successfully!
16:48:54 (7104): called boinc_finish(0)

</stderr_txt>
]]>