Nameexact_genome_1540839302_183_5451_4
Workunit4078167
Created1 Mar 2019, 17:55:26 UTC
Sent1 Mar 2019, 18:04:49 UTC
Report deadline8 May 2019, 23:21:41 UTC
Received9 Mar 2019, 2:31:31 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID85280
Run time21 hours 4 min 51 sec
CPU time21 hours 2 min 33 sec
Validate stateValid
Credit17,055.01
Device peak FLOPS3.93 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size521.30 MB
Peak swap size540.71 MB
Peak disk usage9.74 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
  6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.975024
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000382045
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.52818e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 68
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 60
read number_validation_images: 10000
read best_validation_predictions: 6146
read best_validation_error: 11811.7
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '214803544'
read generator: 214803544
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 755.023803710938s, input_fired_time: 6.39015817642212, output_fired_time: 4.6292200088501, propagate_forward_time: 291.905792236328, propagate_backward_time: 442.473114013672, weight_update_time: 1.92988395690918, other_time: 9.62554931640625
epoch time: 60.5717124938965s, input_fired_time: 0.669670641422272, output_fired_time: 0, propagate_forward_time: 58.5967674255371, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.30527496337891
validation[          , genome  5451] predictions:    6010/  10000 (60.10%), best:    6146/10000 (61.46%), error:     12100.30176, best error:     11811.66016 on epoch:    60, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.975773
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000362943
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.45177e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 69
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 60
read number_validation_images: 10000
read best_validation_predictions: 6146
read best_validation_error: 11811.7
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '200871772'
read generator: 200871772
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.975773
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000362943
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.45177e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 69
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 60
read number_validation_images: 10000
read best_validation_predictions: 6146
read best_validation_error: 11811.7
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '200871772'
read generator: 200871772
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.975773
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000362943
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.45177e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 69
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 60
read number_validation_images: 10000
read best_validation_predictions: 6146
read best_validation_error: 11811.7
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '200871772'
read generator: 200871772
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 760.930786132813s, input_fired_time: 5.40616035461426, output_fired_time: 4.64234828948975, propagate_forward_time: 300.961883544922, propagate_backward_time: 441.252746582031, weight_update_time: 0.914412558078766, other_time: 8.66763305664063
epoch time: 61.0689315795898s, input_fired_time: 0.672968029975891, output_fired_time: 0, propagate_forward_time: 59.0899314880371, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.3060302734375
validation[          , genome  5451] predictions:    6121/  10000 (61.21%), best:    6121/10000 (61.21%), error:     11687.76660, best error:     11687.76660 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.976484
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000344796
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.37918e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 70
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 69
read number_validation_images: 10000
read best_validation_predictions: 6121
read best_validation_error: 11687.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '665062329'
read generator: 665062329
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.976484
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000344796
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.37918e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 70
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 69
read number_validation_images: 10000
read best_validation_predictions: 6121
read best_validation_error: 11687.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '665062329'
read generator: 665062329
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.976484
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000344796
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 1.37918e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 70
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 69
read number_validation_images: 10000
read best_validation_predictions: 6121
read best_validation_error: 11687.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '665062329'
read generator: 665062329
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 758.698547363281s, input_fired_time: 5.39090776443481, output_fired_time: 4.66561222076416, propagate_forward_time: 290.13134765625, propagate_backward_time: 449.781677246094, weight_update_time: 0.934447646141052, other_time: 8.72900390625
epoch time: 61.1502456665039s, input_fired_time: 0.674265205860138, output_fired_time: 0, propagate_forward_time: 59.1606597900391, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.3153190612793
validation[          , genome  5451] predictions:    6032/  10000 (60.32%), best:    6121/10000 (61.21%), error:     12100.28613, best error:     11687.76660 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 757.6994018555s, input_fired_time: 6.3887853622, output_fired_time: 4.5851974487, propagate_forward_time: 291.5063171387, propagate_backward_time: 445.4785766602, weight_update_time: 1.9398850203, other_time: 9.7405090332
epoch time: 61.0473403931s, input_fired_time: 0.6736204028, output_fired_time: 0.0000000000, propagate_forward_time: 59.0739059448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2998123169
validation[          , genome  5451] predictions:    6220/  10000 (62.20%), best:    6220/10000 (62.20%), error:     11550.45215, best error:     11550.45215 on epoch:    71, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 759.0775756836s, input_fired_time: 5.3967738152, output_fired_time: 4.5950989723, propagate_forward_time: 300.2932128906, propagate_backward_time: 441.0479431152, weight_update_time: 0.9370878339, other_time: 7.7445373535
epoch time: 61.4714469910s, input_fired_time: 0.6839383245, output_fired_time: 0.0000000000, propagate_forward_time: 58.4791030884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3084068298
validation[          , genome  5451] predictions:    6131/  10000 (61.31%), best:    6220/10000 (62.20%), error:     11695.19922, best error:     11550.45215 on epoch:    71, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 760.7257690430s, input_fired_time: 5.4027204514, output_fired_time: 5.6717905998, propagate_forward_time: 292.8112487793, propagate_backward_time: 448.1076965332, weight_update_time: 0.9268637896, other_time: 8.7322998047
epoch time: 61.1281814575s, input_fired_time: 0.6701890826, output_fired_time: 0.0000000000, propagate_forward_time: 59.1848831177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2731094360
validation[          , genome  5451] predictions:    6081/  10000 (60.81%), best:    6220/10000 (62.20%), error:     11897.05957, best error:     11550.45215 on epoch:    71, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 756.0721435547s, input_fired_time: 7.0006437302, output_fired_time: 4.6608161926, propagate_forward_time: 288.1682434082, propagate_backward_time: 448.5255126953, weight_update_time: 0.9306781292, other_time: 7.7168884277
epoch time: 60.8489723206s, input_fired_time: 0.6828544736, output_fired_time: 0.0000000000, propagate_forward_time: 58.8645782471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3015403748
validation[          , genome  5451] predictions:    6160/  10000 (61.60%), best:    6220/10000 (62.20%), error:     11682.61523, best error:     11550.45215 on epoch:    71, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 759.0759887695s, input_fired_time: 5.4042840004, output_fired_time: 6.6112003326, propagate_forward_time: 298.4791259766, propagate_backward_time: 440.9009704590, weight_update_time: 0.9303382039, other_time: 7.6803894043
epoch time: 60.9089736938s, input_fired_time: 1.6838716269, output_fired_time: 0.0000000000, propagate_forward_time: 57.9607429504, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2643585205
validation[          , genome  5451] predictions:    6099/  10000 (60.99%), best:    6220/10000 (62.20%), error:     12030.39746, best error:     11550.45215 on epoch:    71, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 759.2543945313s, input_fired_time: 7.4171462059, output_fired_time: 4.6147160530, propagate_forward_time: 289.4776916504, propagate_backward_time: 449.0700683594, weight_update_time: 0.9314963222, other_time: 8.6747131348
epoch time: 61.2606163025s, input_fired_time: 0.6751814485, output_fired_time: 0.0000000000, propagate_forward_time: 58.2808418274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3045921326
validation[          , genome  5451] predictions:    6126/  10000 (61.26%), best:    6220/10000 (62.20%), error:     11728.98926, best error:     11550.45215 on epoch:    71, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 759.9105834961s, input_fired_time: 5.4263420105, output_fired_time: 5.6417222023, propagate_forward_time: 293.5145874023, propagate_backward_time: 447.6164855957, weight_update_time: 0.9306653738, other_time: 7.7114562988
epoch time: 62.4603424072s, input_fired_time: 0.6751444340, output_fired_time: 0.0000000000, propagate_forward_time: 60.4974327087, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2877655029
validation[          , genome  5451] predictions:    6142/  10000 (61.42%), best:    6220/10000 (62.20%), error:     11590.36426, best error:     11550.45215 on epoch:    71, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 767.4269409180s, input_fired_time: 6.4450631142, output_fired_time: 4.7094697952, propagate_forward_time: 298.4398193359, propagate_backward_time: 450.1391906738, weight_update_time: 0.9359293580, other_time: 7.6933898926
epoch time: 62.4725952148s, input_fired_time: 0.6814162731, output_fired_time: 0.0000000000, propagate_forward_time: 60.4913406372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2998390198
validation[          , genome  5451] predictions:    6177/  10000 (61.77%), best:    6220/10000 (62.20%), error:     11681.11523, best error:     11550.45215 on epoch:    71, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 767.8854980469s, input_fired_time: 7.4738168716, output_fired_time: 4.7106575966, propagate_forward_time: 289.6106567383, propagate_backward_time: 458.4116821289, weight_update_time: 0.9321516156, other_time: 7.6787109375
epoch time: 62.5352668762s, input_fired_time: 0.6831816435, output_fired_time: 0.0000000000, propagate_forward_time: 60.5314064026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3206787109
validation[          , genome  5451] predictions:    6190/  10000 (61.90%), best:    6220/10000 (62.20%), error:     11666.84277, best error:     11550.45215 on epoch:    71, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 765.8515625000s, input_fired_time: 6.3444910049, output_fired_time: 6.6455512047, propagate_forward_time: 305.5853271484, propagate_backward_time: 439.5479125977, weight_update_time: 0.9366809130, other_time: 7.7282714844
epoch time: 62.5517730713s, input_fired_time: 0.6838228106, output_fired_time: 0.0000000000, propagate_forward_time: 59.5454063416, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3225440979
validation[          , genome  5451] predictions:    6183/  10000 (61.83%), best:    6220/10000 (62.20%), error:     11616.58594, best error:     11550.45215 on epoch:    71, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 767.4811401367s, input_fired_time: 5.4470624924, output_fired_time: 4.6980819702, propagate_forward_time: 295.8553161621, propagate_backward_time: 452.8426818848, weight_update_time: 1.8397058249, other_time: 8.6380004883
epoch time: 62.5807113647s, input_fired_time: 0.6825577021, output_fired_time: 0.0000000000, propagate_forward_time: 60.5770149231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3211402893
validation[          , genome  5451] predictions:    6096/  10000 (60.96%), best:    6220/10000 (62.20%), error:     11817.20020, best error:     11550.45215 on epoch:    71, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 764.8045043945s, input_fired_time: 5.4496340752, output_fired_time: 4.6735639572, propagate_forward_time: 306.5168151855, propagate_backward_time: 440.5349731445, weight_update_time: 0.9209387898, other_time: 7.6294860840
epoch time: 60.9089927673s, input_fired_time: 0.6766871214, output_fired_time: 0.0000000000, propagate_forward_time: 58.9551391602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2771682739
validation[          , genome  5451] predictions:    6237/  10000 (62.37%), best:    6237/10000 (62.37%), error:     11507.25098, best error:     11507.25098 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 768.9849243164s, input_fired_time: 5.4566888809, output_fired_time: 5.6863903999, propagate_forward_time: 306.7231140137, propagate_backward_time: 443.4182739258, weight_update_time: 0.9310623407, other_time: 7.7004699707
epoch time: 61.1802711487s, input_fired_time: 0.6839178801, output_fired_time: 0.0000000000, propagate_forward_time: 59.1867294312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3096237183
validation[          , genome  5451] predictions:    6209/  10000 (62.09%), best:    6237/10000 (62.37%), error:     11628.67480, best error:     11507.25098 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 764.3004760742s, input_fired_time: 7.4547095299, output_fired_time: 4.6543369293, propagate_forward_time: 295.2285461426, propagate_backward_time: 448.3022155762, weight_update_time: 0.9435133338, other_time: 8.6606445313
epoch time: 61.1355285645s, input_fired_time: 0.6792279482, output_fired_time: 0.0000000000, propagate_forward_time: 59.1619758606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2943229675
validation[          , genome  5451] predictions:    6173/  10000 (61.73%), best:    6237/10000 (62.37%), error:     11577.69727, best error:     11507.25098 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 761.5636596680s, input_fired_time: 7.4354143143, output_fired_time: 5.6699895859, propagate_forward_time: 296.9190979004, propagate_backward_time: 443.8847656250, weight_update_time: 0.9264917970, other_time: 7.6543884277
epoch time: 61.1947669983s, input_fired_time: 0.6743525863, output_fired_time: 0.0000000000, propagate_forward_time: 58.2144126892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3060035706
validation[          , genome  5451] predictions:    6148/  10000 (61.48%), best:    6237/10000 (62.37%), error:     11720.71777, best error:     11507.25098 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 764.0684204102s, input_fired_time: 5.4737448692, output_fired_time: 4.6700406075, propagate_forward_time: 301.7877502441, propagate_backward_time: 444.4569396973, weight_update_time: 0.9278107285, other_time: 7.6799316406
epoch time: 61.3231544495s, input_fired_time: 0.6838417649, output_fired_time: 0.0000000000, propagate_forward_time: 59.3083915710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3309211731
validation[          , genome  5451] predictions:    6197/  10000 (61.97%), best:    6237/10000 (62.37%), error:     11685.25977, best error:     11507.25098 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 767.7435302734s, input_fired_time: 5.4522995949, output_fired_time: 4.7042989731, propagate_forward_time: 290.9756774902, propagate_backward_time: 458.8402404785, weight_update_time: 0.9395490289, other_time: 7.7710571289
epoch time: 61.4172897339s, input_fired_time: 0.6786369085, output_fired_time: 0.0000000000, propagate_forward_time: 59.4504547119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2881965637
validation[          , genome  5451] predictions:    6209/  10000 (62.09%), best:    6237/10000 (62.37%), error:     11610.94922, best error:     11507.25098 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 769.4121704102s, input_fired_time: 6.3695931435, output_fired_time: 5.7227740288, propagate_forward_time: 299.2420349121, propagate_backward_time: 450.4287414551, weight_update_time: 0.9275060892, other_time: 7.6490478516
epoch time: 60.9369201660s, input_fired_time: 0.6792451143, output_fired_time: 0.0000000000, propagate_forward_time: 58.9735565186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2841186523
validation[          , genome  5451] predictions:    6183/  10000 (61.83%), best:    6237/10000 (62.37%), error:     11619.07227, best error:     11507.25098 on epoch:    82, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 760.1361694336s, input_fired_time: 5.4385528564, output_fired_time: 4.6279220581, propagate_forward_time: 293.8862609863, propagate_backward_time: 448.5441284180, weight_update_time: 0.9261412024, other_time: 7.6393127441
epoch time: 61.5101089478s, input_fired_time: 0.6820976734, output_fired_time: 0.0000000000, propagate_forward_time: 59.5258865356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3021240234
validation[          , genome  5451] predictions:    6137/  10000 (61.37%), best:    6237/10000 (62.37%), error:     11745.72852, best error:     11507.25098 on epoch:    82, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 753.0253295898s, input_fired_time: 5.4186673164, output_fired_time: 5.5754551888, propagate_forward_time: 291.0285034180, propagate_backward_time: 442.4000854492, weight_update_time: 0.9208384752, other_time: 8.6026611328
epoch time: 60.6209907532s, input_fired_time: 1.6842625141, output_fired_time: 0.0000000000, propagate_forward_time: 57.6427383423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2939910889
validation[          , genome  5451] predictions:    6228/  10000 (62.28%), best:    6237/10000 (62.37%), error:     11521.55273, best error:     11507.25098 on epoch:    82, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 753.3665771484s, input_fired_time: 5.3950581551, output_fired_time: 4.6262440681, propagate_forward_time: 294.8238525391, propagate_backward_time: 439.8123474121, weight_update_time: 0.9288995862, other_time: 8.7090759277
epoch time: 60.6377944946s, input_fired_time: 0.6756601930, output_fired_time: 0.0000000000, propagate_forward_time: 58.6607742310, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3013610840
validation[          , genome  5451] predictions:    6147/  10000 (61.47%), best:    6237/10000 (62.37%), error:     11637.76660, best error:     11507.25098 on epoch:    82, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540839302_183_5451_4_r1568062304_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.985627
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000111553
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 4.46212e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 92
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 82
read number_validation_images: 10000
read best_validation_predictions: 6237
read best_validation_error: 11507.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5451
read normal distribution: '1 -0.161340996623039 -0.714239895343781'
generator_str: '1882625973'
read generator: 1882625973
read generated_by_map:
1 merge_node 1
reading 76 nodes.
reading 299 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 753.418090820313s, input_fired_time: 5.42912673950195, output_fired_time: 4.6538257598877, propagate_forward_time: 294.332611083984, propagate_backward_time: 440.283325195313, weight_update_time: 0.929303526878357, other_time: 8.71920776367188
epoch time: 61.6719589233398s, input_fired_time: 0.685574769973755, output_fired_time: 0, propagate_forward_time: 59.6751937866211, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.31119155883789
validation[          , genome  5451] predictions:    6229/  10000 (62.29%), best:    6237/10000 (62.37%), error:     11530.18555, best error:     11507.25098 on epoch:    82, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 762.7816772461s, input_fired_time: 7.4737691879, output_fired_time: 5.6986527443, propagate_forward_time: 293.2817687988, propagate_backward_time: 446.6214904785, weight_update_time: 0.9315790534, other_time: 9.7059936523
epoch time: 61.2359695435s, input_fired_time: 0.6807804108, output_fired_time: 0.0000000000, propagate_forward_time: 59.2371444702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3180465698
validation[          , genome  5451] predictions:    6180/  10000 (61.80%), best:    6237/10000 (62.37%), error:     11661.19141, best error:     11507.25098 on epoch:    82, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 760.3850097656s, input_fired_time: 6.3358907700, output_fired_time: 4.6191105843, propagate_forward_time: 293.7626647949, propagate_backward_time: 446.9782409668, weight_update_time: 1.9448999166, other_time: 8.6890869141
epoch time: 61.0881423950s, input_fired_time: 0.6794919968, output_fired_time: 0.0000000000, propagate_forward_time: 59.1180152893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2906341553
validation[          , genome  5451] predictions:    6192/  10000 (61.92%), best:    6237/10000 (62.37%), error:     11524.48730, best error:     11507.25098 on epoch:    82, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 775.6912841797s, input_fired_time: 6.4873180389, output_fired_time: 4.6340208054, propagate_forward_time: 303.5925903320, propagate_backward_time: 452.2523803711, weight_update_time: 0.9293982387, other_time: 8.7249755859
epoch time: 60.9927673340s, input_fired_time: 1.6913864613, output_fired_time: 0.0000000000, propagate_forward_time: 58.0009803772, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3003997803
validation[          , genome  5451] predictions:    6206/  10000 (62.06%), best:    6237/10000 (62.37%), error:     11607.55176, best error:     11507.25098 on epoch:    82, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 762.4923706055s, input_fired_time: 5.4541015625, output_fired_time: 4.6671047211, propagate_forward_time: 291.7523803711, propagate_backward_time: 451.0083923340, weight_update_time: 0.9273285270, other_time: 9.6103820801
epoch time: 62.0882759094s, input_fired_time: 0.6855624318, output_fired_time: 0.0000000000, propagate_forward_time: 60.0952568054, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3074569702
validation[          , genome  5451] predictions:    6198/  10000 (61.98%), best:    6237/10000 (62.37%), error:     11684.14941, best error:     11507.25098 on epoch:    82, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 762.0289916992s, input_fired_time: 5.4457550049, output_fired_time: 5.6617183685, propagate_forward_time: 294.1066894531, propagate_backward_time: 448.1022644043, weight_update_time: 0.9306735396, other_time: 8.7125549316
epoch time: 61.6566696167s, input_fired_time: 1.6992137432, output_fired_time: 0.0000000000, propagate_forward_time: 58.6337051392, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3237495422
validation[          , genome  5451] predictions:    6184/  10000 (61.84%), best:    6237/10000 (62.37%), error:     11639.08301, best error:     11507.25098 on epoch:    82, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 758.8920898438s, input_fired_time: 6.3406229019, output_fired_time: 5.6186885834, propagate_forward_time: 290.4003295898, propagate_backward_time: 447.8150024414, weight_update_time: 1.9419640303, other_time: 8.7174072266
epoch time: 61.2289810181s, input_fired_time: 0.6846435666, output_fired_time: 0.0000000000, propagate_forward_time: 59.2208251953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3235130310
validation[          , genome  5451] predictions:    6198/  10000 (61.98%), best:    6237/10000 (62.37%), error:     11605.84863, best error:     11507.25098 on epoch:    82, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 753.4284667969s, input_fired_time: 5.4341926575, output_fired_time: 4.5740613937, propagate_forward_time: 287.7002868652, propagate_backward_time: 448.0970153809, weight_update_time: 0.9172568321, other_time: 7.6229248047
epoch time: 61.7784729004s, input_fired_time: 0.6829388142, output_fired_time: 0.0000000000, propagate_forward_time: 58.7609901428, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3345451355
validation[          , genome  5451] predictions:    6202/  10000 (62.02%), best:    6237/10000 (62.37%), error:     11585.61523, best error:     11507.25098 on epoch:    82, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 757.3009033203s, input_fired_time: 5.4346408844, output_fired_time: 4.6159462929, propagate_forward_time: 291.8158874512, propagate_backward_time: 446.7075805664, weight_update_time: 0.9305220246, other_time: 8.7268371582
epoch time: 61.7663497925s, input_fired_time: 0.6782550812, output_fired_time: 0.0000000000, propagate_forward_time: 59.7893676758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2987289429
validation[          , genome  5451] predictions:    6188/  10000 (61.88%), best:    6237/10000 (62.37%), error:     11598.02344, best error:     11507.25098 on epoch:    82, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 306.4738464355s, input_fired_time: 5.4088454247, output_fired_time: 0.0000000000, propagate_forward_time: 293.4801940918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5848083496
best training[          , genome  5451] predictions:   39337/  50000 (78.67%), best:    6237/10000 (62.37%), error:     32069.01367, best error:     11507.25098 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 60.9623794556s, input_fired_time: 0.6761221290, output_fired_time: 0.0000000000, propagate_forward_time: 58.9815101624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3047485352
   testing[          , genome  5451] predictions:    6237/  10000 (62.37%), best:    6237/10000 (62.37%), error:     11507.25098, best error:     11507.25098 on epoch:    82, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
19:31:07 (6448): called boinc_finish(0)

</stderr_txt>
]]>