Nameexact_genome_1542531604_179_6233_1
Workunit4096948
Created18 Nov 2018, 9:27:51 UTC
Sent18 Nov 2018, 10:02:09 UTC
Report deadline9 Jan 2019, 8:40:26 UTC
Received28 Nov 2018, 11:45:13 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID76073
Run time20 hours 47 min 56 sec
CPU time17 hours 27 min
Validate stateValid
Credit12,985.82
Device peak FLOPS3.64 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>

read best_epoch: 18
read number_validation_images: 10000
read best_validation_predictions: 6550
read best_validation_error: 10048.2
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '987920754'
read generator: 987920754
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2805.68017578125s, input_fired_time: 43.8648834228516, output_fired_time: 22.5343055725098, propagate_forward_time: 1034.68103027344, propagate_backward_time: 1687.10070800781, weight_update_time: 0.283977866172791, other_time: 17.4990234375
epoch time: 203.750701904297s, input_fired_time: 0.971019148826599, output_fired_time: 0, propagate_forward_time: 197.434158325195, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.34552001953125
validation[          , genome  6233] predictions:    6416/  10000 (64.16%), best:    6550/10000 (65.50%), error:     10400.73535, best error:     10048.18750 on epoch:    18, epoch:   23/50, mu: 0.8503288031, learning_rate: 0.0001997515, weight_decay: 0.0001033686

epoch time: 3975.7998046875s, input_fired_time: 45.3675193787, output_fired_time: 20.5197525024, propagate_forward_time: 1482.0529785156, propagate_backward_time: 2391.6538085938, weight_update_time: 0.4143268168, other_time: 36.2058105469
epoch time: 338.1008911133s, input_fired_time: 3.5568320751, output_fired_time: 0.0000000000, propagate_forward_time: 324.9764099121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.5676574707
validation[          , genome  6233] predictions:    6595/  10000 (65.95%), best:    6595/10000 (65.95%), error:      9971.21875, best error:      9971.21875 on epoch:    24, epoch:   24/50, mu: 0.8571686149, learning_rate: 0.0001817755, weight_decay: 0.0000967564

epoch time: 4072.2253417969s, input_fired_time: 48.1577873230, output_fired_time: 22.8314342499, propagate_forward_time: 1543.3697509766, propagate_backward_time: 2424.4172363281, weight_update_time: 0.4429413676, other_time: 33.4489746094
epoch time: 316.8237304688s, input_fired_time: 6.5630421638, output_fired_time: 0.0000000000, propagate_forward_time: 307.8861083984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3745727539
validation[          , genome  6233] predictions:    6640/  10000 (66.40%), best:    6640/10000 (66.40%), error:      9775.22656, best error:      9775.22656 on epoch:    25, epoch:   25/50, mu: 0.8636734486, learning_rate: 0.0001654171, weight_decay: 0.0000905671

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.86986
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 0.000150531
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 8.47738e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 26
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 25
read number_validation_images: 10000
read best_validation_predictions: 6640
read best_validation_error: 9775.23
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '137917688'
read generator: 137917688
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4141.8134765625s, input_fired_time: 52.5931549072266, output_fired_time: 24.8580951690674, propagate_forward_time: 1500.27392578125, propagate_backward_time: 2515.54345703125, weight_update_time: 0.404853969812393, other_time: 48.544677734375
epoch time: 342.836395263672s, input_fired_time: 4.65097808837891, output_fired_time: 0, propagate_forward_time: 334.596343994141, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.58908081054688
validation[          , genome  6233] predictions:    6559/  10000 (65.59%), best:    6640/10000 (66.40%), error:     10047.57227, best error:      9775.22656 on epoch:    25, epoch:   26/50, mu: 0.8698597550, learning_rate: 0.0001505308, weight_decay: 0.0000847738

epoch time: 3595.6103515625s, input_fired_time: 42.0246505737, output_fired_time: 17.3140449524, propagate_forward_time: 1356.6621093750, propagate_backward_time: 2144.4772949219, weight_update_time: 1.3746678829, other_time: 35.1323242188
epoch time: 217.8953094482s, input_fired_time: 1.0368502140, output_fired_time: 0.0000000000, propagate_forward_time: 211.3379364014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5205230713
validation[          , genome  6233] predictions:    6567/  10000 (65.67%), best:    6640/10000 (66.40%), error:      9929.58594, best error:      9775.22656 on epoch:    25, epoch:   27/50, mu: 0.8757430911, learning_rate: 0.0001369843, weight_decay: 0.0000793510

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.881338
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 0.000124657
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 7.42751e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 28
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 25
read number_validation_images: 10000
read best_validation_predictions: 6640
read best_validation_error: 9775.23
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '550262604'
read generator: 550262604
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.881338
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 0.000124657
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 7.42751e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 28
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 25
read number_validation_images: 10000
read best_validation_predictions: 6640
read best_validation_error: 9775.23
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '550262604'
read generator: 550262604
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3466.63525390625s, input_fired_time: 64.3900527954102, output_fired_time: 18.0027198791504, propagate_forward_time: 1273.05187988281, propagate_backward_time: 2087.53149414063, weight_update_time: 0.363339096307755, other_time: 23.658935546875
epoch time: 270.231872558594s, input_fired_time: 2.32253837585449, output_fired_time: 0, propagate_forward_time: 264.928955078125, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.98037719726563
validation[          , genome  6233] predictions:    6476/  10000 (64.76%), best:    6640/10000 (66.40%), error:     10210.08203, best error:      9775.22656 on epoch:    25, epoch:   28/50, mu: 0.8813383579, learning_rate: 0.0001246567, weight_decay: 0.0000742751

epoch time: 3413.6335449219s, input_fired_time: 47.6141662598, output_fired_time: 18.9657802582, propagate_forward_time: 1243.9725341797, propagate_backward_time: 2070.1987304688, weight_update_time: 0.3584511578, other_time: 32.8823242188
epoch time: 222.6584320068s, input_fired_time: 3.0720772743, output_fired_time: 0.0000000000, propagate_forward_time: 217.0940246582, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4923248291
validation[          , genome  6233] predictions:    6612/  10000 (66.12%), best:    6640/10000 (66.40%), error:      9823.25879, best error:      9775.22656 on epoch:    25, epoch:   29/50, mu: 0.8866596222, learning_rate: 0.0001134386, weight_decay: 0.0000695239

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.89172
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 0.00010323
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 6.50766e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 30
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 25
read number_validation_images: 10000
read best_validation_predictions: 6640
read best_validation_error: 9775.23
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '2105610199'
read generator: 2105610199
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3643.62744140625s, input_fired_time: 41.9156303405762, output_fired_time: 19.560453414917, propagate_forward_time: 1352.73315429688, propagate_backward_time: 2201.10327148438, weight_update_time: 0.373355507850647, other_time: 28.31494140625
epoch time: 255.100158691406s, input_fired_time: 1.21349024772644, output_fired_time: 0, propagate_forward_time: 247.964904785156, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.92176818847656
validation[          , genome  6233] predictions:    6635/  10000 (66.35%), best:    6640/10000 (66.40%), error:      9782.01367, best error:      9775.22656 on epoch:    25, epoch:   30/50, mu: 0.8917202950, learning_rate: 0.0001032300, weight_decay: 0.0000650766

epoch time: 3350.0656738281s, input_fired_time: 36.6595573425, output_fired_time: 19.8016242981, propagate_forward_time: 1250.2584228516, propagate_backward_time: 2023.8908691406, weight_update_time: 0.3647302389, other_time: 19.4552001953
epoch time: 259.8503417969s, input_fired_time: 7.2989859581, output_fired_time: 0.0000000000, propagate_forward_time: 242.8874053955, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.6639556885
validation[          , genome  6233] predictions:    6630/  10000 (66.30%), best:    6640/10000 (66.40%), error:      9839.53711, best error:      9775.22656 on epoch:    25, epoch:   31/50, mu: 0.8965331316, learning_rate: 0.0000939401, weight_decay: 0.0000609139

epoch time: 3408.3571777344s, input_fired_time: 42.5443458557, output_fired_time: 23.3079280853, propagate_forward_time: 1251.0220947266, propagate_backward_time: 2063.8317871094, weight_update_time: 0.3674016595, other_time: 27.6511230469
epoch time: 267.0332641602s, input_fired_time: 2.2966454029, output_fired_time: 0.0000000000, propagate_forward_time: 260.8231201172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9135131836
validation[          , genome  6233] predictions:    6693/  10000 (66.93%), best:    6693/10000 (66.93%), error:      9672.85938, best error:      9672.85938 on epoch:    32, epoch:   32/50, mu: 0.9011102915, learning_rate: 0.0000854863, weight_decay: 0.0000570173

epoch time: 2999.8256835938s, input_fired_time: 36.9490928650, output_fired_time: 17.8658771515, propagate_forward_time: 1114.4669189453, propagate_backward_time: 1808.5012207031, weight_update_time: 0.3094860911, other_time: 22.0426025391
epoch time: 219.8082580566s, input_fired_time: 2.0622386932, output_fired_time: 0.0000000000, propagate_forward_time: 214.2528228760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4931945801
validation[          , genome  6233] predictions:    6673/  10000 (66.73%), best:    6693/10000 (66.93%), error:      9758.47461, best error:      9672.85938 on epoch:    32, epoch:   33/50, mu: 0.9054632783, learning_rate: 0.0000777932, weight_decay: 0.0000533701

epoch time: 5712.8154296875s, input_fired_time: 69.3007431030, output_fired_time: 23.9556789398, propagate_forward_time: 2180.2885742188, propagate_backward_time: 3398.6853027344, weight_update_time: 0.7687941790, other_time: 40.5852050781
epoch time: 423.2519836426s, input_fired_time: 5.8056674004, output_fired_time: 0.0000000000, propagate_forward_time: 412.2285156250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2178039551
validation[          , genome  6233] predictions:    6617/  10000 (66.17%), best:    6693/10000 (66.93%), error:      9802.23828, best error:      9672.85938 on epoch:    32, epoch:   34/50, mu: 0.9096031189, learning_rate: 0.0000707924, weight_decay: 0.0000499561

epoch time: 4848.2431640625s, input_fired_time: 56.0553207397, output_fired_time: 29.5270195007, propagate_forward_time: 1829.0307617188, propagate_backward_time: 2900.2517089844, weight_update_time: 0.4734692276, other_time: 33.3786621094
epoch time: 480.2546997070s, input_fired_time: 5.3302998543, output_fired_time: 0.0000000000, propagate_forward_time: 467.3274536133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5969543457
validation[          , genome  6233] predictions:    6713/  10000 (67.13%), best:    6693/10000 (66.93%), error:      9677.19238, best error:      9672.85938 on epoch:    32, epoch:   35/50, mu: 0.9135402441, learning_rate: 0.0000644216, weight_decay: 0.0000467606

epoch time: 4424.5991210938s, input_fired_time: 53.4962730408, output_fired_time: 30.5891265869, propagate_forward_time: 1635.1269531250, propagate_backward_time: 2656.8193359375, weight_update_time: 0.4460366964, other_time: 48.5673828125
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.917285
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 5.86242e-05
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 4.37694e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 36
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 32
read number_validation_images: 10000
read best_validation_predictions: 6693
read best_validation_error: 9672.86
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '550634246'
read generator: 550634246
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3287.8076171875s, input_fired_time: 50.3209228515625, output_fired_time: 24.7723598480225, propagate_forward_time: 1226.91198730469, propagate_backward_time: 1963.69226074219, weight_update_time: 0.320344269275665, other_time: 22.110107421875
epoch time: 251.659515380859s, input_fired_time: 4.14371395111084, output_fired_time: 0, propagate_forward_time: 244.776733398438, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.73907470703125
validation[          , genome  6233] predictions:    6709/  10000 (67.09%), best:    6709/10000 (67.09%), error:      9577.47266, best error:      9577.47266 on epoch:    36, epoch:   36/50, mu: 0.9172845483, learning_rate: 0.0000586242, weight_decay: 0.0000437694

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.920846
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 5.33485e-05
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 4.09696e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 37
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6709
read best_validation_error: 9577.47
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '960769525'
read generator: 960769525
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3394.552734375s, input_fired_time: 62.0560874938965, output_fired_time: 16.0677738189697, propagate_forward_time: 1240.4423828125, propagate_backward_time: 2047.14514160156, weight_update_time: 0.346188247203827, other_time: 28.8411865234375
epoch time: 267.836853027344s, input_fired_time: 4.34559202194214, output_fired_time: 0, propagate_forward_time: 255.637924194336, propagate_backward_time: 0, weight_update_time: 0, other_time: 7.85334777832031
validation[          , genome  6233] predictions:    6678/  10000 (66.78%), best:    6709/10000 (67.09%), error:      9648.74707, best error:      9577.47266 on epoch:    36, epoch:   37/50, mu: 0.9208455086, learning_rate: 0.0000533485, weight_decay: 0.0000409696

epoch time: 3420.6286621094s, input_fired_time: 46.0827331543, output_fired_time: 20.0993843079, propagate_forward_time: 1253.2868652344, propagate_backward_time: 2075.3156738281, weight_update_time: 0.3562304378, other_time: 25.8439941406
epoch time: 261.4536437988s, input_fired_time: 3.3083057404, output_fired_time: 0.0000000000, propagate_forward_time: 251.2691192627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.8762054443
validation[          , genome  6233] predictions:    6709/  10000 (67.09%), best:    6709/10000 (67.09%), error:      9579.50098, best error:      9577.47266 on epoch:    36, epoch:   38/50, mu: 0.9242320657, learning_rate: 0.0000485475, weight_decay: 0.0000383489

epoch time: 3282.5834960938s, input_fired_time: 37.4242782593, output_fired_time: 27.7120056152, propagate_forward_time: 1217.3804931641, propagate_backward_time: 1973.6660156250, weight_update_time: 2.3663716316, other_time: 26.4007568359
epoch time: 242.4728240967s, input_fired_time: 3.1976072788, output_fired_time: 0.0000000000, propagate_forward_time: 235.6005554199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6746673584
validation[          , genome  6233] predictions:    6749/  10000 (67.49%), best:    6749/10000 (67.49%), error:      9552.55371, best error:      9552.55371 on epoch:    39, epoch:   39/50, mu: 0.9274527431, learning_rate: 0.0000441786, weight_decay: 0.0000358958

epoch time: 3066.8151855469s, input_fired_time: 48.3758201599, output_fired_time: 13.0759410858, propagate_forward_time: 1147.2772216797, propagate_backward_time: 1836.0124511719, weight_update_time: 0.3077988923, other_time: 22.0738525391
epoch time: 220.1049194336s, input_fired_time: 1.0544985533, output_fired_time: 0.0000000000, propagate_forward_time: 214.5132446289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5371704102
validation[          , genome  6233] predictions:    6739/  10000 (67.39%), best:    6749/10000 (67.49%), error:      9639.81836, best error:      9552.55371 on epoch:    39, epoch:   40/50, mu: 0.9305157065, learning_rate: 0.0000402029, weight_decay: 0.0000335996

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.933429
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 3.6585e-05
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 3.14503e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 41
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 39
read number_validation_images: 10000
read best_validation_predictions: 6749
read best_validation_error: 9552.55
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '1396830256'
read generator: 1396830256
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3270.53100585938s, input_fired_time: 48.313533782959, output_fired_time: 22.4470443725586, propagate_forward_time: 1231.72424316406, propagate_backward_time: 1948.0576171875, weight_update_time: 0.333494484424591, other_time: 19.9886474609375
epoch time: 244.637115478516s, input_fired_time: 3.17958068847656, output_fired_time: 0, propagate_forward_time: 235.747787475586, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.70974731445313
validation[          , genome  6233] predictions:    6739/  10000 (67.39%), best:    6739/10000 (67.39%), error:      9497.30664, best error:      9497.30664 on epoch:    41, epoch:   41/50, mu: 0.9334287047, learning_rate: 0.0000365850, weight_decay: 0.0000314503

epoch time: 3276.6655273438s, input_fired_time: 52.0567970276, output_fired_time: 29.7482547760, propagate_forward_time: 1204.0649414063, propagate_backward_time: 1956.7470703125, weight_update_time: 0.3209502399, other_time: 34.0483398438
epoch time: 250.7210083008s, input_fired_time: 1.2367476225, output_fired_time: 0.0000000000, propagate_forward_time: 247.7451171875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7391510010
validation[          , genome  6233] predictions:    6734/  10000 (67.34%), best:    6739/10000 (67.39%), error:      9531.63086, best error:      9497.30664 on epoch:    41, epoch:   42/50, mu: 0.9361990690, learning_rate: 0.0000332926, weight_decay: 0.0000294385

epoch time: 3295.4394531250s, input_fired_time: 51.3580245972, output_fired_time: 13.8043231964, propagate_forward_time: 1204.7373046875, propagate_backward_time: 1995.2154541016, weight_update_time: 1.3481885195, other_time: 30.3243408203
epoch time: 249.7685699463s, input_fired_time: 2.2148697376, output_fired_time: 0.0000000000, propagate_forward_time: 238.9095306396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.6441650391
validation[          , genome  6233] predictions:    6781/  10000 (67.81%), best:    6781/10000 (67.81%), error:      9464.43262, best error:      9464.43262 on epoch:    43, epoch:   43/50, mu: 0.9388337135, learning_rate: 0.0000302965, weight_decay: 0.0000275554

epoch time: 3379.4792480469s, input_fired_time: 46.0895500183, output_fired_time: 28.8894462585, propagate_forward_time: 1263.1934814453, propagate_backward_time: 2009.5574951172, weight_update_time: 1.3583229780, other_time: 31.7492675781
epoch time: 253.5065612793s, input_fired_time: 4.2484407425, output_fired_time: 0.0000000000, propagate_forward_time: 243.4652557373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.7928619385
validation[          , genome  6233] predictions:    6775/  10000 (67.75%), best:    6775/10000 (67.75%), error:      9456.14648, best error:      9456.14648 on epoch:    44, epoch:   44/50, mu: 0.9413393736, learning_rate: 0.0000275701, weight_decay: 0.0000257928

epoch time: 3004.1997070313s, input_fired_time: 37.9900741577, output_fired_time: 16.9941291809, propagate_forward_time: 1086.3609619141, propagate_backward_time: 1836.4797363281, weight_update_time: 0.3079695106, other_time: 26.3748779297
epoch time: 185.1902465820s, input_fired_time: 1.9478240013, output_fired_time: 0.0000000000, propagate_forward_time: 180.8683624268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3740539551
validation[          , genome  6233] predictions:    6728/  10000 (67.28%), best:    6775/10000 (67.75%), error:      9490.78613, best error:      9456.14648 on epoch:    44, epoch:   45/50, mu: 0.9437223077, learning_rate: 0.0000250890, weight_decay: 0.0000241429

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_179_6233_1_r1730022545_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.546751
read mu: 0.945989
read mu_delta: 0.951029
read initial_learning_rate: 0.00174764
read learning_rate: 2.28312e-05
read learning_rate_delta: 0.910008
read initial_weight_decay: 0.000472822
read weight_decay: 2.25985e-05
read weight_decay_delta: 0.936032
read batch_size: 118
read epsilon: 1e-07
read alpha: 0.0927476
read input_dropout_probability: 0.00120921
read hidden_dropout_probability: 0.105551
read velocity_reset: 1601
read epoch: 46
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 44
read number_validation_images: 10000
read best_validation_predictions: 6775
read best_validation_error: 9456.15
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6233
read normal distribution: '1 0 0'
generator_str: '304751489'
read generator: 304751489
read generated_by_map:
1 enable_edge 1
reading 90 nodes.
reading 468 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3241.63134765625s, input_fired_time: 49.3924522399902, output_fired_time: 17.4054889678955, propagate_forward_time: 1134.70422363281, propagate_backward_time: 2006.896484375, weight_update_time: 0.336848646402359, other_time: 33.2327880859375
epoch time: 246.864517211914s, input_fired_time: 3.27110719680786, output_fired_time: 0, propagate_forward_time: 238.725982666016, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.867431640625
validation[          , genome  6233] predictions:    6736/  10000 (67.36%), best:    6775/10000 (67.75%), error:      9530.08496, best error:      9456.14648 on epoch:    44, epoch:   46/50, mu: 0.9459885359, learning_rate: 0.0000228312, weight_decay: 0.0000225985

epoch time: 3239.7797851563s, input_fired_time: 44.6170158386, output_fired_time: 17.5488891602, propagate_forward_time: 1163.3026123047, propagate_backward_time: 1987.0034179688, weight_update_time: 0.3394416571, other_time: 27.3079833984
epoch time: 240.4715881348s, input_fired_time: 1.2187073231, output_fired_time: 0.0000000000, propagate_forward_time: 236.5557098389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6971740723
validation[          , genome  6233] predictions:    6743/  10000 (67.43%), best:    6775/10000 (67.75%), error:      9466.18652, best error:      9456.14648 on epoch:    44, epoch:   47/50, mu: 0.9481438398, learning_rate: 0.0000207765, weight_decay: 0.0000211529

epoch time: 3266.4802246094s, input_fired_time: 45.4805679321, output_fired_time: 21.6534996033, propagate_forward_time: 1153.6994628906, propagate_backward_time: 2027.6140136719, weight_update_time: 2.3521361351, other_time: 18.0327148438
epoch time: 240.5088806152s, input_fired_time: 4.2122068405, output_fired_time: 0.0000000000, propagate_forward_time: 225.5520324707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.7446441650
validation[          , genome  6233] predictions:    6785/  10000 (67.85%), best:    6785/10000 (67.85%), error:      9407.56836, best error:      9407.56836 on epoch:    48, epoch:   48/50, mu: 0.9501935840, learning_rate: 0.0000189068, weight_decay: 0.0000197998

epoch time: 3222.6342773438s, input_fired_time: 41.5346298218, output_fired_time: 10.4304876328, propagate_forward_time: 1176.8762207031, propagate_backward_time: 1971.8189697266, weight_update_time: 0.3280167282, other_time: 21.9739990234
epoch time: 239.6246185303s, input_fired_time: 3.2127282619, output_fired_time: 0.0000000000, propagate_forward_time: 231.6993408203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7125549316
validation[          , genome  6233] predictions:    6798/  10000 (67.98%), best:    6785/10000 (67.85%), error:      9451.22559, best error:      9407.56836 on epoch:    48, epoch:   49/50, mu: 0.9521429539, learning_rate: 0.0000172054, weight_decay: 0.0000185333

epoch time: 3286.0659179688s, input_fired_time: 52.9939956665, output_fired_time: 21.8338508606, propagate_forward_time: 1175.4229736328, propagate_backward_time: 2012.3448486328, weight_update_time: 0.3578126729, other_time: 23.4704589844
epoch time: 225.6661529541s, input_fired_time: 3.1893181801, output_fired_time: 0.0000000000, propagate_forward_time: 218.7283935547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7484436035
validation[          , genome  6233] predictions:    6755/  10000 (67.55%), best:    6785/10000 (67.85%), error:      9457.30371, best error:      9407.56836 on epoch:    48, epoch:   50/50, mu: 0.9539968371, learning_rate: 0.0000156570, weight_decay: 0.0000173478

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1148.5399169922s, input_fired_time: 27.0055484772, output_fired_time: 0.0000000000, propagate_forward_time: 1096.5986328125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 24.9357910156
best training[          , genome  6233] predictions:   36517/  50000 (73.03%), best:    6785/10000 (67.85%), error:     40699.27344, best error:      9407.56836 on epoch:    48, epoch:   51/50, mu: 0.9557599425, learning_rate: 0.0000142480, weight_decay: 0.0000162381
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 227.0155639648s, input_fired_time: 3.2447133064, output_fired_time: 0.0000000000, propagate_forward_time: 221.1126556396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6581878662
   testing[          , genome  6233] predictions:    6785/  10000 (67.85%), best:    6785/10000 (67.85%), error:      9407.56836, best error:      9407.56836 on epoch:    48, epoch:   51/50, mu: 0.9557599425, learning_rate: 0.0000142480, weight_decay: 0.0000162381
backpropagation finished successfully!
13:44:08 (4548): called boinc_finish(0)

</stderr_txt>
]]>