Nameexact_genome_1542531604_189_6240_1
Workunit4097055
Created18 Nov 2018, 10:40:38 UTC
Sent18 Nov 2018, 10:55:06 UTC
Report deadline11 Feb 2019, 5:22:26 UTC
Received5 Jan 2019, 12:00:57 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID92991
Run time1 days 7 hours 34 min 37 sec
CPU time1 days 7 hours 34 min 37 sec
Validate stateValid
Credit21,192.25
Device peak FLOPS3.09 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size540.07 MB
Peak swap size559.87 MB
Peak disk usage11.05 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
d mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 7.06152e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.98872e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 93
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 88
read number_validation_images: 10000
read best_validation_predictions: 6461
read best_validation_error: 10242.2
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '1063911378'
read generator: 1063911378
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2427.70043945313s, input_fired_time: 44.3438262939453, output_fired_time: 7.95300579071045, propagate_forward_time: 910.966369628906, propagate_backward_time: 1440.60083007813, weight_update_time: 0.296610444784164, other_time: 23.83642578125
epoch time: 187.746673583984s, input_fired_time: 2.2507483959198, output_fired_time: 0, propagate_forward_time: 183.861114501953, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.63481140136719
validation[          , genome  6240] predictions:    6446/  10000 (64.46%), best:    6446/10000 (64.46%), error:     10206.60840, best error:     10206.60840 on epoch:    93, epoch:   93/100, mu: 0.9873375893, learning_rate: 0.0000070615, weight_decay: 0.0000039887

epoch time: 2503.4997558594s, input_fired_time: 39.0203552246, output_fired_time: 12.6927127838, propagate_forward_time: 880.9509887695, propagate_backward_time: 1544.9711914063, weight_update_time: 0.3130074441, other_time: 25.8647460938
epoch time: 200.2334136963s, input_fired_time: 5.4927649498, output_fired_time: 0.0000000000, propagate_forward_time: 191.4471893311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2934570313
validation[          , genome  6240] predictions:    6487/  10000 (64.87%), best:    6446/10000 (64.46%), error:     10237.81055, best error:     10206.60840 on epoch:    93, epoch:   94/100, mu: 0.9874841571, learning_rate: 0.0000066572, weight_decay: 0.0000037926

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.987623
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 6.27603e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.60621e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 95
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 93
read number_validation_images: 10000
read best_validation_predictions: 6446
read best_validation_error: 10206.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '307126169'
read generator: 307126169
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2599.75073242188s, input_fired_time: 31.3295383453369, output_fired_time: 10.0015897750854, propagate_forward_time: 995.980773925781, propagate_backward_time: 1542.54089355469, weight_update_time: 0.319042235612869, other_time: 19.8978271484375
epoch time: 209.515197753906s, input_fired_time: 2.42079997062683, output_fired_time: 0, propagate_forward_time: 203.75749206543, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.33689880371094
validation[          , genome  6240] predictions:    6489/  10000 (64.89%), best:    6446/10000 (64.46%), error:     10211.56348, best error:     10206.60840 on epoch:    93, epoch:   95/100, mu: 0.9876226187, learning_rate: 0.0000062760, weight_decay: 0.0000036062

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.987753
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 5.91668e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.42894e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 96
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 93
read number_validation_images: 10000
read best_validation_predictions: 6446
read best_validation_error: 10206.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '818954010'
read generator: 818954010
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2455.48291015625s, input_fired_time: 24.7025012969971, output_fired_time: 14.44553565979, propagate_forward_time: 911.873596191406, propagate_backward_time: 1474.01477050781, weight_update_time: 0.317216515541077, other_time: 30.4466552734375
epoch time: 190.359512329102s, input_fired_time: 0.857273757457733, output_fired_time: 0, propagate_forward_time: 186.205902099609, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.29634094238281
validation[          , genome  6240] predictions:    6463/  10000 (64.63%), best:    6446/10000 (64.46%), error:     10246.16797, best error:     10206.60840 on epoch:    93, epoch:   96/100, mu: 0.9877534509, learning_rate: 0.0000059167, weight_decay: 0.0000034289

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.987877
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 5.57792e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.26039e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 97
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 93
read number_validation_images: 10000
read best_validation_predictions: 6446
read best_validation_error: 10206.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '2134111123'
read generator: 2134111123
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.987877
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 5.57792e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.26039e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 97
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 93
read number_validation_images: 10000
read best_validation_predictions: 6446
read best_validation_error: 10206.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '2134111123'
read generator: 2134111123
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.987877
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 5.57792e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.26039e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 97
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 93
read number_validation_images: 10000
read best_validation_predictions: 6446
read best_validation_error: 10206.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '2134111123'
read generator: 2134111123
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3139.57421875s, input_fired_time: 42.3128776550293, output_fired_time: 12.5695886611938, propagate_forward_time: 1187.712890625, propagate_backward_time: 1869.6884765625, weight_update_time: 0.354764968156815, other_time: 27.290283203125
epoch time: 195.313262939453s, input_fired_time: 2.3738374710083, output_fired_time: 0, propagate_forward_time: 188.025375366211, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.91404724121094
validation[          , genome  6240] predictions:    6472/  10000 (64.72%), best:    6472/10000 (64.72%), error:     10200.19043, best error:     10200.19043 on epoch:    97, epoch:   97/100, mu: 0.9878771305, learning_rate: 0.0000055779, weight_decay: 0.0000032604

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.987994
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 5.25854e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 3.10012e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 98
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 97
read number_validation_images: 10000
read best_validation_predictions: 6472
read best_validation_error: 10200.2
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '558538773'
read generator: 558538773
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2570.056640625s, input_fired_time: 31.799259185791, output_fired_time: 12.9049663543701, propagate_forward_time: 970.776184082031, propagate_backward_time: 1529.93054199219, weight_update_time: 0.321630507707596, other_time: 24.6456298828125
epoch time: 200.780700683594s, input_fired_time: 0.894011378288269, output_fired_time: 0, propagate_forward_time: 196.543838500977, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.34284973144531
validation[          , genome  6240] predictions:    6518/  10000 (65.18%), best:    6472/10000 (64.72%), error:     10220.39844, best error:     10200.19043 on epoch:    97, epoch:   98/100, mu: 0.9879939556, learning_rate: 0.0000052585, weight_decay: 0.0000031001

epoch time: 2510.1201171875s, input_fired_time: 32.2451896667, output_fired_time: 9.7712688446, propagate_forward_time: 951.8550415039, propagate_backward_time: 1485.7932128906, weight_update_time: 0.3213872313, other_time: 30.4555664063
epoch time: 215.3743133545s, input_fired_time: 3.9886438847, output_fired_time: 0.0000000000, propagate_forward_time: 206.1500396729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2356262207
validation[          , genome  6240] predictions:    6473/  10000 (64.73%), best:    6473/10000 (64.73%), error:     10187.95410, best error:     10187.95410 on epoch:    99, epoch:   99/100, mu: 0.9881044030, learning_rate: 0.0000049575, weight_decay: 0.0000029477

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.988209
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 4.67361e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 2.80283e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 100
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 99
read number_validation_images: 10000
read best_validation_predictions: 6473
read best_validation_error: 10188
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '883105479'
read generator: 883105479
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.988209
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 4.67361e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 2.80283e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 100
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 99
read number_validation_images: 10000
read best_validation_predictions: 6473
read best_validation_error: 10188
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '883105479'
read generator: 883105479
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.988209
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 4.67361e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 2.80283e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 100
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 99
read number_validation_images: 10000
read best_validation_predictions: 6473
read best_validation_error: 10188
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '883105479'
read generator: 883105479
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.988209
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 4.67361e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 2.80283e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 100
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 99
read number_validation_images: 10000
read best_validation_predictions: 6473
read best_validation_error: 10188
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '883105479'
read generator: 883105479
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2603.0703125s, input_fired_time: 32.9324684143066, output_fired_time: 20.3689632415771, propagate_forward_time: 996.9501953125, propagate_backward_time: 1525.28491210938, weight_update_time: 0.321667939424515, other_time: 27.533935546875
epoch time: 213.232284545898s, input_fired_time: 2.45935082435608, output_fired_time: 0, propagate_forward_time: 202.744812011719, propagate_backward_time: 0, weight_update_time: 0, other_time: 8.02812194824219
validation[          , genome  6240] predictions:    6486/  10000 (64.86%), best:    6473/10000 (64.73%), error:     10193.64258, best error:     10187.95410 on epoch:    99, epoch:  100/100, mu: 0.9882087708, learning_rate: 0.0000046736, weight_decay: 0.0000028028

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1011.2063598633s, input_fired_time: 10.4854860306, output_fired_time: 0.0000000000, propagate_forward_time: 985.4752807617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.2456054688
best training[          , genome  6240] predictions:   36219/  50000 (72.44%), best:    6473/10000 (64.73%), error:     42233.33984, best error:     10187.95410 on epoch:    99, epoch:  101/100, mu: 0.9883073568, learning_rate: 0.0000044060, weight_decay: 0.0000026651
evaluating best weights on test data.
evaluting test set with running mean/variance:
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_189_6240_1_r1202366245_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.474799
read mu: 0.988307
read mu_delta: 0.944956
read initial_learning_rate: 0.00169942
read learning_rate: 4.40602e-06
read learning_rate_delta: 0.942743
read initial_weight_decay: 0.000433209
read weight_decay: 2.66505e-06
read weight_decay_delta: 0.950843
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0979101
read input_dropout_probability: 0.00154
read hidden_dropout_probability: 0.107722
read velocity_reset: 1577
read epoch: 101
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 99
read number_validation_images: 10000
read best_validation_predictions: 6473
read best_validation_error: 10188
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6240
read normal distribution: '1 0.0713836550712585 2.42767477035522'
generator_str: '910444595'
read generator: 910444595
read generated_by_map:
1 add_edge 1
reading 73 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2539.00268554688s, input_fired_time: 32.713752746582, output_fired_time: 13.4368867874146, propagate_forward_time: 928.776062011719, propagate_backward_time: 1534.25134277344, weight_update_time: 3.33164215087891, other_time: 29.8245849609375
epoch time: 189.62516784668s, input_fired_time: 7.08144807815552, output_fired_time: 0, propagate_forward_time: 177.729476928711, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.81423950195313
validation[          , genome  6240] predictions:    6479/  10000 (64.79%), best:    6479/10000 (64.79%), error:     10170.66016, best error:     10170.66016 on epoch:   101, epoch:  101/100, mu: 0.9883073568, learning_rate: 0.0000044060, weight_decay: 0.0000026651

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 942.9265136719s, input_fired_time: 5.7573928833, output_fired_time: 0.0000000000, propagate_forward_time: 923.9413452148, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.2277832031
best training[          , genome  6240] predictions:   36154/  50000 (72.31%), best:    6479/10000 (64.79%), error:     42178.34375, best error:     10170.66016 on epoch:   101, epoch:  102/100, mu: 0.9884005189, learning_rate: 0.0000041537, weight_decay: 0.0000025340
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 188.2586975098s, input_fired_time: 2.3706643581, output_fired_time: 0.0000000000, propagate_forward_time: 182.5178527832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3701782227
   testing[          , genome  6240] predictions:    6479/  10000 (64.79%), best:    6479/10000 (64.79%), error:     10170.66016, best error:     10170.66016 on epoch:   101, epoch:  102/100, mu: 0.9884005189, learning_rate: 0.0000041537, weight_decay: 0.0000025340
backpropagation finished successfully!
12:59:11 (14968): called boinc_finish(0)

</stderr_txt>
]]>