Nameexact_genome_1542334203_173_6031_1
Workunit4092027
Created16 Nov 2018, 3:28:41 UTC
Sent16 Nov 2018, 3:45:09 UTC
Report deadline19 Dec 2018, 0:54:20 UTC
Received24 Nov 2018, 2:31:07 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID84732
Run time10 hours 4 min 48 sec
CPU time9 hours 32 min 58 sec
Validate stateValid
Credit8,220.35
Device peak FLOPS4.03 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size586.96 MB
Peak swap size606.69 MB
Peak disk usage12.74 MB

Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.586157
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000699994
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 0.000255758
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 3
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 2
read number_validation_images: 10000
read best_validation_predictions: 5967
read best_validation_error: 11616.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '176449066'
read generator: 176449066
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3335.33251953125s, input_fired_time: 44.701545715332, output_fired_time: 20.6863346099854, propagate_forward_time: 964.423828125, propagate_backward_time: 2269.34985351563, weight_update_time: 0.259150475263596, other_time: 36.1708984375
epoch time: 192.930999755859s, input_fired_time: 5.73139429092407, output_fired_time: 0, propagate_forward_time: 182.167495727539, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.0321044921875
validation[          , genome  6031] predictions:    5970/  10000 (59.70%), best:    5970/10000 (59.70%), error:     11587.33398, best error:     11587.33398 on epoch:     3, epoch:    3/25, mu: 0.5861567259, learning_rate: 0.0006999936, weight_decay: 0.0002557583

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.598343
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000641383
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 0.000234242
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 4
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 3
read number_validation_images: 10000
read best_validation_predictions: 5970
read best_validation_error: 11587.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '322392440'
read generator: 322392440
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3265.14819335938s, input_fired_time: 44.165397644043, output_fired_time: 15.5271444320679, propagate_forward_time: 922.697692871094, propagate_backward_time: 2259.30639648438, weight_update_time: 0.246248990297318, other_time: 23.45166015625
epoch time: 188.880477905273s, input_fired_time: 4.27557420730591, output_fired_time: 0, propagate_forward_time: 179.500869750977, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.10403442382813
validation[          , genome  6031] predictions:    6005/  10000 (60.05%), best:    6005/10000 (60.05%), error:     11339.94434, best error:     11339.94434 on epoch:     4, epoch:    4/25, mu: 0.5983425379, learning_rate: 0.0006413828, weight_decay: 0.0002342416

epoch time: 3157.2265625000s, input_fired_time: 52.1176261902, output_fired_time: 15.7593507767, propagate_forward_time: 897.7429809570, propagate_backward_time: 2163.8037109375, weight_update_time: 0.2648373544, other_time: 27.8029785156
epoch time: 182.4479827881s, input_fired_time: 2.5059354305, output_fired_time: 0.0000000000, propagate_forward_time: 176.5890197754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3530273438
validation[          , genome  6031] predictions:    5585/  10000 (55.85%), best:    6005/10000 (60.05%), error:     13152.97266, best error:     11339.94434 on epoch:     4, epoch:    5/25, mu: 0.6101606488, learning_rate: 0.0005876794, weight_decay: 0.0002145350

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.621622
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000538473
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 0.000196486
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 6
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 4
read number_validation_images: 10000
read best_validation_predictions: 6005
read best_validation_error: 11339.9
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '147126747'
read generator: 147126747
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3072.21533203125s, input_fired_time: 40.6273193359375, output_fired_time: 22.7810249328613, propagate_forward_time: 885.949951171875, propagate_backward_time: 2097.4453125, weight_update_time: 0.224373981356621, other_time: 25.41162109375
epoch time: 184.333374023438s, input_fired_time: 4.13217926025391, output_fired_time: 0, propagate_forward_time: 175.38395690918, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.81724548339844
validation[          , genome  6031] predictions:    5971/  10000 (59.71%), best:    6005/10000 (60.05%), error:     11414.59863, best error:     11339.94434 on epoch:     4, epoch:    6/25, mu: 0.6216221452, learning_rate: 0.0005384727, weight_decay: 0.0001964864

epoch time: 3261.3276367188s, input_fired_time: 44.4468574524, output_fired_time: 21.8204040527, propagate_forward_time: 918.0907592773, propagate_backward_time: 2242.7932128906, weight_update_time: 0.2509401441, other_time: 34.1765136719
epoch time: 202.8346099854s, input_fired_time: 1.2686245441, output_fired_time: 0.0000000000, propagate_forward_time: 196.4354705811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1305084229
validation[          , genome  6031] predictions:    6068/  10000 (60.68%), best:    6005/10000 (60.05%), error:     11353.63086, best error:     11339.94434 on epoch:     4, epoch:    7/25, mu: 0.6327378154, learning_rate: 0.0004933861, weight_decay: 0.0001799562

epoch time: 3489.8469238281s, input_fired_time: 48.3466453552, output_fired_time: 18.8809776306, propagate_forward_time: 940.5062255859, propagate_backward_time: 2283.0964355469, weight_update_time: 0.2655715346, other_time: 199.0168457031
epoch time: 192.1004791260s, input_fired_time: 5.6356759071, output_fired_time: 0.0000000000, propagate_forward_time: 176.7986907959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.6661071777
validation[          , genome  6031] predictions:    6019/  10000 (60.19%), best:    6019/10000 (60.19%), error:     11337.33301, best error:     11337.33301 on epoch:     8, epoch:    8/25, mu: 0.6435180902, learning_rate: 0.0004520746, weight_decay: 0.0001648166

epoch time: 3239.2883300781s, input_fired_time: 47.2680969238, output_fired_time: 15.5963811874, propagate_forward_time: 934.6245727539, propagate_backward_time: 2166.8972167969, weight_update_time: 1.7400494814, other_time: 74.9020996094
epoch time: 182.1035156250s, input_fired_time: 1.0594308376, output_fired_time: 0.0000000000, propagate_forward_time: 179.3747711182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6693115234
validation[          , genome  6031] predictions:    6146/  10000 (61.46%), best:    6146/10000 (61.46%), error:     10988.82324, best error:     10988.82324 on epoch:     9, epoch:    9/25, mu: 0.6539730430, learning_rate: 0.0004142221, weight_decay: 0.0001509508

epoch time: 3318.9191894531s, input_fired_time: 50.3522605896, output_fired_time: 16.8872795105, propagate_forward_time: 879.6450805664, propagate_backward_time: 2125.8918457031, weight_update_time: 0.2227011770, other_time: 246.1428222656
epoch time: 198.5464782715s, input_fired_time: 1.2705824375, output_fired_time: 0.0000000000, propagate_forward_time: 193.6542663574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6216278076
validation[          , genome  6031] predictions:    6169/  10000 (61.69%), best:    6146/10000 (61.46%), error:     11079.69434, best error:     10988.82324 on epoch:     9, epoch:   10/25, mu: 0.6641125083, learning_rate: 0.0003795390, weight_decay: 0.0001382514

epoch time: 3193.5378417969s, input_fired_time: 56.0092010498, output_fired_time: 14.0146474838, propagate_forward_time: 876.0870971680, propagate_backward_time: 2211.8305664063, weight_update_time: 0.2384314537, other_time: 35.5961914063
epoch time: 192.6487884521s, input_fired_time: 1.2137862444, output_fired_time: 0.0000000000, propagate_forward_time: 186.3958129883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0391845703
validation[          , genome  6031] predictions:    6147/  10000 (61.47%), best:    6146/10000 (61.46%), error:     11042.71582, best error:     10988.82324 on epoch:     9, epoch:   11/25, mu: 0.6739460230, learning_rate: 0.0003477600, weight_decay: 0.0001266204

epoch time: 3190.2529296875s, input_fired_time: 52.8721313477, output_fired_time: 18.6969394684, propagate_forward_time: 898.1163940430, propagate_backward_time: 2187.9592285156, weight_update_time: 0.2302092910, other_time: 32.6081542969
epoch time: 182.9629211426s, input_fired_time: 2.6516194344, output_fired_time: 0.0000000000, propagate_forward_time: 178.4859771729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8253173828
validation[          , genome  6031] predictions:    6200/  10000 (62.00%), best:    6200/10000 (62.00%), error:     10879.47656, best error:     10879.47656 on epoch:    12, epoch:   12/25, mu: 0.6834828258, learning_rate: 0.0003186419, weight_decay: 0.0001159680

epoch time: 3051.8027343750s, input_fired_time: 40.0512886047, output_fired_time: 16.5475997925, propagate_forward_time: 884.8516235352, propagate_backward_time: 2079.8259277344, weight_update_time: 0.2201948762, other_time: 30.5263671875
epoch time: 164.3645477295s, input_fired_time: 2.5385365486, output_fired_time: 0.0000000000, propagate_forward_time: 157.3516845703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4743194580
validation[          , genome  6031] predictions:    6266/  10000 (62.66%), best:    6266/10000 (62.66%), error:     10763.26172, best error:     10763.26172 on epoch:    13, epoch:   13/25, mu: 0.6927318573, learning_rate: 0.0002919618, weight_decay: 0.0001062117

epoch time: 3083.6967773438s, input_fired_time: 46.6531524658, output_fired_time: 17.0123729706, propagate_forward_time: 891.1849975586, propagate_backward_time: 2107.7145996094, weight_update_time: 0.2353527546, other_time: 21.1315917969
epoch time: 182.5748748779s, input_fired_time: 4.1179761887, output_fired_time: 0.0000000000, propagate_forward_time: 176.7420806885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7148132324
validation[          , genome  6031] predictions:    6191/  10000 (61.91%), best:    6266/10000 (62.66%), error:     10919.72168, best error:     10763.26172 on epoch:    13, epoch:   14/25, mu: 0.7017018199, learning_rate: 0.0002675157, weight_decay: 0.0000972762

epoch time: 3031.4360351563s, input_fired_time: 45.4509010315, output_fired_time: 10.6984710693, propagate_forward_time: 864.0595703125, propagate_backward_time: 2077.0788574219, weight_update_time: 0.2158479542, other_time: 34.1481933594
epoch time: 175.0899810791s, input_fired_time: 4.1072578430, output_fired_time: 0.0000000000, propagate_forward_time: 167.7627868652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2199401855
validation[          , genome  6031] predictions:    6267/  10000 (62.67%), best:    6267/10000 (62.67%), error:     10725.98047, best error:     10725.98047 on epoch:    15, epoch:   15/25, mu: 0.7104011178, learning_rate: 0.0002451164, weight_decay: 0.0000890924

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.718838
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000224593
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 8.15972e-05
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 16
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 15
read number_validation_images: 10000
read best_validation_predictions: 6267
read best_validation_error: 10726
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '821197511'
read generator: 821197511
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3011.17065429688s, input_fired_time: 45.7655334472656, output_fired_time: 13.5378370285034, propagate_forward_time: 865.272399902344, propagate_backward_time: 2057.82202148438, weight_update_time: 0.21658881008625, other_time: 28.772705078125
epoch time: 189.474685668945s, input_fired_time: 5.68779373168945, output_fired_time: 0, propagate_forward_time: 181.889587402344, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.89730834960938
validation[          , genome  6031] predictions:    6174/  10000 (61.74%), best:    6267/10000 (62.67%), error:     11074.97070, best error:     10725.98047 on epoch:    15, epoch:   16/25, mu: 0.7188379169, learning_rate: 0.0002245927, weight_decay: 0.0000815972

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.72702
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000205787
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 7.47325e-05
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 17
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 15
read number_validation_images: 10000
read best_validation_predictions: 6267
read best_validation_error: 10726
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '1626681623'
read generator: 1626681623
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3098.36059570313s, input_fired_time: 48.8758430480957, output_fired_time: 22.6235408782959, propagate_forward_time: 830.64208984375, propagate_backward_time: 2101.76977539063, weight_update_time: 0.213547810912132, other_time: 94.449462890625
epoch time: 182.282455444336s, input_fired_time: 3.99365472793579, output_fired_time: 0, propagate_forward_time: 168.84196472168, propagate_backward_time: 0, weight_update_time: 0, other_time: 9.44683837890625
validation[          , genome  6031] predictions:    6175/  10000 (61.75%), best:    6267/10000 (62.67%), error:     10918.63281, best error:     10725.98047 on epoch:    15, epoch:   17/25, mu: 0.7270201445, learning_rate: 0.0002057874, weight_decay: 0.0000747325

epoch time: 3033.5476074219s, input_fired_time: 40.9859352112, output_fired_time: 22.5549335480, propagate_forward_time: 841.6149291992, propagate_backward_time: 2103.1892089844, weight_update_time: 0.2119152546, other_time: 25.2026367188
epoch time: 174.5668640137s, input_fired_time: 2.5792689323, output_fired_time: 0.0000000000, propagate_forward_time: 164.4180450439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5695495605
validation[          , genome  6031] predictions:    6275/  10000 (62.75%), best:    6267/10000 (62.67%), error:     10727.61230, best error:     10725.98047 on epoch:    15, epoch:   18/25, mu: 0.7349554300, learning_rate: 0.0001885567, weight_decay: 0.0000684453

epoch time: 3165.7456054688s, input_fired_time: 45.8512077332, output_fired_time: 22.8982429504, propagate_forward_time: 903.5051879883, propagate_backward_time: 2166.7656250000, weight_update_time: 0.2205928415, other_time: 26.7253417969
epoch time: 200.0938110352s, input_fired_time: 2.8357391357, output_fired_time: 0.0000000000, propagate_forward_time: 192.0217437744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2363281250
validation[          , genome  6031] predictions:    6292/  10000 (62.92%), best:    6292/10000 (62.92%), error:     10695.83691, best error:     10695.83691 on epoch:    19, epoch:   19/25, mu: 0.7426512837, learning_rate: 0.0001727687, weight_decay: 0.0000626871

epoch time: 3412.5568847656s, input_fired_time: 46.1002311707, output_fired_time: 20.7128791809, propagate_forward_time: 943.8089599609, propagate_backward_time: 2266.2250976563, weight_update_time: 0.2436403334, other_time: 135.7094726563
epoch time: 235.5550842285s, input_fired_time: 7.2065629959, output_fired_time: 0.0000000000, propagate_forward_time: 185.0053558350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 43.3431701660
validation[          , genome  6031] predictions:    6344/  10000 (63.44%), best:    6344/10000 (63.44%), error:     10519.25000, best error:     10519.25000 on epoch:    20, epoch:   20/25, mu: 0.7501149178, learning_rate: 0.0001583027, weight_decay: 0.0000574133

epoch time: 3244.8911132813s, input_fired_time: 30.2318363190, output_fired_time: 9.3887634277, propagate_forward_time: 947.0842285156, propagate_backward_time: 2235.3601074219, weight_update_time: 0.2368424088, other_time: 22.8261718750
epoch time: 198.4006958008s, input_fired_time: 2.8060731888, output_fired_time: 0.0000000000, propagate_forward_time: 185.9181365967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.6764831543
validation[          , genome  6031] predictions:    6276/  10000 (62.76%), best:    6344/10000 (63.44%), error:     10750.65137, best error:     10519.25000 on epoch:    20, epoch:   21/25, mu: 0.7573533654, learning_rate: 0.0001450479, weight_decay: 0.0000525831

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.764373
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000132903
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 4.81594e-05
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 22
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 20
read number_validation_images: 10000
read best_validation_predictions: 6344
read best_validation_error: 10519.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '1004201941'
read generator: 1004201941
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3164.08227539063s, input_fired_time: 39.1925277709961, output_fired_time: 10.9309062957764, propagate_forward_time: 910.194213867188, propagate_backward_time: 2167.29077148438, weight_update_time: 0.225213453173637, other_time: 36.473876953125
epoch time: 184.867462158203s, input_fired_time: 4.18543815612793, output_fired_time: 0, propagate_forward_time: 177.428726196289, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.2532958984375
validation[          , genome  6031] predictions:    6393/  10000 (63.93%), best:    6393/10000 (63.93%), error:     10428.99414, best error:     10428.99414 on epoch:    22, epoch:   22/25, mu: 0.7643733621, learning_rate: 0.0001329030, weight_decay: 0.0000481594

epoch time: 3021.7504882813s, input_fired_time: 44.3985862732, output_fired_time: 15.1801471710, propagate_forward_time: 880.2541503906, propagate_backward_time: 2062.0336914063, weight_update_time: 0.2097206563, other_time: 19.8837890625
epoch time: 185.1358795166s, input_fired_time: 2.6539101601, output_fired_time: 0.0000000000, propagate_forward_time: 179.1825561523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2994079590
validation[          , genome  6031] predictions:    6285/  10000 (62.85%), best:    6393/10000 (63.93%), error:     10756.89160, best error:     10428.99414 on epoch:    22, epoch:   23/25, mu: 0.7711815834, learning_rate: 0.0001217749, weight_decay: 0.0000441077

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.777784
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000111579
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 4.0397e-05
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 24
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 22
read number_validation_images: 10000
read best_validation_predictions: 6393
read best_validation_error: 10429
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '1958350844'
read generator: 1958350844
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.777784
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000111579
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 4.0397e-05
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 24
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 22
read number_validation_images: 10000
read best_validation_predictions: 6393
read best_validation_error: 10429
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '1958350844'
read generator: 1958350844
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3102.7529296875s, input_fired_time: 43.0962829589844, output_fired_time: 13.5026178359985, propagate_forward_time: 883.054931640625, propagate_backward_time: 2142.31591796875, weight_update_time: 0.233313217759132, other_time: 20.783203125
epoch time: 192.678741455078s, input_fired_time: 4.15553617477417, output_fired_time: 0, propagate_forward_time: 183.694747924805, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.82846069335938
validation[          , genome  6031] predictions:    6363/  10000 (63.63%), best:    6393/10000 (63.93%), error:     10491.73926, best error:     10428.99414 on epoch:    22, epoch:   24/25, mu: 0.7777843475, learning_rate: 0.0001115787, weight_decay: 0.0000403970

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_173_6031_1_r1032821021_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.547277
read mu: 0.784188
read mu_delta: 0.969825
read initial_learning_rate: 0.000909965
read learning_rate: 0.000102236
read learning_rate_delta: 0.916269
read initial_weight_decay: 0.00033291
read weight_decay: 3.69984e-05
read weight_decay_delta: 0.915871
read batch_size: 122
read epsilon: 1e-07
read alpha: 0.123907
read input_dropout_probability: 0.00166246
read hidden_dropout_probability: 0.0670095
read velocity_reset: 1801
read epoch: 25
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 22
read number_validation_images: 10000
read best_validation_predictions: 6393
read best_validation_error: 10429
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6031
read normal distribution: '1 0 0'
generator_str: '267126273'
read generator: 267126273
read generated_by_map:
1 disable_node 1
reading 96 nodes.
reading 389 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3283.85717773438s, input_fired_time: 46.7317199707031, output_fired_time: 21.2943096160889, propagate_forward_time: 948.896789550781, propagate_backward_time: 2217.51977539063, weight_update_time: 1.7968442440033, other_time: 49.414794921875
epoch time: 195.309799194336s, input_fired_time: 1.23954391479492, output_fired_time: 0, propagate_forward_time: 189.068710327148, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.00154113769531
validation[          , genome  6031] predictions:    6326/  10000 (63.26%), best:    6393/10000 (63.93%), error:     10524.97461, best error:     10428.99414 on epoch:    22, epoch:   25/25, mu: 0.7841878533, learning_rate: 0.0001022361, weight_decay: 0.0000369984

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 968.5093383789s, input_fired_time: 16.6610260010, output_fired_time: 0.0000000000, propagate_forward_time: 928.7080688477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 23.1402587891
best training[          , genome  6031] predictions:   34686/  50000 (69.37%), best:    6393/10000 (63.93%), error:     45722.53125, best error:     10428.99414 on epoch:    22, epoch:   26/25, mu: 0.7903981805, learning_rate: 0.0000936758, weight_decay: 0.0000338858
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 193.3895721436s, input_fired_time: 2.7201354504, output_fired_time: 0.0000000000, propagate_forward_time: 182.6163024902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0531311035
   testing[          , genome  6031] predictions:    6393/  10000 (63.93%), best:    6393/10000 (63.93%), error:     10428.99414, best error:     10428.99414 on epoch:    22, epoch:   26/25, mu: 0.7903981805, learning_rate: 0.0000936758, weight_decay: 0.0000338858
backpropagation finished successfully!
10:28:03 (7736): called boinc_finish(0)

</stderr_txt>
]]>