Nameexact_genome_1542031203_177_5584_1
Workunit4081327
Created12 Nov 2018, 18:34:01 UTC
Sent12 Nov 2018, 18:40:59 UTC
Report deadline8 Jan 2019, 18:15:15 UTC
Received14 Nov 2018, 2:03:13 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID10687
Run time23 hours 38 min 39 sec
CPU time22 hours 50 min 5 sec
Validate stateValid
Credit14,245.53
Device peak FLOPS4.48 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size526.63 MB
Peak swap size525.12 MB
Peak disk usage13.18 MB

Stderr output

<core_client_version>7.4.42</core_client_version>
<![CDATA[
<stderr_txt>
rator_str: '1259686093'
read generator: 1259686093
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.908619
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00207604
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 8.30417e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 35
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 32
read number_validation_images: 10000
read best_validation_predictions: 5950
read best_validation_error: 12573.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1259686093'
read generator: 1259686093
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1583.3095703125s, input_fired_time: 15.2526550292969, output_fired_time: 11.7848176956177, propagate_forward_time: 574.084228515625, propagate_backward_time: 965.521179199219, weight_update_time: 1.63666093349457, other_time: 16.6666870117188
epoch time: 117.091156005859s, input_fired_time: 1.722660779953, output_fired_time: 0, propagate_forward_time: 112.447708129883, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.92078399658203
validation[          , genome  5584] predictions:    5897/  10000 (58.97%), best:    5897/10000 (58.97%), error:     12553.75293, best error:     12553.75293 on epoch:    35, epoch:   35/50, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1560.6271972656s, input_fired_time: 15.0363340378, output_fired_time: 12.0094547272, propagate_forward_time: 563.8955688477, propagate_backward_time: 953.3408203125, weight_update_time: 1.6365091801, other_time: 16.3450317383
epoch time: 117.6013336182s, input_fired_time: 1.7509256601, output_fired_time: 0.0000000000, propagate_forward_time: 112.9130172729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9373931885
validation[          , genome  5584] predictions:    6068/  10000 (60.68%), best:    6068/10000 (60.68%), error:     12388.50098, best error:     12388.50098 on epoch:    36, epoch:   36/50, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1566.5039062500s, input_fired_time: 15.2136678696, output_fired_time: 12.0878934860, propagate_forward_time: 565.8779296875, propagate_backward_time: 956.9907836914, weight_update_time: 1.6130231619, other_time: 16.3336791992
epoch time: 119.3326416016s, input_fired_time: 1.7385293245, output_fired_time: 0.0000000000, propagate_forward_time: 114.6666336060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9274749756
validation[          , genome  5584] predictions:    5971/  10000 (59.71%), best:    6068/10000 (60.68%), error:     12535.91602, best error:     12388.50098 on epoch:    36, epoch:   37/50, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.920226
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00177995
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 7.11978e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 38
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1961074024'
read generator: 1961074024
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1718.06811523438s, input_fired_time: 16.1657295227051, output_fired_time: 12.6863584518433, propagate_forward_time: 617.289978027344, propagate_backward_time: 1053.81274414063, weight_update_time: 1.61248779296875, other_time: 18.11328125
epoch time: 123.624076843262s, input_fired_time: 1.72460043430328, output_fired_time: 0, propagate_forward_time: 118.975715637207, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.92375946044922
validation[          , genome  5584] predictions:    5957/  10000 (59.57%), best:    6068/10000 (60.68%), error:     12659.11133, best error:     12388.50098 on epoch:    36, epoch:   38/50, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 1568.7792968750s, input_fired_time: 15.1766500473, output_fired_time: 11.8869924545, propagate_forward_time: 562.5666503906, propagate_backward_time: 962.2699584961, weight_update_time: 1.6926178932, other_time: 16.8790893555
epoch time: 116.2963714600s, input_fired_time: 1.7410745621, output_fired_time: 0.0000000000, propagate_forward_time: 111.6604614258, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8948364258
validation[          , genome  5584] predictions:    5984/  10000 (59.84%), best:    6068/10000 (60.68%), error:     12716.72754, best error:     12388.50098 on epoch:    36, epoch:   39/50, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 1542.2404785156s, input_fired_time: 15.0442810059, output_fired_time: 11.8886604309, propagate_forward_time: 558.4368286133, propagate_backward_time: 940.3282470703, weight_update_time: 1.6348890066, other_time: 16.5424194336
epoch time: 114.9458236694s, input_fired_time: 1.6910403967, output_fired_time: 0.0000000000, propagate_forward_time: 110.3708496094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8839340210
validation[          , genome  5584] predictions:    5976/  10000 (59.76%), best:    6068/10000 (60.68%), error:     12490.95410, best error:     12388.50098 on epoch:    36, epoch:   40/50, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.930178
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00152608
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 6.10432e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 41
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '734741701'
read generator: 734741701
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1507.03466796875s, input_fired_time: 14.6781044006348, output_fired_time: 11.787260055542, propagate_forward_time: 544.833801269531, propagate_backward_time: 921.432495117188, weight_update_time: 1.36849808692932, other_time: 14.3030395507813
epoch time: 155.655410766602s, input_fired_time: 1.67865908145905, output_fired_time: 0, propagate_forward_time: 151.157684326172, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.81906127929688
validation[          , genome  5584] predictions:    5992/  10000 (59.92%), best:    6068/10000 (60.68%), error:     12547.24023, best error:     12388.50098 on epoch:    36, epoch:   41/50, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.933169
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00144978
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.79911e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 42
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1142459347'
read generator: 1142459347
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1507.51220703125s, input_fired_time: 14.6264677047729, output_fired_time: 11.6595144271851, propagate_forward_time: 547.834289550781, propagate_backward_time: 918.830993652344, weight_update_time: 1.37932574748993, other_time: 14.5609130859375
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.933169
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00144978
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.79911e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 42
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1142459347'
read generator: 1142459347
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.933169
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00144978
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.79911e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 42
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1142459347'
read generator: 1142459347
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.933169
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00144978
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.79911e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 42
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1142459347'
read generator: 1142459347
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.933169
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00144978
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.79911e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 42
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1142459347'
read generator: 1142459347
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1475.74145507813s, input_fired_time: 14.2863969802856, output_fired_time: 11.4771919250488, propagate_forward_time: 533.755554199219, propagate_backward_time: 902.082336425781, weight_update_time: 1.37992119789124, other_time: 14.1400146484375
epoch time: 114.924308776855s, input_fired_time: 1.71531701087952, output_fired_time: 0, propagate_forward_time: 110.408813476563, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.80017852783203
validation[          , genome  5584] predictions:    5989/  10000 (59.89%), best:    6068/10000 (60.68%), error:     12534.27637, best error:     12388.50098 on epoch:    36, epoch:   42/50, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.93601
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00137729
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.50915e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 43
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 36
read number_validation_images: 10000
read best_validation_predictions: 6068
read best_validation_error: 12388.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '2074216273'
read generator: 2074216273
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1482.6748046875s, input_fired_time: 14.4942741394043, output_fired_time: 11.4481925964355, propagate_forward_time: 537.1240234375, propagate_backward_time: 905.496765136719, weight_update_time: 1.36119699478149, other_time: 14.1115112304688
epoch time: 119.266525268555s, input_fired_time: 1.86562991142273, output_fired_time: 0, propagate_forward_time: 114.524864196777, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.87602996826172
validation[          , genome  5584] predictions:    5976/  10000 (59.76%), best:    6068/10000 (60.68%), error:     12730.28516, best error:     12388.50098 on epoch:    36, epoch:   43/50, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 1505.9624023438s, input_fired_time: 14.7967863083, output_fired_time: 11.5642662048, propagate_forward_time: 544.7788085938, propagate_backward_time: 918.6728515625, weight_update_time: 1.5583276749, other_time: 16.1497802734
epoch time: 114.1541061401s, input_fired_time: 1.7367057800, output_fired_time: 0.0000000000, propagate_forward_time: 109.5948791504, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8225250244
validation[          , genome  5584] predictions:    6111/  10000 (61.11%), best:    6111/10000 (61.11%), error:     12322.79688, best error:     12322.79688 on epoch:    44, epoch:   44/50, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_177_5584_1_r1919251514_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.941274
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.001243
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 4.97201e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 45
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 44
read number_validation_images: 10000
read best_validation_predictions: 6111
read best_validation_error: 12322.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5584
read normal distribution: '1 0 0'
generator_str: '1634842889'
read generator: 1634842889
read generated_by_map:
1 disable_node 1
reading 107 nodes.
reading 444 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1556.94067382813s, input_fired_time: 14.7109603881836, output_fired_time: 11.687388420105, propagate_forward_time: 585.43701171875, propagate_backward_time: 929.894836425781, weight_update_time: 1.44935524463654, other_time: 15.2105102539063
epoch time: 117.590362548828s, input_fired_time: 1.79029130935669, output_fired_time: 0, propagate_forward_time: 112.840553283691, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.95951843261719
validation[          , genome  5584] predictions:    6037/  10000 (60.37%), best:    6111/10000 (61.11%), error:     12348.93652, best error:     12322.79688 on epoch:    44, epoch:   45/50, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 1552.3121337891s, input_fired_time: 15.2108907700, output_fired_time: 11.8725023270, propagate_forward_time: 561.1220092773, propagate_backward_time: 947.7548828125, weight_update_time: 1.5826940536, other_time: 16.3517456055
epoch time: 114.5084304810s, input_fired_time: 1.7237328291, output_fired_time: 0.0000000000, propagate_forward_time: 109.9044113159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8802871704
validation[          , genome  5584] predictions:    6041/  10000 (60.41%), best:    6111/10000 (61.11%), error:     12497.92090, best error:     12322.79688 on epoch:    44, epoch:   46/50, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 1488.3432617188s, input_fired_time: 14.5771026611, output_fired_time: 11.4529514313, propagate_forward_time: 539.1568603516, propagate_backward_time: 907.1570434570, weight_update_time: 1.5645728111, other_time: 15.9992065430
epoch time: 111.3451080322s, input_fired_time: 1.6803381443, output_fired_time: 0.0000000000, propagate_forward_time: 106.9297027588, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7350692749
validation[          , genome  5584] predictions:    5970/  10000 (59.70%), best:    6111/10000 (61.11%), error:     12812.26563, best error:     12322.79688 on epoch:    44, epoch:   47/50, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1507.8790283203s, input_fired_time: 14.6625595093, output_fired_time: 11.5318994522, propagate_forward_time: 543.4564819336, propagate_backward_time: 922.1330566406, weight_update_time: 1.5718839169, other_time: 16.0950317383
epoch time: 112.1479110718s, input_fired_time: 1.6999788284, output_fired_time: 0.0000000000, propagate_forward_time: 107.6444091797, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8035202026
validation[          , genome  5584] predictions:    6005/  10000 (60.05%), best:    6111/10000 (61.11%), error:     12892.37793, best error:     12322.79688 on epoch:    44, epoch:   48/50, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1506.8327636719s, input_fired_time: 14.7599287033, output_fired_time: 11.5638818741, propagate_forward_time: 543.9142456055, propagate_backward_time: 920.3443603516, weight_update_time: 1.5853872299, other_time: 16.2504272461
epoch time: 111.8984603882s, input_fired_time: 1.7143909931, output_fired_time: 0.0000000000, propagate_forward_time: 107.3848876953, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7991790771
validation[          , genome  5584] predictions:    6087/  10000 (60.87%), best:    6087/10000 (60.87%), error:     12139.29883, best error:     12139.29883 on epoch:    49, epoch:   49/50, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 1508.9837646484s, input_fired_time: 14.7286510468, output_fired_time: 11.6132555008, propagate_forward_time: 546.1965332031, propagate_backward_time: 920.2009277344, weight_update_time: 1.5932672024, other_time: 16.2443847656
epoch time: 120.2890853882s, input_fired_time: 1.7194721699, output_fired_time: 0.0000000000, propagate_forward_time: 115.7028961182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8667144775
validation[          , genome  5584] predictions:    6151/  10000 (61.51%), best:    6087/10000 (60.87%), error:     12139.69043, best error:     12139.29883 on epoch:    49, epoch:   50/50, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 562.0500488281s, input_fired_time: 8.5854511261, output_fired_time: 0.0000000000, propagate_forward_time: 539.3169555664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.1476440430
best training[          , genome  5584] predictions:   38012/  50000 (76.02%), best:    6087/10000 (60.87%), error:     34785.54297, best error:     12139.29883 on epoch:    49, epoch:   51/50, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 119.7102127075s, input_fired_time: 1.7558431625, output_fired_time: 0.0000000000, propagate_forward_time: 115.0883026123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8660659790
   testing[          , genome  5584] predictions:    6087/  10000 (60.87%), best:    6087/10000 (60.87%), error:     12139.29883, best error:     12139.29883 on epoch:    49, epoch:   51/50, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488
backpropagation finished successfully!
12:01:06 (6500): called boinc_finish(0)

</stderr_txt>
]]>