Nameexact_genome_1542069603_188_5744_2
Workunit4085157
Created23 Dec 2018, 2:26:17 UTC
Sent23 Dec 2018, 2:27:39 UTC
Report deadline1 Apr 2019, 18:56:34 UTC
Received6 Jan 2019, 3:21:49 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID74580
Run time1 days 10 hours 59 min 37 sec
CPU time1 days 10 hours 9 min 16 sec
Validate stateValid
Credit24,921.69
Device peak FLOPS3.92 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size535.89 MB
Peak swap size534.16 MB
Peak disk usage12.37 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
ding image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3649.89379882813s, input_fired_time: 56.0572776794434, output_fired_time: 31.5713996887207, propagate_forward_time: 1392.19262695313, propagate_backward_time: 2135.90478515625, weight_update_time: 0.607889711856842, other_time: 34.167724609375
epoch time: 346.610687255859s, input_fired_time: 6.21268177032471, output_fired_time: 0, propagate_forward_time: 335.512847900391, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.88516235351563
validation[          , genome  5744] predictions:    6531/  10000 (65.31%), best:    6592/10000 (65.92%), error:      9978.04883, best error:      9898.82227 on epoch:    72, epoch:   73/100, mu: 0.9753840566, learning_rate: 0.0000067488, weight_decay: 0.0000056169

epoch time: 4111.2817382813s, input_fired_time: 78.6119079590, output_fired_time: 27.0307102203, propagate_forward_time: 1598.0201416016, propagate_backward_time: 2360.2407226563, weight_update_time: 3.0790455341, other_time: 47.3784179688
epoch time: 346.0661621094s, input_fired_time: 1.5299777985, output_fired_time: 0.0000000000, propagate_forward_time: 337.5476074219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9885864258
validation[          , genome  5744] predictions:    6479/  10000 (64.79%), best:    6592/10000 (65.92%), error:     10051.47070, best error:      9898.82227 on epoch:    72, epoch:   74/100, mu: 0.9760646224, learning_rate: 0.0000062902, weight_decay: 0.0000052807

epoch time: 4056.7326660156s, input_fired_time: 55.6898422241, output_fired_time: 32.9111442566, propagate_forward_time: 1626.8166503906, propagate_backward_time: 2286.4943847656, weight_update_time: 5.3149881363, other_time: 54.8205566406
epoch time: 346.4525756836s, input_fired_time: 13.2447147369, output_fired_time: 0.0000000000, propagate_forward_time: 323.7555236816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.4523315430
validation[          , genome  5744] predictions:    6604/  10000 (66.04%), best:    6604/10000 (66.04%), error:      9816.66309, best error:      9816.66309 on epoch:    75, epoch:   75/100, mu: 0.9767134786, learning_rate: 0.0000058626, weight_decay: 0.0000049646

epoch time: 3723.7041015625s, input_fired_time: 56.2638626099, output_fired_time: 22.2688446045, propagate_forward_time: 1457.8746337891, propagate_backward_time: 2141.1047363281, weight_update_time: 0.6291059852, other_time: 46.1921386719
epoch time: 259.4810180664s, input_fired_time: 3.5336318016, output_fired_time: 0.0000000000, propagate_forward_time: 244.6956329346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.2517547607
validation[          , genome  5744] predictions:    6524/  10000 (65.24%), best:    6604/10000 (66.04%), error:      9922.53906, best error:      9816.66309 on epoch:    75, epoch:   76/100, mu: 0.9773321748, learning_rate: 0.0000054642, weight_decay: 0.0000046674

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.977922
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 5.0928e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 4.38806e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 77
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 75
read number_validation_images: 10000
read best_validation_predictions: 6604
read best_validation_error: 9816.66
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '1365288403'
read generator: 1365288403
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3526.96166992188s, input_fired_time: 69.8862686157227, output_fired_time: 33.1479835510254, propagate_forward_time: 1360.38647460938, propagate_backward_time: 2028.96057128906, weight_update_time: 0.618128895759583, other_time: 34.5804443359375
epoch time: 270.419372558594s, input_fired_time: 8.20447444915771, output_fired_time: 0, propagate_forward_time: 252.963653564453, propagate_backward_time: 0, weight_update_time: 0, other_time: 9.25125122070313
validation[          , genome  5744] predictions:    6550/  10000 (65.50%), best:    6604/10000 (66.04%), error:      9908.79102, best error:      9816.66309 on epoch:    75, epoch:   77/100, mu: 0.9779220223, learning_rate: 0.0000050928, weight_decay: 0.0000043881

epoch time: 4625.0283203125s, input_fired_time: 55.4539871216, output_fired_time: 26.8435592651, propagate_forward_time: 1831.3937988281, propagate_backward_time: 2642.3312988281, weight_update_time: 3.0772657394, other_time: 69.0053710938
epoch time: 483.6946411133s, input_fired_time: 2.0225832462, output_fired_time: 0.0000000000, propagate_forward_time: 473.4498596191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.2221984863
validation[          , genome  5744] predictions:    6614/  10000 (66.14%), best:    6614/10000 (66.14%), error:      9805.99805, best error:      9805.99805 on epoch:    78, epoch:   78/100, mu: 0.9784843922, learning_rate: 0.0000047467, weight_decay: 0.0000041254

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.979021
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 4.42405e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 3.87847e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 79
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 78
read number_validation_images: 10000
read best_validation_predictions: 6614
read best_validation_error: 9806
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '149998419'
read generator: 149998419
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3465.96459960938s, input_fired_time: 73.9088745117188, output_fired_time: 19.89723777771, propagate_forward_time: 1343.78125, propagate_backward_time: 1984.10546875, weight_update_time: 0.621471285820007, other_time: 44.271728515625
epoch time: 366.288635253906s, input_fired_time: 6.01850509643555, output_fired_time: 0, propagate_forward_time: 355.486022949219, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.78411865234375
validation[          , genome  5744] predictions:    6520/  10000 (65.20%), best:    6614/10000 (66.14%), error:      9937.72461, best error:      9805.99805 on epoch:    78, epoch:   79/100, mu: 0.9790205956, learning_rate: 0.0000044240, weight_decay: 0.0000038785

epoch time: 3607.8894042969s, input_fired_time: 61.1233749390, output_fired_time: 24.5580177307, propagate_forward_time: 1389.7518310547, propagate_backward_time: 2092.9453125000, weight_update_time: 0.6197556257, other_time: 39.5107421875
epoch time: 237.6669464111s, input_fired_time: 8.2612400055, output_fired_time: 0.0000000000, propagate_forward_time: 224.8900756836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5156250000
validation[          , genome  5744] predictions:    6597/  10000 (65.97%), best:    6614/10000 (66.14%), error:      9882.88672, best error:      9805.99805 on epoch:    78, epoch:   80/100, mu: 0.9795318246, learning_rate: 0.0000041234, weight_decay: 0.0000036463

epoch time: 3208.5539550781s, input_fired_time: 50.5046043396, output_fired_time: 23.6621665955, propagate_forward_time: 1262.0533447266, propagate_backward_time: 1838.3162841797, weight_update_time: 0.5700690746, other_time: 34.0175781250
epoch time: 263.3670349121s, input_fired_time: 5.9000177383, output_fired_time: 0.0000000000, propagate_forward_time: 248.0026855469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.4643249512
validation[          , genome  5744] predictions:    6570/  10000 (65.70%), best:    6614/10000 (66.14%), error:      9910.54297, best error:      9805.99805 on epoch:    78, epoch:   81/100, mu: 0.9800192714, learning_rate: 0.0000038431, weight_decay: 0.0000034281

epoch time: 3140.2268066406s, input_fired_time: 60.5023612976, output_fired_time: 16.4980373383, propagate_forward_time: 1236.4101562500, propagate_backward_time: 1788.0156250000, weight_update_time: 0.5793399215, other_time: 38.8005371094
epoch time: 290.1361083984s, input_fired_time: 3.6642098427, output_fired_time: 0.0000000000, propagate_forward_time: 272.4509277344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.0209655762
validation[          , genome  5744] predictions:    6552/  10000 (65.52%), best:    6614/10000 (66.14%), error:      9890.18262, best error:      9805.99805 on epoch:    78, epoch:   82/100, mu: 0.9804840088, learning_rate: 0.0000035819, weight_decay: 0.0000032229

epoch time: 3387.2768554688s, input_fired_time: 48.9188728333, output_fired_time: 33.7490539551, propagate_forward_time: 1306.2684326172, propagate_backward_time: 1958.9915771484, weight_update_time: 0.6107251048, other_time: 39.3488769531
epoch time: 334.1239929199s, input_fired_time: 3.7937443256, output_fired_time: 0.0000000000, propagate_forward_time: 315.9677734375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.3624877930
validation[          , genome  5744] predictions:    6559/  10000 (65.59%), best:    6614/10000 (66.14%), error:      9863.65918, best error:      9805.99805 on epoch:    78, epoch:   83/100, mu: 0.9809271097, learning_rate: 0.0000033385, weight_decay: 0.0000030300

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.98135
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 3.11156e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 2.8486e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 84
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 78
read number_validation_images: 10000
read best_validation_predictions: 6614
read best_validation_error: 9806
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '521967960'
read generator: 521967960
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3723.8564453125s, input_fired_time: 64.1462249755859, output_fired_time: 41.3117370605469, propagate_forward_time: 1422.91064453125, propagate_backward_time: 2136.3603515625, weight_update_time: 2.97131443023682, other_time: 59.12744140625
epoch time: 269.540771484375s, input_fired_time: 3.5962450504303, output_fired_time: 0, propagate_forward_time: 259.081481933594, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.863037109375
validation[          , genome  5744] predictions:    6574/  10000 (65.74%), best:    6614/10000 (66.14%), error:      9850.00586, best error:      9805.99805 on epoch:    78, epoch:   84/100, mu: 0.9813495874, learning_rate: 0.0000031116, weight_decay: 0.0000028486

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.981752
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 2.90008e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 2.67809e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 85
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 78
read number_validation_images: 10000
read best_validation_predictions: 6614
read best_validation_error: 9806
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '1759846707'
read generator: 1759846707
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3564.1005859375s, input_fired_time: 65.7164306640625, output_fired_time: 26.9594058990479, propagate_forward_time: 1381.75622558594, propagate_backward_time: 2038.50634765625, weight_update_time: 5.31665945053101, other_time: 51.162109375
epoch time: 357.403076171875s, input_fired_time: 1.62989044189453, output_fired_time: 0, propagate_forward_time: 343.810974121094, propagate_backward_time: 0, weight_update_time: 0, other_time: 11.9622192382813
validation[          , genome  5744] predictions:    6587/  10000 (65.87%), best:    6587/10000 (65.87%), error:      9790.68555, best error:      9790.68555 on epoch:    85, epoch:   85/100, mu: 0.9817523956, learning_rate: 0.0000029001, weight_decay: 0.0000026781

epoch time: 3778.2612304688s, input_fired_time: 56.7327690125, output_fired_time: 25.2339954376, propagate_forward_time: 1505.7988281250, propagate_backward_time: 2157.7546386719, weight_update_time: 0.6568396688, other_time: 32.7412109375
epoch time: 290.8711242676s, input_fired_time: 3.7585158348, output_fired_time: 0.0000000000, propagate_forward_time: 277.7293090820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.3833007813
validation[          , genome  5744] predictions:    6580/  10000 (65.80%), best:    6587/10000 (65.87%), error:      9843.20898, best error:      9790.68555 on epoch:    85, epoch:   86/100, mu: 0.9821364284, learning_rate: 0.0000027030, weight_decay: 0.0000025178

epoch time: 4039.8830566406s, input_fired_time: 55.3196525574, output_fired_time: 39.4131126404, propagate_forward_time: 1559.4758300781, propagate_backward_time: 2345.5385742188, weight_update_time: 2.9758000374, other_time: 40.1359863281
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.982503
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 2.51926e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 2.36709e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.982503
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 2.51926e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 2.36709e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 87
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 85
read number_validation_images: 10000
read best_validation_predictions: 6587
read best_validation_error: 9790.69
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '623050276'
read generator: 623050276
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4246.31982421875s, input_fired_time: 75.9429626464844, output_fired_time: 30.6069240570068, propagate_forward_time: 1664.88403320313, propagate_backward_time: 2413.97631835938, weight_update_time: 0.704819321632385, other_time: 60.90966796875
epoch time: 346.624298095703s, input_fired_time: 10.8271141052246, output_fired_time: 0, propagate_forward_time: 328.700500488281, propagate_backward_time: 0, weight_update_time: 0, other_time: 7.0966796875
validation[          , genome  5744] predictions:    6592/  10000 (65.92%), best:    6587/10000 (65.87%), error:      9807.28320, best error:      9790.68555 on epoch:    85, epoch:   87/100, mu: 0.9825025797, learning_rate: 0.0000025193, weight_decay: 0.0000023671

epoch time: 5802.1162109375s, input_fired_time: 77.4480209351, output_fired_time: 29.0708408356, propagate_forward_time: 2329.1413574219, propagate_backward_time: 3307.2373046875, weight_update_time: 0.7502055764, other_time: 59.2185058594
epoch time: 340.6618347168s, input_fired_time: 3.9128696918, output_fired_time: 0.0000000000, propagate_forward_time: 329.7778930664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9710693359
validation[          , genome  5744] predictions:    6592/  10000 (65.92%), best:    6587/10000 (65.87%), error:      9846.52930, best error:      9790.68555 on epoch:    85, epoch:   88/100, mu: 0.9828516841, learning_rate: 0.0000023480, weight_decay: 0.0000022254

epoch time: 4789.6015625000s, input_fired_time: 69.7326965332, output_fired_time: 27.0636463165, propagate_forward_time: 1873.2435302734, propagate_backward_time: 2753.2080078125, weight_update_time: 0.7836378813, other_time: 66.3535156250
epoch time: 423.2210083008s, input_fired_time: 4.0287590027, output_fired_time: 0.0000000000, propagate_forward_time: 409.7435607910, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.4486999512
validation[          , genome  5744] predictions:    6609/  10000 (66.09%), best:    6609/10000 (66.09%), error:      9786.76270, best error:      9786.76270 on epoch:    89, epoch:   89/100, mu: 0.9831845164, learning_rate: 0.0000021884, weight_decay: 0.0000020922

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.983502
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 2.03971e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 1.96696e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 90
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 89
read number_validation_images: 10000
read best_validation_predictions: 6609
read best_validation_error: 9786.76
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '1065005529'
read generator: 1065005529
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4761.31787109375s, input_fired_time: 85.404899597168, output_fired_time: 31.8510646820068, propagate_forward_time: 1839.20104980469, propagate_backward_time: 2752.0478515625, weight_update_time: 3.34097790718079, other_time: 52.81298828125
epoch time: 397.113128662109s, input_fired_time: 6.32354927062988, output_fired_time: 0, propagate_forward_time: 378.941101074219, propagate_backward_time: 0, weight_update_time: 0, other_time: 11.8484802246094
validation[          , genome  5744] predictions:    6584/  10000 (65.84%), best:    6609/10000 (66.09%), error:      9811.21094, best error:      9786.76270 on epoch:    89, epoch:   90/100, mu: 0.9835018516, learning_rate: 0.0000020397, weight_decay: 0.0000019670

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.983804
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 1.90108e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 1.84923e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 91
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 89
read number_validation_images: 10000
read best_validation_predictions: 6609
read best_validation_error: 9786.76
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '1380804167'
read generator: 1380804167
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4917.52978515625s, input_fired_time: 80.3444976806641, output_fired_time: 36.5857315063477, propagate_forward_time: 1940.42211914063, propagate_backward_time: 2811.8837890625, weight_update_time: 0.79839962720871, other_time: 48.293212890625
epoch time: 351.941375732422s, input_fired_time: 4.0561146736145, output_fired_time: 0, propagate_forward_time: 335.799163818359, propagate_backward_time: 0, weight_update_time: 0, other_time: 12.0860900878906
validation[          , genome  5744] predictions:    6618/  10000 (66.18%), best:    6609/10000 (66.09%), error:      9814.85254, best error:      9786.76270 on epoch:    89, epoch:   91/100, mu: 0.9838044047, learning_rate: 0.0000019011, weight_decay: 0.0000018492

epoch time: 4688.6713867188s, input_fired_time: 95.7018661499, output_fired_time: 34.6660118103, propagate_forward_time: 1794.2100830078, propagate_backward_time: 2713.8056640625, weight_update_time: 0.8252205849, other_time: 50.2880859375
epoch time: 446.2659301758s, input_fired_time: 1.7947078943, output_fired_time: 0.0000000000, propagate_forward_time: 437.2790527344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1921691895
validation[          , genome  5744] predictions:    6600/  10000 (66.00%), best:    6600/10000 (66.00%), error:      9777.27734, best error:      9777.27734 on epoch:    92, epoch:   92/100, mu: 0.9840928912, learning_rate: 0.0000017719, weight_decay: 0.0000017385

epoch time: 4814.2534179688s, input_fired_time: 82.7850112915, output_fired_time: 35.2367401123, propagate_forward_time: 1925.0250244141, propagate_backward_time: 2720.1437988281, weight_update_time: 3.1175475121, other_time: 51.0627441406
epoch time: 399.8966674805s, input_fired_time: 6.3818116188, output_fired_time: 0.0000000000, propagate_forward_time: 371.6007995605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 21.9140625000
validation[          , genome  5744] predictions:    6614/  10000 (66.14%), best:    6600/10000 (66.00%), error:      9783.37598, best error:      9777.27734 on epoch:    92, epoch:   93/100, mu: 0.9843679667, learning_rate: 0.0000016514, weight_decay: 0.0000016345

epoch time: 4612.0771484375s, input_fired_time: 62.0775833130, output_fired_time: 29.8410892487, propagate_forward_time: 1822.4293212891, propagate_backward_time: 2631.3664550781, weight_update_time: 5.4372420311, other_time: 66.3625488281
epoch time: 373.4886474609s, input_fired_time: 6.3210601807, output_fired_time: 0.0000000000, propagate_forward_time: 362.6125488281, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5550537109
validation[          , genome  5744] predictions:    6615/  10000 (66.15%), best:    6615/10000 (66.15%), error:      9762.25391, best error:      9762.25391 on epoch:    94, epoch:   94/100, mu: 0.9846302271, learning_rate: 0.0000015392, weight_decay: 0.0000015366

epoch time: 4743.6928710938s, input_fired_time: 79.2144317627, output_fired_time: 27.0366134644, propagate_forward_time: 1870.2316894531, propagate_backward_time: 2728.4338378906, weight_update_time: 3.1033351421, other_time: 38.7763671875
epoch time: 390.2998657227s, input_fired_time: 6.3535227776, output_fired_time: 0.0000000000, propagate_forward_time: 369.5756225586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.3707275391
validation[          , genome  5744] predictions:    6576/  10000 (65.76%), best:    6615/10000 (66.15%), error:      9784.47461, best error:      9762.25391 on epoch:    94, epoch:   95/100, mu: 0.9848802686, learning_rate: 0.0000014346, weight_decay: 0.0000014447

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542069603_188_5744_2_r68717993_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.515179
read mu: 0.985119
read mu_delta: 0.953436
read initial_learning_rate: 0.00115006
read learning_rate: 1.33708e-06
read learning_rate_delta: 0.932034
read initial_weight_decay: 0.000508536
read weight_decay: 1.35819e-06
read weight_decay_delta: 0.940144
read batch_size: 70
read epsilon: 1e-07
read alpha: 0.104969
read input_dropout_probability: 0.00112202
read hidden_dropout_probability: 0.101738
read velocity_reset: 1624
read epoch: 96
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 94
read number_validation_images: 10000
read best_validation_predictions: 6615
read best_validation_error: 9762.25
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5744
read normal distribution: '0 -0.0218961257487535 0.492582708597183'
generator_str: '922941675'
read generator: 922941675
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 372 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 3360.12451171875s, input_fired_time: 55.7156944274902, output_fired_time: 19.018575668335, propagate_forward_time: 1336.81970214844, propagate_backward_time: 1909.90051269531, weight_update_time: 0.62016636133194, other_time: 38.670166015625
epoch time: 296.581268310547s, input_fired_time: 3.68603992462158, output_fired_time: 0, propagate_forward_time: 281.159637451172, propagate_backward_time: 0, weight_update_time: 0, other_time: 11.735595703125
validation[          , genome  5744] predictions:    6590/  10000 (65.90%), best:    6615/10000 (66.15%), error:      9782.82617, best error:      9762.25391 on epoch:    94, epoch:   96/100, mu: 0.9851186872, learning_rate: 0.0000013371, weight_decay: 0.0000013582

epoch time: 5888.5068359375s, input_fired_time: 68.2350921631, output_fired_time: 55.6479072571, propagate_forward_time: 2380.3908691406, propagate_backward_time: 3339.0468750000, weight_update_time: 0.7232655287, other_time: 45.1862792969
epoch time: 273.7307128906s, input_fired_time: 5.9039502144, output_fired_time: 0.0000000000, propagate_forward_time: 260.9264831543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9002685547
validation[          , genome  5744] predictions:    6624/  10000 (66.24%), best:    6624/10000 (66.24%), error:      9748.69336, best error:      9748.69336 on epoch:    97, epoch:   97/100, mu: 0.9853459597, learning_rate: 0.0000012462, weight_decay: 0.0000012769

epoch time: 4228.9741210938s, input_fired_time: 69.7036895752, output_fired_time: 21.2009353638, propagate_forward_time: 1615.5250244141, propagate_backward_time: 2455.7905273438, weight_update_time: 3.0857732296, other_time: 66.7539062500
epoch time: 356.2772827148s, input_fired_time: 4.0194854736, output_fired_time: 0.0000000000, propagate_forward_time: 345.0746154785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1831970215
validation[          , genome  5744] predictions:    6608/  10000 (66.08%), best:    6624/10000 (66.24%), error:      9768.12988, best error:      9748.69336 on epoch:    97, epoch:   98/100, mu: 0.9855626822, learning_rate: 0.0000011615, weight_decay: 0.0000012005

epoch time: 3233.1550292969s, input_fired_time: 55.5137596130, output_fired_time: 30.6912860870, propagate_forward_time: 1231.6237792969, propagate_backward_time: 1881.4771728516, weight_update_time: 2.9305844307, other_time: 33.8489990234
epoch time: 290.5612487793s, input_fired_time: 5.9942283630, output_fired_time: 0.0000000000, propagate_forward_time: 272.7747192383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.7922973633
validation[          , genome  5744] predictions:    6599/  10000 (65.99%), best:    6624/10000 (66.24%), error:      9767.42188, best error:      9748.69336 on epoch:    97, epoch:   99/100, mu: 0.9857692719, learning_rate: 0.0000010826, weight_decay: 0.0000011286

epoch time: 3347.6608886719s, input_fired_time: 53.5921669006, output_fired_time: 23.8013725281, propagate_forward_time: 1285.8676757813, propagate_backward_time: 1959.7893066406, weight_update_time: 0.6461659074, other_time: 24.6103515625
epoch time: 276.6918334961s, input_fired_time: 1.3062785864, output_fired_time: 0.0000000000, propagate_forward_time: 266.1658020020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.2197570801
validation[          , genome  5744] predictions:    6605/  10000 (66.05%), best:    6624/10000 (66.24%), error:      9773.86816, best error:      9748.69336 on epoch:    97, epoch:  100/100, mu: 0.9859662652, learning_rate: 0.0000010090, weight_decay: 0.0000010611

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1329.9528808594s, input_fired_time: 15.7848949432, output_fired_time: 0.0000000000, propagate_forward_time: 1274.7420654297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 39.4259033203
best training[          , genome  5744] predictions:   36717/  50000 (73.43%), best:    6624/10000 (66.24%), error:     40329.08594, best error:      9748.69336 on epoch:    97, epoch:  101/100, mu: 0.9861540794, learning_rate: 0.0000009404, weight_decay: 0.0000009975
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 277.1863403320s, input_fired_time: 3.6741821766, output_fired_time: 0.0000000000, propagate_forward_time: 268.8704528809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6416931152
   testing[          , genome  5744] predictions:    6624/  10000 (66.24%), best:    6624/10000 (66.24%), error:      9748.69336, best error:      9748.69336 on epoch:    97, epoch:  101/100, mu: 0.9861540794, learning_rate: 0.0000009404, weight_decay: 0.0000009975
backpropagation finished successfully!
18:21:24 (1072): called boinc_finish(0)

</stderr_txt>
]]>