Nameexact_genome_1542531604_183_6256_1
Workunit4097508
Created18 Nov 2018, 14:03:49 UTC
Sent18 Nov 2018, 14:45:44 UTC
Report deadline17 Jan 2019, 21:09:22 UTC
Received20 Nov 2018, 4:18:09 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID60920
Run time1 days 1 hours 28 min 30 sec
CPU time1 days 1 hours 18 min 23 sec
Validate stateValid
Credit15,066.61
Device peak FLOPS3.88 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size507.31 MB
Peak swap size505.72 MB
Peak disk usage8.69 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
00, propagate_forward_time: 63.4134902954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6578216553
validation[          , genome  6256] predictions:    6006/  10000 (60.06%), best:    6060/10000 (60.60%), error:     12034.35059, best error:     11777.68652 on epoch:    64, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 835.3952636719s, input_fired_time: 5.8955936432, output_fired_time: 5.4820022583, propagate_forward_time: 318.0808105469, propagate_backward_time: 496.3106689453, weight_update_time: 1.0732232332, other_time: 9.6262207031
epoch time: 66.0381698608s, input_fired_time: 0.7473037839, output_fired_time: 0.0000000000, propagate_forward_time: 63.6424865723, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6483764648
validation[          , genome  6256] predictions:    6001/  10000 (60.01%), best:    6060/10000 (60.60%), error:     11899.01074, best error:     11777.68652 on epoch:    64, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 836.7604980469s, input_fired_time: 5.9102392197, output_fired_time: 5.4759516716, propagate_forward_time: 318.3908691406, propagate_backward_time: 497.3175964355, weight_update_time: 1.0803289413, other_time: 9.6658630371
epoch time: 66.2707748413s, input_fired_time: 0.7501437068, output_fired_time: 0.0000000000, propagate_forward_time: 63.8823738098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6382560730
validation[          , genome  6256] predictions:    5999/  10000 (59.99%), best:    6060/10000 (60.60%), error:     11909.03516, best error:     11777.68652 on epoch:    64, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 836.6350097656s, input_fired_time: 5.9102425575, output_fired_time: 5.4609913826, propagate_forward_time: 318.4875793457, propagate_backward_time: 497.1565856934, weight_update_time: 1.0733637810, other_time: 9.6196289063
epoch time: 66.4648284912s, input_fired_time: 0.7498278022, output_fired_time: 0.0000000000, propagate_forward_time: 64.0786361694, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6363677979
validation[          , genome  6256] predictions:    5983/  10000 (59.83%), best:    6060/10000 (60.60%), error:     11974.76172, best error:     11777.68652 on epoch:    64, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 834.3027343750s, input_fired_time: 5.9118142128, output_fired_time: 5.4730324745, propagate_forward_time: 317.8288269043, propagate_backward_time: 495.4398803711, weight_update_time: 1.0798549652, other_time: 9.6492004395
epoch time: 66.1485519409s, input_fired_time: 0.7465848923, output_fired_time: 0.0000000000, propagate_forward_time: 63.7344818115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6674880981
validation[          , genome  6256] predictions:    6015/  10000 (60.15%), best:    6060/10000 (60.60%), error:     11999.91602, best error:     11777.68652 on epoch:    64, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 835.7150268555s, input_fired_time: 5.9186716080, output_fired_time: 5.4830060005, propagate_forward_time: 318.2894287109, propagate_backward_time: 496.3361816406, weight_update_time: 1.0761626959, other_time: 9.6876831055
epoch time: 65.8737945557s, input_fired_time: 0.7473739982, output_fired_time: 0.0000000000, propagate_forward_time: 63.4658851624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6605339050
validation[          , genome  6256] predictions:    6004/  10000 (60.04%), best:    6060/10000 (60.60%), error:     12197.20215, best error:     11777.68652 on epoch:    64, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 834.4005737305s, input_fired_time: 5.9084444046, output_fired_time: 5.4805393219, propagate_forward_time: 317.5017700195, propagate_backward_time: 495.7995910645, weight_update_time: 1.0810570717, other_time: 9.7102355957
epoch time: 65.4683914185s, input_fired_time: 0.7416356802, output_fired_time: 0.0000000000, propagate_forward_time: 63.0572586060, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6694946289
validation[          , genome  6256] predictions:    6043/  10000 (60.43%), best:    6060/10000 (60.60%), error:     11835.74316, best error:     11777.68652 on epoch:    64, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 831.5301513672s, input_fired_time: 5.9038052559, output_fired_time: 5.4626407623, propagate_forward_time: 316.5507202148, propagate_backward_time: 493.9181518555, weight_update_time: 1.0807418823, other_time: 9.6948242188
epoch time: 66.0394592285s, input_fired_time: 0.7533930540, output_fired_time: 0.0000000000, propagate_forward_time: 63.6153297424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6707344055
validation[          , genome  6256] predictions:    6121/  10000 (61.21%), best:    6121/10000 (61.21%), error:     11718.52930, best error:     11718.52930 on epoch:    74, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 828.8493041992s, input_fired_time: 5.8948092461, output_fired_time: 5.4552416801, propagate_forward_time: 315.6659851074, propagate_backward_time: 492.0909729004, weight_update_time: 1.0737652779, other_time: 9.7422485352
epoch time: 65.3631439209s, input_fired_time: 0.7445924282, output_fired_time: 0.0000000000, propagate_forward_time: 62.9734230042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6451301575
validation[          , genome  6256] predictions:    6043/  10000 (60.43%), best:    6121/10000 (61.21%), error:     11789.74414, best error:     11718.52930 on epoch:    74, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 828.6903686523s, input_fired_time: 5.8950471878, output_fired_time: 5.4606523514, propagate_forward_time: 315.8057556152, propagate_backward_time: 491.7660827637, weight_update_time: 1.0751637220, other_time: 9.7628784180
epoch time: 65.6133880615s, input_fired_time: 0.7485855222, output_fired_time: 0.0000000000, propagate_forward_time: 63.1572761536, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7075233459
validation[          , genome  6256] predictions:    6055/  10000 (60.55%), best:    6121/10000 (61.21%), error:     11861.53516, best error:     11718.52930 on epoch:    74, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 828.4229736328s, input_fired_time: 5.9007773399, output_fired_time: 5.4513301849, propagate_forward_time: 315.6269531250, propagate_backward_time: 491.7197265625, weight_update_time: 1.0723905563, other_time: 9.7241821289
epoch time: 65.7658309937s, input_fired_time: 0.7511639595, output_fired_time: 0.0000000000, propagate_forward_time: 63.3444328308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6702308655
validation[          , genome  6256] predictions:    6019/  10000 (60.19%), best:    6121/10000 (61.21%), error:     11933.82422, best error:     11718.52930 on epoch:    74, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 828.1141967773s, input_fired_time: 5.9030613899, output_fired_time: 5.4491348267, propagate_forward_time: 315.1019592285, propagate_backward_time: 491.9562072754, weight_update_time: 1.0756829977, other_time: 9.7037963867
epoch time: 65.4236526489s, input_fired_time: 0.7504746914, output_fired_time: 0.0000000000, propagate_forward_time: 63.0030059814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6701736450
validation[          , genome  6256] predictions:    6124/  10000 (61.24%), best:    6121/10000 (61.21%), error:     11762.37207, best error:     11718.52930 on epoch:    74, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 828.6456909180s, input_fired_time: 5.9341974258, output_fired_time: 5.4559273720, propagate_forward_time: 315.6250305176, propagate_backward_time: 491.8596191406, weight_update_time: 1.0790066719, other_time: 9.7709045410
epoch time: 65.2977447510s, input_fired_time: 0.7465399504, output_fired_time: 0.0000000000, propagate_forward_time: 62.8772544861, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6739540100
validation[          , genome  6256] predictions:    5988/  10000 (59.88%), best:    6121/10000 (61.21%), error:     11924.60449, best error:     11718.52930 on epoch:    74, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 828.7169799805s, input_fired_time: 5.9088549614, output_fired_time: 5.4497656822, propagate_forward_time: 315.5950927734, propagate_backward_time: 492.0135803223, weight_update_time: 1.0767692327, other_time: 9.7496643066
epoch time: 65.9303665161s, input_fired_time: 0.7507285476, output_fired_time: 0.0000000000, propagate_forward_time: 63.5091590881, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6704826355
validation[          , genome  6256] predictions:    6109/  10000 (61.09%), best:    6109/10000 (61.09%), error:     11675.80957, best error:     11675.80957 on epoch:    80, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 833.2600097656s, input_fired_time: 5.9286546707, output_fired_time: 5.4870424271, propagate_forward_time: 317.4986572266, propagate_backward_time: 494.6051635742, weight_update_time: 1.0767294168, other_time: 9.7404785156
epoch time: 65.9968032837s, input_fired_time: 0.7504101396, output_fired_time: 0.0000000000, propagate_forward_time: 63.5920219421, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6543693542
validation[          , genome  6256] predictions:    6074/  10000 (60.74%), best:    6109/10000 (61.09%), error:     11807.64258, best error:     11675.80957 on epoch:    80, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 837.5819091797s, input_fired_time: 5.9538602829, output_fired_time: 5.5243506432, propagate_forward_time: 318.9159545898, propagate_backward_time: 497.4548950195, weight_update_time: 1.0768260956, other_time: 9.7328491211
epoch time: 65.8539199829s, input_fired_time: 0.7493730187, output_fired_time: 0.0000000000, propagate_forward_time: 63.4475936890, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6569519043
validation[          , genome  6256] predictions:    6092/  10000 (60.92%), best:    6109/10000 (61.09%), error:     11682.57520, best error:     11675.80957 on epoch:    80, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.983062
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000176998
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 7.07993e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 83
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 80
read number_validation_images: 10000
read best_validation_predictions: 6109
read best_validation_error: 11675.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '492568849'
read generator: 492568849
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.983062
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000176998
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 7.07993e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 83
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 80
read number_validation_images: 10000
read best_validation_predictions: 6109
read best_validation_error: 11675.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '492568849'
read generator: 492568849
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.983062
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000176998
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 7.07993e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 83
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 80
read number_validation_images: 10000
read best_validation_predictions: 6109
read best_validation_error: 11675.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '492568849'
read generator: 492568849
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.983062
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000176998
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 7.07993e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 83
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 80
read number_validation_images: 10000
read best_validation_predictions: 6109
read best_validation_error: 11675.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '492568849'
read generator: 492568849
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.983062
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000176998
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 7.07993e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 83
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 80
read number_validation_images: 10000
read best_validation_predictions: 6109
read best_validation_error: 11675.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '492568849'
read generator: 492568849
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 835.544677734375s, input_fired_time: 5.92761659622192, output_fired_time: 5.45497941970825, propagate_forward_time: 317.969146728516, propagate_backward_time: 496.535034179688, weight_update_time: 1.07854986190796, other_time: 9.65792846679688
epoch time: 65.5702362060547s, input_fired_time: 0.747448265552521, output_fired_time: 0, propagate_forward_time: 63.1599540710449, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.6628303527832
validation[          , genome  6256] predictions:    6118/  10000 (61.18%), best:    6118/10000 (61.18%), error:     11634.58496, best error:     11634.58496 on epoch:    83, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 831.4743041992s, input_fired_time: 5.9404377937, output_fired_time: 5.4679927826, propagate_forward_time: 316.6091918945, propagate_backward_time: 493.7534179688, weight_update_time: 1.0774410963, other_time: 9.7032470703
epoch time: 65.5214614868s, input_fired_time: 0.7510114908, output_fired_time: 0.0000000000, propagate_forward_time: 63.1140022278, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6564445496
validation[          , genome  6256] predictions:    6108/  10000 (61.08%), best:    6118/10000 (61.18%), error:     11701.01660, best error:     11634.58496 on epoch:    83, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 831.9226074219s, input_fired_time: 5.9243049622, output_fired_time: 5.4523301125, propagate_forward_time: 316.4719848633, propagate_backward_time: 494.4043273926, weight_update_time: 1.0725429058, other_time: 9.6696472168
epoch time: 65.7939147949s, input_fired_time: 0.7553530335, output_fired_time: 0.0000000000, propagate_forward_time: 63.3793601990, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6591987610
validation[          , genome  6256] predictions:    5999/  10000 (59.99%), best:    6118/10000 (61.18%), error:     11784.58887, best error:     11634.58496 on epoch:    83, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 832.0764160156s, input_fired_time: 5.9438877106, output_fired_time: 5.4745693207, propagate_forward_time: 316.6052856445, propagate_backward_time: 494.3721008301, weight_update_time: 1.0728716850, other_time: 9.6805725098
epoch time: 65.7821502686s, input_fired_time: 0.7504943609, output_fired_time: 0.0000000000, propagate_forward_time: 63.3878631592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6437911987
validation[          , genome  6256] predictions:    6078/  10000 (60.78%), best:    6118/10000 (61.18%), error:     11843.00391, best error:     11634.58496 on epoch:    83, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 830.6885375977s, input_fired_time: 5.9159474373, output_fired_time: 5.4757518768, propagate_forward_time: 316.0325927734, propagate_backward_time: 493.4103088379, weight_update_time: 1.0706127882, other_time: 9.8539123535
epoch time: 66.1855163574s, input_fired_time: 0.7577009797, output_fired_time: 0.0000000000, propagate_forward_time: 63.7820854187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6457328796
validation[          , genome  6256] predictions:    6105/  10000 (61.05%), best:    6118/10000 (61.18%), error:     11727.21680, best error:     11634.58496 on epoch:    83, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 833.4855957031s, input_fired_time: 5.9417486191, output_fired_time: 5.4734930992, propagate_forward_time: 317.4384155273, propagate_backward_time: 494.9206542969, weight_update_time: 1.0814790726, other_time: 9.7112426758
epoch time: 65.7902603149s, input_fired_time: 0.7521500587, output_fired_time: 0.0000000000, propagate_forward_time: 63.3844833374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6536254883
validation[          , genome  6256] predictions:    6099/  10000 (60.99%), best:    6118/10000 (61.18%), error:     11761.46582, best error:     11634.58496 on epoch:    83, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.9849
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00013011
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.2044e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 89
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 83
read number_validation_images: 10000
read best_validation_predictions: 6118
read best_validation_error: 11634.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '1864560952'
read generator: 1864560952
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.9849
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00013011
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.2044e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 89
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 83
read number_validation_images: 10000
read best_validation_predictions: 6118
read best_validation_error: 11634.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '1864560952'
read generator: 1864560952
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542531604_183_6256_1_r1007419498_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.9849
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.00013011
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 5.2044e-06
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 89
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 83
read number_validation_images: 10000
read best_validation_predictions: 6118
read best_validation_error: 11634.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6256
read normal distribution: '1 0 0'
generator_str: '1864560952'
read generator: 1864560952
read generated_by_map:
1 crossover 1
reading 60 nodes.
reading 245 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 836.561767578125s, input_fired_time: 5.95020055770874, output_fired_time: 5.48657321929932, propagate_forward_time: 318.693725585938, propagate_backward_time: 496.720428466797, weight_update_time: 1.0793993473053, other_time: 9.71084594726563
epoch time: 65.9570922851563s, input_fired_time: 0.755878686904907, output_fired_time: 0, propagate_forward_time: 63.5417709350586, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.65943908691406
validation[          , genome  6256] predictions:    6136/  10000 (61.36%), best:    6118/10000 (61.18%), error:     11685.75000, best error:     11634.58496 on epoch:    83, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 834.5332641602s, input_fired_time: 5.9470930099, output_fired_time: 5.4671015739, propagate_forward_time: 317.7383728027, propagate_backward_time: 495.6790161133, weight_update_time: 1.0797172785, other_time: 9.7016906738
epoch time: 65.7945938110s, input_fired_time: 0.7535170317, output_fired_time: 0.0000000000, propagate_forward_time: 63.3940963745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6469802856
validation[          , genome  6256] predictions:    6081/  10000 (60.81%), best:    6118/10000 (61.18%), error:     11915.14648, best error:     11634.58496 on epoch:    83, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 836.2308349609s, input_fired_time: 5.9406738281, output_fired_time: 5.4852213860, propagate_forward_time: 318.4360351563, propagate_backward_time: 496.6438598633, weight_update_time: 1.0843138695, other_time: 9.7250366211
epoch time: 65.7908859253s, input_fired_time: 0.7505297661, output_fired_time: 0.0000000000, propagate_forward_time: 63.3864212036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6539382935
validation[          , genome  6256] predictions:    6079/  10000 (60.79%), best:    6118/10000 (61.18%), error:     11714.44629, best error:     11634.58496 on epoch:    83, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 833.1594238281s, input_fired_time: 5.9365406036, output_fired_time: 5.4651226997, propagate_forward_time: 317.3292236328, propagate_backward_time: 494.7353820801, weight_update_time: 1.0752733946, other_time: 9.6931457520
epoch time: 65.9153671265s, input_fired_time: 0.7509360313, output_fired_time: 0.0000000000, propagate_forward_time: 63.5174827576, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6469459534
validation[          , genome  6256] predictions:    6079/  10000 (60.79%), best:    6118/10000 (61.18%), error:     11849.72852, best error:     11634.58496 on epoch:    83, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 834.1055297852s, input_fired_time: 5.9556770325, output_fired_time: 5.4884619713, propagate_forward_time: 317.9023742676, propagate_backward_time: 495.0479736328, weight_update_time: 1.0759278536, other_time: 9.7110290527
epoch time: 66.0204467773s, input_fired_time: 0.7576788068, output_fired_time: 0.0000000000, propagate_forward_time: 63.6055870056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6571846008
validation[          , genome  6256] predictions:    6142/  10000 (61.42%), best:    6142/10000 (61.42%), error:     11564.18164, best error:     11564.18164 on epoch:    93, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 834.7254028320s, input_fired_time: 5.9615187645, output_fired_time: 5.4696717262, propagate_forward_time: 317.5634765625, propagate_backward_time: 496.0158996582, weight_update_time: 1.0719096661, other_time: 9.7148132324
epoch time: 65.9389343262s, input_fired_time: 0.7569373250, output_fired_time: 0.0000000000, propagate_forward_time: 63.5268898010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6551094055
validation[          , genome  6256] predictions:    6125/  10000 (61.25%), best:    6142/10000 (61.42%), error:     11656.38379, best error:     11564.18164 on epoch:    93, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 834.5277099609s, input_fired_time: 5.9670906067, output_fired_time: 5.4784808159, propagate_forward_time: 317.6768188477, propagate_backward_time: 495.6488037109, weight_update_time: 1.0763959885, other_time: 9.7565307617
epoch time: 65.7844467163s, input_fired_time: 0.7540451884, output_fired_time: 0.0000000000, propagate_forward_time: 63.3626098633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6677932739
validation[          , genome  6256] predictions:    6123/  10000 (61.23%), best:    6142/10000 (61.42%), error:     11647.02930, best error:     11564.18164 on epoch:    93, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 838.9210205078s, input_fired_time: 5.9544558525, output_fired_time: 5.4825639725, propagate_forward_time: 319.2257690430, propagate_backward_time: 498.6275024414, weight_update_time: 1.0772473812, other_time: 9.6307373047
epoch time: 66.4568634033s, input_fired_time: 0.7760971785, output_fired_time: 0.0000000000, propagate_forward_time: 64.0317764282, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6489868164
validation[          , genome  6256] predictions:    6109/  10000 (61.09%), best:    6142/10000 (61.42%), error:     11635.72949, best error:     11564.18164 on epoch:    93, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 841.9691162109s, input_fired_time: 5.9788713455, output_fired_time: 5.4828257561, propagate_forward_time: 320.4463195801, propagate_backward_time: 500.4160156250, weight_update_time: 1.0819090605, other_time: 9.6450500488
epoch time: 66.3349609375s, input_fired_time: 0.7589047551, output_fired_time: 0.0000000000, propagate_forward_time: 63.9253387451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6507186890
validation[          , genome  6256] predictions:    6102/  10000 (61.02%), best:    6142/10000 (61.42%), error:     11611.79492, best error:     11564.18164 on epoch:    93, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 838.4722900391s, input_fired_time: 5.9649324417, output_fired_time: 5.4756793976, propagate_forward_time: 319.2038879395, propagate_backward_time: 498.1138610840, weight_update_time: 1.0960245132, other_time: 9.7139282227
epoch time: 66.1292419434s, input_fired_time: 0.7588329315, output_fired_time: 0.0000000000, propagate_forward_time: 63.7250137329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6453933716
validation[          , genome  6256] predictions:    6079/  10000 (60.79%), best:    6142/10000 (61.42%), error:     11627.96777, best error:     11564.18164 on epoch:    93, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 837.2915039063s, input_fired_time: 5.9732313156, output_fired_time: 5.4834399223, propagate_forward_time: 318.5503540039, propagate_backward_time: 497.6190490723, weight_update_time: 1.0784763098, other_time: 9.6654357910
epoch time: 68.1918411255s, input_fired_time: 0.7713043690, output_fired_time: 0.0000000000, propagate_forward_time: 65.7370758057, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6834640503
validation[          , genome  6256] predictions:    6144/  10000 (61.44%), best:    6142/10000 (61.42%), error:     11673.94141, best error:     11564.18164 on epoch:    93, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 837.0067749023s, input_fired_time: 5.9801373482, output_fired_time: 5.4651198387, propagate_forward_time: 318.6995849609, propagate_backward_time: 497.1942749023, weight_update_time: 1.0757049322, other_time: 9.6676025391
epoch time: 66.1577835083s, input_fired_time: 0.7611964345, output_fired_time: 0.0000000000, propagate_forward_time: 63.7452735901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6513099670
validation[          , genome  6256] predictions:    6097/  10000 (60.97%), best:    6142/10000 (61.42%), error:     11825.87695, best error:     11564.18164 on epoch:    93, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 330.6050415039s, input_fired_time: 3.7834489346, output_fired_time: 0.0000000000, propagate_forward_time: 318.5178833008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.3037109375
best training[          , genome  6256] predictions:   39084/  50000 (78.17%), best:    6142/10000 (61.42%), error:     33150.77344, best error:     11564.18164 on epoch:    93, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 66.0728454590s, input_fired_time: 0.7548986077, output_fired_time: 0.0000000000, propagate_forward_time: 63.6641464233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6538009644
   testing[          , genome  6256] predictions:    6142/  10000 (61.42%), best:    6142/10000 (61.42%), error:     11564.18164, best error:     11564.18164 on epoch:    93, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
21:17:55 (20168): called boinc_finish(0)

</stderr_txt>
]]>