Nameexact_genome_1542189904_188_5893_3
Workunit4088794
Created16 Jun 2019, 19:11:26 UTC
Sent16 Jun 2019, 19:11:34 UTC
Report deadline1 Oct 2019, 20:16:35 UTC
Received19 Jun 2019, 6:48:03 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID6323
Run time2 days 1 hours 42 min 41 sec
CPU time2 days 0 hours 41 min 21 sec
Validate stateValid
Credit26,761.29
Device peak FLOPS3.43 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size557.91 MB
Peak swap size577.08 MB
Peak disk usage11.64 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1353.25219726563s, input_fired_time: 19.0582580566406, output_fired_time: 9.71693229675293, propagate_forward_time: 495.471008300781, propagate_backward_time: 816.045593261719, weight_update_time: 0.705537617206573, other_time: 12.96044921875
epoch time: 102.098205566406s, input_fired_time: 1.46944487094879, output_fired_time: 0, propagate_forward_time: 98.3313980102539, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.29736328125
validation[          , genome  5893] predictions:    6196/  10000 (61.96%), best:    6249/10000 (62.49%), error:     10979.79102, best error:     10763.36035 on epoch:    61, epoch:   69/100, mu: 0.9754847288, learning_rate: 0.0001290026, weight_decay: 0.0000653956

epoch time: 1339.5489501953s, input_fired_time: 18.9668655396, output_fired_time: 9.4884862900, propagate_forward_time: 491.5902099609, propagate_backward_time: 806.6520996094, weight_update_time: 0.6733637452, other_time: 12.8511962891
epoch time: 104.4993209839s, input_fired_time: 1.4639950991, output_fired_time: 0.0000000000, propagate_forward_time: 100.8276977539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2076263428
validation[          , genome  5893] predictions:    6262/  10000 (62.62%), best:    6249/10000 (62.49%), error:     10852.41016, best error:     10763.36035 on epoch:    61, epoch:   70/100, mu: 0.9762084484, learning_rate: 0.0001214605, weight_decay: 0.0000633378

epoch time: 1384.8874511719s, input_fired_time: 19.6923694611, output_fired_time: 9.9642763138, propagate_forward_time: 507.9656372070, propagate_backward_time: 833.7048950195, weight_update_time: 0.7235710621, other_time: 13.5603027344
epoch time: 107.3504791260s, input_fired_time: 1.7306010723, output_fired_time: 0.0000000000, propagate_forward_time: 103.1485443115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4713363647
validation[          , genome  5893] predictions:    6306/  10000 (63.06%), best:    6249/10000 (62.49%), error:     10828.96680, best error:     10763.36035 on epoch:    61, epoch:   71/100, mu: 0.9768961072, learning_rate: 0.0001143594, weight_decay: 0.0000613448

epoch time: 1411.5303955078s, input_fired_time: 20.4475822449, output_fired_time: 10.4793348312, propagate_forward_time: 516.2803344727, propagate_backward_time: 850.2064208984, weight_update_time: 0.7688745856, other_time: 14.1166381836
epoch time: 109.3986816406s, input_fired_time: 1.8459701538, output_fired_time: 0.0000000000, propagate_forward_time: 104.8452911377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7074203491
validation[          , genome  5893] predictions:    6228/  10000 (62.28%), best:    6249/10000 (62.49%), error:     10934.32324, best error:     10763.36035 on epoch:    61, epoch:   72/100, mu: 0.9775494337, learning_rate: 0.0001076734, weight_decay: 0.0000594145

epoch time: 1406.1008300781s, input_fired_time: 21.1391716003, output_fired_time: 10.6440162659, propagate_forward_time: 512.8083496094, propagate_backward_time: 846.9973754883, weight_update_time: 0.7309215069, other_time: 14.5119018555
epoch time: 97.9725799561s, input_fired_time: 1.4013215303, output_fired_time: 0.0000000000, propagate_forward_time: 94.6165847778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9546737671
validation[          , genome  5893] predictions:    6205/  10000 (62.05%), best:    6249/10000 (62.49%), error:     10890.68945, best error:     10763.36035 on epoch:    61, epoch:   73/100, mu: 0.9781702161, learning_rate: 0.0001013783, weight_decay: 0.0000575449

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.97876
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 9.54513e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 5.57342e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 74
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 61
read number_validation_images: 10000
read best_validation_predictions: 6249
read best_validation_error: 10763.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '1754510903'
read generator: 1754510903
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.97876
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 9.54513e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 5.57342e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 74
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 61
read number_validation_images: 10000
read best_validation_predictions: 6249
read best_validation_error: 10763.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '1754510903'
read generator: 1754510903
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1655.01098632813s, input_fired_time: 22.4486503601074, output_fired_time: 11.4402666091919, propagate_forward_time: 614.700439453125, propagate_backward_time: 993.258483886719, weight_update_time: 0.756993532180786, other_time: 13.1631469726563
epoch time: 122.534744262695s, input_fired_time: 1.62411165237427, output_fired_time: 0, propagate_forward_time: 118.796974182129, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.11365509033203
validation[          , genome  5893] predictions:    6265/  10000 (62.65%), best:    6249/10000 (62.49%), error:     10768.06836, best error:     10763.36035 on epoch:    61, epoch:   74/100, mu: 0.9787600636, learning_rate: 0.0000954513, weight_decay: 0.0000557342

epoch time: 1599.8571777344s, input_fired_time: 21.6303176880, output_fired_time: 10.6925067902, propagate_forward_time: 593.8906250000, propagate_backward_time: 960.9704589844, weight_update_time: 0.7504474521, other_time: 12.6732177734
epoch time: 122.6107101440s, input_fired_time: 1.6402088404, output_fired_time: 0.0000000000, propagate_forward_time: 118.8351974487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1353073120
validation[          , genome  5893] predictions:    6194/  10000 (61.94%), best:    6249/10000 (62.49%), error:     10861.61816, best error:     10763.36035 on epoch:    61, epoch:   75/100, mu: 0.9793204665, learning_rate: 0.0000898707, weight_decay: 0.0000539804

epoch time: 1595.7720947266s, input_fired_time: 21.9149475098, output_fired_time: 10.8017416000, propagate_forward_time: 590.6846923828, propagate_backward_time: 959.5698242188, weight_update_time: 0.7517871261, other_time: 12.8009033203
epoch time: 121.2157440186s, input_fired_time: 1.6203446388, output_fired_time: 0.0000000000, propagate_forward_time: 117.5193252563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0760726929
validation[          , genome  5893] predictions:    6235/  10000 (62.35%), best:    6249/10000 (62.49%), error:     10779.82031, best error:     10763.36035 on epoch:    61, epoch:   76/100, mu: 0.9798529148, learning_rate: 0.0000846165, weight_decay: 0.0000522818

epoch time: 1583.3712158203s, input_fired_time: 21.3675823212, output_fired_time: 10.5494155884, propagate_forward_time: 587.2670288086, propagate_backward_time: 951.6537475586, weight_update_time: 0.7760381699, other_time: 12.5334472656
epoch time: 124.1064910889s, input_fired_time: 1.6462337971, output_fired_time: 0.0000000000, propagate_forward_time: 120.3673553467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0929031372
validation[          , genome  5893] predictions:    6218/  10000 (62.18%), best:    6249/10000 (62.49%), error:     10860.84180, best error:     10763.36035 on epoch:    61, epoch:   77/100, mu: 0.9803588390, learning_rate: 0.0000796694, weight_decay: 0.0000506367

epoch time: 1603.3238525391s, input_fired_time: 21.5038528442, output_fired_time: 10.6164045334, propagate_forward_time: 598.0789794922, propagate_backward_time: 960.8035888672, weight_update_time: 0.7212845683, other_time: 12.3209228516
epoch time: 125.0512084961s, input_fired_time: 1.6876711845, output_fired_time: 0.0000000000, propagate_forward_time: 121.2994613647, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0640792847
validation[          , genome  5893] predictions:    6264/  10000 (62.64%), best:    6249/10000 (62.49%), error:     10790.03320, best error:     10763.36035 on epoch:    61, epoch:   78/100, mu: 0.9808395505, learning_rate: 0.0000750116, weight_decay: 0.0000490434

epoch time: 1625.4161376953s, input_fired_time: 21.8588256836, output_fired_time: 10.9170894623, propagate_forward_time: 605.7833251953, propagate_backward_time: 974.1553344727, weight_update_time: 0.7365484238, other_time: 12.7015991211
epoch time: 126.0485839844s, input_fired_time: 1.7026355267, output_fired_time: 0.0000000000, propagate_forward_time: 122.2118988037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1340484619
validation[          , genome  5893] predictions:    6285/  10000 (62.85%), best:    6249/10000 (62.49%), error:     10767.44922, best error:     10763.36035 on epoch:    61, epoch:   79/100, mu: 0.9812963009, learning_rate: 0.0000706260, weight_decay: 0.0000475001

epoch time: 1597.2137451172s, input_fired_time: 21.3893604279, output_fired_time: 10.4348688126, propagate_forward_time: 596.6354980469, propagate_backward_time: 956.4133911133, weight_update_time: 0.7188188434, other_time: 12.3406372070
epoch time: 123.8236694336s, input_fired_time: 1.6504231691, output_fired_time: 0.0000000000, propagate_forward_time: 120.1227111816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0505371094
validation[          , genome  5893] predictions:    6352/  10000 (63.52%), best:    6352/10000 (63.52%), error:     10553.71094, best error:     10553.71094 on epoch:    80, epoch:   80/100, mu: 0.9817302823, learning_rate: 0.0000664969, weight_decay: 0.0000460055

epoch time: 1595.7382812500s, input_fired_time: 21.4631729126, output_fired_time: 10.5848102570, propagate_forward_time: 595.0870971680, propagate_backward_time: 956.3134765625, weight_update_time: 0.7134089470, other_time: 12.2897338867
epoch time: 123.9464263916s, input_fired_time: 1.6405675411, output_fired_time: 0.0000000000, propagate_forward_time: 120.2420043945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0638580322
validation[          , genome  5893] predictions:    6325/  10000 (63.25%), best:    6352/10000 (63.52%), error:     10581.42188, best error:     10553.71094 on epoch:    80, epoch:   81/100, mu: 0.9821426272, learning_rate: 0.0000626092, weight_decay: 0.0000445578

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.982534
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 5.89488e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 4.31558e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 82
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 80
read number_validation_images: 10000
read best_validation_predictions: 6352
read best_validation_error: 10553.7
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '1524855292'
read generator: 1524855292
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1681.76733398438s, input_fired_time: 21.8808269500732, output_fired_time: 10.8758163452148, propagate_forward_time: 630.625122070313, propagate_backward_time: 1006.00549316406, weight_update_time: 0.736497402191162, other_time: 12.3800048828125
epoch time: 130.090759277344s, input_fired_time: 1.73185706138611, output_fired_time: 0, propagate_forward_time: 126.231369018555, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.12753295898438
validation[          , genome  5893] predictions:    6330/  10000 (63.30%), best:    6352/10000 (63.52%), error:     10601.17285, best error:     10553.71094 on epoch:    80, epoch:   82/100, mu: 0.9825344086, learning_rate: 0.0000589488, weight_decay: 0.0000431558

epoch time: 1615.5111083984s, input_fired_time: 21.4849090576, output_fired_time: 10.6375503540, propagate_forward_time: 603.1663818359, propagate_backward_time: 967.8898925781, weight_update_time: 0.7136267424, other_time: 12.3323974609
epoch time: 126.1767349243s, input_fired_time: 1.6487947702, output_fired_time: 0.0000000000, propagate_forward_time: 122.4857711792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0421676636
validation[          , genome  5893] predictions:    6333/  10000 (63.33%), best:    6352/10000 (63.52%), error:     10608.55859, best error:     10553.71094 on epoch:    80, epoch:   83/100, mu: 0.9829066396, learning_rate: 0.0000555024, weight_decay: 0.0000417978

epoch time: 1641.4733886719s, input_fired_time: 21.4705429077, output_fired_time: 10.6398525238, propagate_forward_time: 615.1683959961, propagate_backward_time: 982.0258789063, weight_update_time: 0.7150899768, other_time: 12.1686401367
epoch time: 126.9479980469s, input_fired_time: 1.6568545103, output_fired_time: 0.0000000000, propagate_forward_time: 123.2603683472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0307769775
validation[          , genome  5893] predictions:    6306/  10000 (63.06%), best:    6352/10000 (63.52%), error:     10691.80762, best error:     10553.71094 on epoch:    80, epoch:   84/100, mu: 0.9832603335, learning_rate: 0.0000522574, weight_decay: 0.0000404826

epoch time: 1631.3239746094s, input_fired_time: 21.5535125732, output_fired_time: 10.7476606369, propagate_forward_time: 609.9577026367, propagate_backward_time: 976.7414550781, weight_update_time: 0.7258378863, other_time: 12.3236694336
epoch time: 127.1656188965s, input_fired_time: 1.6642568111, output_fired_time: 0.0000000000, propagate_forward_time: 123.4600753784, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0412902832
validation[          , genome  5893] predictions:    6383/  10000 (63.83%), best:    6383/10000 (63.83%), error:     10529.71191, best error:     10529.71191 on epoch:    85, epoch:   85/100, mu: 0.9835963845, learning_rate: 0.0000492022, weight_decay: 0.0000392087

epoch time: 1645.0576171875s, input_fired_time: 21.7094707489, output_fired_time: 10.7150020599, propagate_forward_time: 613.6890869141, propagate_backward_time: 985.9327392578, weight_update_time: 0.7419670224, other_time: 13.0113525391
epoch time: 125.3864746094s, input_fired_time: 1.6421562433, output_fired_time: 0.0000000000, propagate_forward_time: 121.6836624146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0606536865
validation[          , genome  5893] predictions:    6324/  10000 (63.24%), best:    6383/10000 (63.83%), error:     10619.66504, best error:     10529.71191 on epoch:    85, epoch:   86/100, mu: 0.9839156866, learning_rate: 0.0000463256, weight_decay: 0.0000379750

epoch time: 1619.8878173828s, input_fired_time: 21.3747272491, output_fired_time: 10.5624637604, propagate_forward_time: 606.3096313477, propagate_backward_time: 969.4571533203, weight_update_time: 0.7123082876, other_time: 12.1837768555
epoch time: 125.1704635620s, input_fired_time: 1.6382658482, output_fired_time: 0.0000000000, propagate_forward_time: 121.4563446045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0758514404
validation[          , genome  5893] predictions:    6358/  10000 (63.58%), best:    6383/10000 (63.83%), error:     10542.58594, best error:     10529.71191 on epoch:    85, epoch:   87/100, mu: 0.9842190742, learning_rate: 0.0000436172, weight_decay: 0.0000367800

epoch time: 1617.7509765625s, input_fired_time: 21.4063205719, output_fired_time: 10.5326681137, propagate_forward_time: 605.1719360352, propagate_backward_time: 968.5314331055, weight_update_time: 0.7207061052, other_time: 12.1085205078
epoch time: 126.2725677490s, input_fired_time: 1.6703227758, output_fired_time: 0.0000000000, propagate_forward_time: 122.5864562988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0157852173
validation[          , genome  5893] predictions:    6356/  10000 (63.56%), best:    6356/10000 (63.56%), error:     10466.80273, best error:     10466.80273 on epoch:    88, epoch:   88/100, mu: 0.9845073223, learning_rate: 0.0000410671, weight_decay: 0.0000356227

epoch time: 1638.8914794922s, input_fired_time: 21.6319751740, output_fired_time: 10.6515693665, propagate_forward_time: 613.7076416016, propagate_backward_time: 980.4516601563, weight_update_time: 0.7346578836, other_time: 12.4486083984
epoch time: 125.5949478149s, input_fired_time: 1.6417243481, output_fired_time: 0.0000000000, propagate_forward_time: 121.9061355591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0470886230
validation[          , genome  5893] predictions:    6338/  10000 (63.38%), best:    6356/10000 (63.56%), error:     10563.09961, best error:     10466.80273 on epoch:    88, epoch:   89/100, mu: 0.9847812057, learning_rate: 0.0000386662, weight_decay: 0.0000345018

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.985041
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 3.64056e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 3.34161e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 90
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 88
read number_validation_images: 10000
read best_validation_predictions: 6356
read best_validation_error: 10466.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '2034120158'
read generator: 2034120158
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1675.93005371094s, input_fired_time: 21.564338684082, output_fired_time: 10.7702560424805, propagate_forward_time: 633.260559082031, propagate_backward_time: 998.333679199219, weight_update_time: 0.717211961746216, other_time: 12.001220703125
epoch time: 131.063888549805s, input_fired_time: 1.67667937278748, output_fired_time: 0, propagate_forward_time: 127.399230957031, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.98797607421875
validation[          , genome  5893] predictions:    6388/  10000 (63.88%), best:    6356/10000 (63.56%), error:     10501.13379, best error:     10466.80273 on epoch:    88, epoch:   90/100, mu: 0.9850414395, learning_rate: 0.0000364056, weight_decay: 0.0000334161

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.985289
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 3.42771e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 3.23646e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 91
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 88
read number_validation_images: 10000
read best_validation_predictions: 6356
read best_validation_error: 10466.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '549818048'
read generator: 549818048
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.985289
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 3.42771e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 3.23646e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 91
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 88
read number_validation_images: 10000
read best_validation_predictions: 6356
read best_validation_error: 10466.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '549818048'
read generator: 549818048
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.985289
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 3.42771e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 3.23646e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 91
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 88
read number_validation_images: 10000
read best_validation_predictions: 6356
read best_validation_error: 10466.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '549818048'
read generator: 549818048
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1650.91296386719s, input_fired_time: 21.4873828887939, output_fired_time: 10.7860908508301, propagate_forward_time: 619.567565917969, propagate_backward_time: 986.991577148438, weight_update_time: 0.726286709308624, other_time: 12.0802612304688
epoch time: 127.351135253906s, input_fired_time: 1.66814231872559, output_fired_time: 0, propagate_forward_time: 123.644912719727, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.03807830810547
validation[          , genome  5893] predictions:    6278/  10000 (62.78%), best:    6356/10000 (63.56%), error:     10651.35059, best error:     10466.80273 on epoch:    88, epoch:   91/100, mu: 0.9852886796, learning_rate: 0.0000342771, weight_decay: 0.0000323646

epoch time: 1632.0555419922s, input_fired_time: 21.4948959351, output_fired_time: 10.6638021469, propagate_forward_time: 611.4877929688, propagate_backward_time: 976.1071777344, weight_update_time: 0.7289838195, other_time: 12.3018798828
epoch time: 129.8210296631s, input_fired_time: 1.6968024969, output_fired_time: 0.0000000000, propagate_forward_time: 126.0351104736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0891113281
validation[          , genome  5893] predictions:    6241/  10000 (62.41%), best:    6356/10000 (63.56%), error:     10986.40820, best error:     10466.80273 on epoch:    88, epoch:   92/100, mu: 0.9855235815, learning_rate: 0.0000322731, weight_decay: 0.0000313462

epoch time: 1643.1282958984s, input_fired_time: 21.5280532837, output_fired_time: 10.6155891418, propagate_forward_time: 617.8571777344, propagate_backward_time: 981.0164184570, weight_update_time: 0.7117778659, other_time: 12.1110229492
epoch time: 127.7467727661s, input_fired_time: 1.6419879198, output_fired_time: 0.0000000000, propagate_forward_time: 124.0664672852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0383148193
validation[          , genome  5893] predictions:    6394/  10000 (63.94%), best:    6356/10000 (63.56%), error:     10494.68652, best error:     10466.80273 on epoch:    88, epoch:   93/100, mu: 0.9857468009, learning_rate: 0.0000303863, weight_decay: 0.0000303599

epoch time: 1639.0375976563s, input_fired_time: 21.5853137970, output_fired_time: 10.6172657013, propagate_forward_time: 616.1434936523, propagate_backward_time: 978.4987792969, weight_update_time: 0.7165682316, other_time: 12.1926879883
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_188_5893_3_r1550529392_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495172
read mu: 0.985959
read mu_delta: 0.950141
read initial_learning_rate: 0.00823893
read learning_rate: 2.86098e-05
read learning_rate_delta: 0.941535
read initial_weight_decay: 0.000593796
read weight_decay: 2.94046e-05
read weight_decay_delta: 0.968534
read batch_size: 95
read epsilon: 1e-07
read alpha: 0.07413
read input_dropout_probability: 0.00118635
read hidden_dropout_probability: 0.0989785
read velocity_reset: 1725
read epoch: 94
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 88
read number_validation_images: 10000
read best_validation_predictions: 6356
read best_validation_error: 10466.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5893
read normal distribution: '0 0.582476496696472 -0.169215381145477'
generator_str: '552035938'
read generator: 552035938
read generated_by_map:
1 crossover 1
reading 88 nodes.
reading 361 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1644.16430664063s, input_fired_time: 21.4744033813477, output_fired_time: 10.6933746337891, propagate_forward_time: 617.656799316406, propagate_backward_time: 982.414367675781, weight_update_time: 0.709331691265106, other_time: 11.9254150390625
epoch time: 124.502838134766s, input_fired_time: 1.6932874917984, output_fired_time: 0, propagate_forward_time: 120.763618469238, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.04592895507813
validation[          , genome  5893] predictions:    6331/  10000 (63.31%), best:    6356/10000 (63.56%), error:     10558.71777, best error:     10466.80273 on epoch:    88, epoch:   94/100, mu: 0.9859588742, learning_rate: 0.0000286098, weight_decay: 0.0000294046

epoch time: 1595.7885742188s, input_fired_time: 21.3347129822, output_fired_time: 10.6177349091, propagate_forward_time: 596.0796508789, propagate_backward_time: 955.4384765625, weight_update_time: 0.7192248106, other_time: 12.3180541992
epoch time: 124.9583587646s, input_fired_time: 1.6375505924, output_fired_time: 0.0000000000, propagate_forward_time: 121.2415466309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0792617798
validation[          , genome  5893] predictions:    6355/  10000 (63.55%), best:    6356/10000 (63.56%), error:     10553.18652, best error:     10466.80273 on epoch:    88, epoch:   95/100, mu: 0.9861603379, learning_rate: 0.0000269371, weight_decay: 0.0000284793

epoch time: 1597.5161132813s, input_fired_time: 21.3081245422, output_fired_time: 10.5754280090, propagate_forward_time: 595.2663574219, propagate_backward_time: 958.0208129883, weight_update_time: 0.7330285311, other_time: 12.3453979492
epoch time: 124.7002334595s, input_fired_time: 1.6630910635, output_fired_time: 0.0000000000, propagate_forward_time: 120.9432144165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0939254761
validation[          , genome  5893] predictions:    6393/  10000 (63.93%), best:    6393/10000 (63.93%), error:     10437.75879, best error:     10437.75879 on epoch:    96, epoch:   96/100, mu: 0.9863517880, learning_rate: 0.0000253622, weight_decay: 0.0000275832

epoch time: 1615.0493164063s, input_fired_time: 21.5078945160, output_fired_time: 10.6056966782, propagate_forward_time: 603.1693725586, propagate_backward_time: 967.4648437500, weight_update_time: 0.7169450521, other_time: 12.3014526367
epoch time: 127.1360549927s, input_fired_time: 1.6933436394, output_fired_time: 0.0000000000, propagate_forward_time: 123.3567733765, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0859375000
validation[          , genome  5893] predictions:    6339/  10000 (63.39%), best:    6393/10000 (63.93%), error:     10446.40820, best error:     10437.75879 on epoch:    96, epoch:   97/100, mu: 0.9865337014, learning_rate: 0.0000238794, weight_decay: 0.0000267152

epoch time: 1631.0388183594s, input_fired_time: 21.4083766937, output_fired_time: 10.6985177994, propagate_forward_time: 610.3093872070, propagate_backward_time: 976.2784423828, weight_update_time: 0.7379812598, other_time: 12.3441772461
epoch time: 125.7604064941s, input_fired_time: 1.6534379721, output_fired_time: 0.0000000000, propagate_forward_time: 122.0848388672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0221328735
validation[          , genome  5893] predictions:    6310/  10000 (63.10%), best:    6393/10000 (63.93%), error:     10576.47559, best error:     10437.75879 on epoch:    96, epoch:   98/100, mu: 0.9867065549, learning_rate: 0.0000224833, weight_decay: 0.0000258746

epoch time: 1639.4647216797s, input_fired_time: 21.4586620331, output_fired_time: 10.5999927521, propagate_forward_time: 614.4208374023, propagate_backward_time: 980.9304199219, weight_update_time: 0.7146645188, other_time: 12.0548706055
epoch time: 127.5355072021s, input_fired_time: 1.6717591286, output_fired_time: 0.0000000000, propagate_forward_time: 123.8589859009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0047607422
validation[          , genome  5893] predictions:    6396/  10000 (63.96%), best:    6393/10000 (63.93%), error:     10509.09180, best error:     10437.75879 on epoch:    96, epoch:   99/100, mu: 0.9868707657, learning_rate: 0.0000211689, weight_decay: 0.0000250604

epoch time: 1631.2285156250s, input_fired_time: 21.3015460968, output_fired_time: 10.6434793472, propagate_forward_time: 611.3447265625, propagate_backward_time: 975.9058227539, weight_update_time: 0.7247310281, other_time: 12.0330200195
epoch time: 127.6639175415s, input_fired_time: 1.6824579239, output_fired_time: 0.0000000000, propagate_forward_time: 123.9485855103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0328750610
validation[          , genome  5893] predictions:    6373/  10000 (63.73%), best:    6393/10000 (63.93%), error:     10498.76758, best error:     10437.75879 on epoch:    96, epoch:  100/100, mu: 0.9870268106, learning_rate: 0.0000199312, weight_decay: 0.0000242718

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 630.0936279297s, input_fired_time: 8.2400350571, output_fired_time: 0.0000000000, propagate_forward_time: 611.6428833008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.2106933594
best training[          , genome  5893] predictions:   36276/  50000 (72.55%), best:    6393/10000 (63.93%), error:     42325.31250, best error:     10437.75879 on epoch:    96, epoch:  101/100, mu: 0.9871750474, learning_rate: 0.0000187660, weight_decay: 0.0000235081
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 126.4493408203s, input_fired_time: 1.6470645666, output_fired_time: 0.0000000000, propagate_forward_time: 122.7992172241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0030593872
   testing[          , genome  5893] predictions:    6393/  10000 (63.93%), best:    6393/10000 (63.93%), error:     10437.75879, best error:     10437.75879 on epoch:    96, epoch:  101/100, mu: 0.9871750474, learning_rate: 0.0000187660, weight_decay: 0.0000235081
backpropagation finished successfully!
08:47:26 (1476): called boinc_finish(0)

</stderr_txt>
]]>