Nameexact_genome_1540746903_170_5322_1
Workunit4075225
Created28 Oct 2018, 19:39:33 UTC
Sent28 Oct 2018, 20:13:03 UTC
Report deadline24 Nov 2018, 6:31:24 UTC
Received7 Dec 2018, 16:46:15 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time10 hours 14 min 39 sec
CPU time10 hours 3 min 43 sec
Validate stateValid
Credit6,607.36
Device peak FLOPS3.80 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size569.29 MB
Peak swap size588.77 MB
Peak disk usage11.19 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.466159
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000677923
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 0.000197482
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '1748235363'
read generator: 1748235363
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 720487687
post shuffle 1: 968037393
epoch time: 1071.57275390625s, input_fired_time: 21.0874710083008, output_fired_time: 7.52069282531738, propagate_forward_time: 387.107513427734, propagate_backward_time: 643.141296386719, weight_update_time: 0.259989053010941, other_time: 12.7156372070313
epoch time: 76.4925842285156s, input_fired_time: 1.27075290679932, output_fired_time: 0, propagate_forward_time: 73.0668182373047, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.15501403808594
validation[          , genome  5322] predictions:    6022/  10000 (60.22%), best:    6022/10000 (60.22%), error:     11565.62891, best error:     11565.62891 on epoch:     0, epoch:    0/25, mu: 0.4661592841, learning_rate: 0.0006779235, weight_decay: 0.0001974822

epoch time: 994.0835571289s, input_fired_time: 20.6784172058, output_fired_time: 7.0848073959, propagate_forward_time: 353.8409729004, propagate_backward_time: 600.1453247070, weight_update_time: 0.2461557835, other_time: 12.3340454102
epoch time: 74.6932983398s, input_fired_time: 1.2504271269, output_fired_time: 0.0000000000, propagate_forward_time: 71.3107757568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1320953369
validation[          , genome  5322] predictions:    5744/  10000 (57.44%), best:    6022/10000 (60.22%), error:     12379.81641, best error:     11565.62891 on epoch:     0, epoch:    1/25, mu: 0.4974627495, learning_rate: 0.0006157606, weight_decay: 0.0001832391

epoch time: 993.8496093750s, input_fired_time: 20.6698455811, output_fired_time: 7.0898594856, propagate_forward_time: 353.7149353027, propagate_backward_time: 600.0308837891, weight_update_time: 0.2476923764, other_time: 12.3441162109
epoch time: 76.1812362671s, input_fired_time: 1.2693102360, output_fired_time: 0.0000000000, propagate_forward_time: 72.7467041016, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1652221680
validation[          , genome  5322] predictions:    5893/  10000 (58.93%), best:    6022/10000 (60.22%), error:     11864.09180, best error:     11565.62891 on epoch:     0, epoch:    2/25, mu: 0.5268955827, learning_rate: 0.0005592977, weight_decay: 0.0001700233

epoch time: 996.8750610352s, input_fired_time: 20.6881980896, output_fired_time: 7.1046853065, propagate_forward_time: 354.8171386719, propagate_backward_time: 601.8787231445, weight_update_time: 0.2470244616, other_time: 12.3863525391
epoch time: 74.6011276245s, input_fired_time: 1.2482893467, output_fired_time: 0.0000000000, propagate_forward_time: 71.2430496216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1097869873
validation[          , genome  5322] predictions:    6050/  10000 (60.50%), best:    6050/10000 (60.50%), error:     11542.31152, best error:     11542.31152 on epoch:     3, epoch:    3/25, mu: 0.5545696020, learning_rate: 0.0005080123, weight_decay: 0.0001577606

epoch time: 994.5269775391s, input_fired_time: 20.6644744873, output_fired_time: 7.0868597031, propagate_forward_time: 354.0925903320, propagate_backward_time: 600.3184814453, weight_update_time: 0.2461415827, other_time: 12.3645629883
epoch time: 74.6116256714s, input_fired_time: 1.2537300587, output_fired_time: 0.0000000000, propagate_forward_time: 71.2302017212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1276931763
validation[          , genome  5322] predictions:    5967/  10000 (59.67%), best:    5967/10000 (59.67%), error:     11473.71387, best error:     11473.71387 on epoch:     4, epoch:    4/25, mu: 0.5805898905, learning_rate: 0.0004614296, weight_decay: 0.0001463824

epoch time: 993.4408569336s, input_fired_time: 20.6441078186, output_fired_time: 7.0795321465, propagate_forward_time: 353.7170410156, propagate_backward_time: 599.6766357422, weight_update_time: 0.2452594638, other_time: 12.3235473633
epoch time: 74.6534881592s, input_fired_time: 1.2523262501, output_fired_time: 0.0000000000, propagate_forward_time: 71.2759628296, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1251983643
validation[          , genome  5322] predictions:    6035/  10000 (60.35%), best:    6035/10000 (60.35%), error:     11403.33008, best error:     11403.33008 on epoch:     5, epoch:    5/25, mu: 0.6050552726, learning_rate: 0.0004191183, weight_decay: 0.0001358248

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.628059
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000380687
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 0.000126029
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 6
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 5
read number_validation_images: 10000
read best_validation_predictions: 6035
read best_validation_error: 11403.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '156697425'
read generator: 156697425
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 994.182678222656s, input_fired_time: 20.6515579223633, output_fired_time: 7.08226442337036, propagate_forward_time: 353.949096679688, propagate_backward_time: 600.131896972656, weight_update_time: 0.246065154671669, other_time: 12.3678588867188
epoch time: 74.5116195678711s, input_fired_time: 1.25043201446533, output_fired_time: 0, propagate_forward_time: 71.1579284667969, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.10325622558594
validation[          , genome  5322] predictions:    5974/  10000 (59.74%), best:    6035/10000 (60.35%), error:     11549.54492, best error:     11403.33008 on epoch:     5, epoch:    6/25, mu: 0.6280586123, learning_rate: 0.0003806868, weight_decay: 0.0001260286

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.649687
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000345779
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 0.000116939
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 7
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 5
read number_validation_images: 10000
read best_validation_predictions: 6035
read best_validation_error: 11403.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '1790070479'
read generator: 1790070479
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.649687
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000345779
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 0.000116939
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 7
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 5
read number_validation_images: 10000
read best_validation_predictions: 6035
read best_validation_error: 11403.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '1790070479'
read generator: 1790070479
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.649687
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000345779
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 0.000116939
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 7
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 5
read number_validation_images: 10000
read best_validation_predictions: 6035
read best_validation_error: 11403.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '1790070479'
read generator: 1790070479
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.649687
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000345779
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 0.000116939
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 7
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 5
read number_validation_images: 10000
read best_validation_predictions: 6035
read best_validation_error: 11403.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '1790070479'
read generator: 1790070479
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1170.33862304688s, input_fired_time: 23.5286159515381, output_fired_time: 8.43270111083984, propagate_forward_time: 419.804077148438, propagate_backward_time: 703.818664550781, weight_update_time: 0.298963755369186, other_time: 14.7545776367188
epoch time: 121.91056060791s, input_fired_time: 1.98641419410706, output_fired_time: 0, propagate_forward_time: 116.232650756836, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.69149780273438
validation[          , genome  5322] predictions:    6044/  10000 (60.44%), best:    6044/10000 (60.44%), error:     11400.92773, best error:     11400.92773 on epoch:     7, epoch:    7/25, mu: 0.6496873498, learning_rate: 0.0003457793, weight_decay: 0.0001169390

epoch time: 1222.9438476563s, input_fired_time: 23.4204597473, output_fired_time: 8.7055768967, propagate_forward_time: 445.9171447754, propagate_backward_time: 729.4102783203, weight_update_time: 0.3077362180, other_time: 15.4904785156
epoch time: 77.0692214966s, input_fired_time: 1.3130133152, output_fired_time: 0.0000000000, propagate_forward_time: 73.4519271851, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3042831421
validation[          , genome  5322] predictions:    6198/  10000 (61.98%), best:    6198/10000 (61.98%), error:     11107.70215, best error:     11107.70215 on epoch:     8, epoch:    8/25, mu: 0.6700236201, learning_rate: 0.0003140727, weight_decay: 0.0001085050

epoch time: 1040.2347412109s, input_fired_time: 21.7159194946, output_fired_time: 7.4289693832, propagate_forward_time: 370.3938293457, propagate_backward_time: 627.3133544922, weight_update_time: 0.2601445913, other_time: 13.3826904297
epoch time: 77.9363861084s, input_fired_time: 1.3339815140, output_fired_time: 0.0000000000, propagate_forward_time: 74.2488174438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3535842896
validation[          , genome  5322] predictions:    6110/  10000 (61.10%), best:    6198/10000 (61.98%), error:     11120.09668, best error:     11107.70215 on epoch:     8, epoch:    9/25, mu: 0.6891446114, learning_rate: 0.0002852734, weight_decay: 0.0001006792

epoch time: 1123.9255371094s, input_fired_time: 22.4830417633, output_fired_time: 8.0138568878, propagate_forward_time: 404.8215332031, propagate_backward_time: 674.2225341797, weight_update_time: 0.2816770077, other_time: 14.3845214844
epoch time: 113.7280578613s, input_fired_time: 1.7433387041, output_fired_time: 0.0000000000, propagate_forward_time: 109.0142211914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9704971313
validation[          , genome  5322] predictions:    6188/  10000 (61.88%), best:    6188/10000 (61.88%), error:     11010.14844, best error:     11010.14844 on epoch:    10, epoch:   10/25, mu: 0.7071229815, learning_rate: 0.0002591150, weight_decay: 0.0000934179

epoch time: 1559.3328857422s, input_fired_time: 24.9659633636, output_fired_time: 10.8753881454, propagate_forward_time: 579.1292724609, propagate_backward_time: 926.5573730469, weight_update_time: 0.3686094880, other_time: 17.8049316406
epoch time: 134.0993041992s, input_fired_time: 1.9554144144, output_fired_time: 0.0000000000, propagate_forward_time: 128.5853424072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5585479736
validation[          , genome  5322] predictions:    6165/  10000 (61.65%), best:    6165/10000 (61.65%), error:     10988.70117, best error:     10988.70117 on epoch:    11, epoch:   11/25, mu: 0.7240270376, learning_rate: 0.0002353552, weight_decay: 0.0000866803

epoch time: 1661.8206787109s, input_fired_time: 25.7114677429, output_fired_time: 11.3658027649, propagate_forward_time: 624.5854492188, propagate_backward_time: 981.6323242188, weight_update_time: 0.3910302222, other_time: 18.5256347656
epoch time: 128.6870117188s, input_fired_time: 2.0432446003, output_fired_time: 0.0000000000, propagate_forward_time: 123.2582244873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3855438232
validation[          , genome  5322] predictions:    6085/  10000 (60.85%), best:    6165/10000 (61.65%), error:     11255.18945, best error:     10988.70117 on epoch:    11, epoch:   12/25, mu: 0.7399209142, learning_rate: 0.0002137740, weight_decay: 0.0000804286

epoch time: 1598.5814208984s, input_fired_time: 25.3548984528, output_fired_time: 11.1324615479, propagate_forward_time: 603.6514892578, propagate_backward_time: 940.1506958008, weight_update_time: 0.3759614527, other_time: 18.2919311523
epoch time: 133.9015045166s, input_fired_time: 1.9519984722, output_fired_time: 0.0000000000, propagate_forward_time: 128.5094757080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4400329590
validation[          , genome  5322] predictions:    6179/  10000 (61.79%), best:    6179/10000 (61.79%), error:     10938.40625, best error:     10938.40625 on epoch:    13, epoch:   13/25, mu: 0.7548650503, learning_rate: 0.0001941718, weight_decay: 0.0000746278

epoch time: 1646.2429199219s, input_fired_time: 25.4674072266, output_fired_time: 11.3071317673, propagate_forward_time: 617.1036987305, propagate_backward_time: 973.2531127930, weight_update_time: 0.4012549222, other_time: 19.1115722656
epoch time: 137.8106842041s, input_fired_time: 2.0387015343, output_fired_time: 0.0000000000, propagate_forward_time: 132.2599029541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5120849609
validation[          , genome  5322] predictions:    6124/  10000 (61.24%), best:    6179/10000 (61.79%), error:     11051.83789, best error:     10938.40625 on epoch:    13, epoch:   14/25, mu: 0.7689161301, learning_rate: 0.0001763670, weight_decay: 0.0000692454

epoch time: 1674.7359619141s, input_fired_time: 25.6320114136, output_fired_time: 11.5269975662, propagate_forward_time: 630.5347900391, propagate_backward_time: 987.6842651367, weight_update_time: 0.4030611515, other_time: 19.3579711914
epoch time: 129.4899749756s, input_fired_time: 1.9363108873, output_fired_time: 0.0000000000, propagate_forward_time: 124.0375442505, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5161209106
validation[          , genome  5322] predictions:    6186/  10000 (61.86%), best:    6179/10000 (61.79%), error:     10939.94531, best error:     10938.40625 on epoch:    13, epoch:   15/25, mu: 0.7821275592, learning_rate: 0.0001601948, weight_decay: 0.0000642512

epoch time: 1750.1595458984s, input_fired_time: 26.1197376251, output_fired_time: 12.1034727097, propagate_forward_time: 657.4221801758, propagate_backward_time: 1033.4914550781, weight_update_time: 0.4289267361, other_time: 21.0227050781
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_170_5322_1_r1311106425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.466159
read mu: 0.79455
read mu_delta: 0.940242
read initial_learning_rate: 0.000677923
read learning_rate: 0.000145506
read learning_rate_delta: 0.908304
read initial_weight_decay: 0.000197482
read weight_decay: 5.96172e-05
read weight_decay_delta: 0.927877
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0570896
read input_dropout_probability: 0.00146829
read hidden_dropout_probability: 0.0799061
read velocity_reset: 1415
read epoch: 16
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 13
read number_validation_images: 10000
read best_validation_predictions: 6179
read best_validation_error: 10938.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5322
read normal distribution: '0 0.359275966882706 -0.8435018658638'
generator_str: '1345622564'
read generator: 1345622564
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 371 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1953.82397460938s, input_fired_time: 32.7063598632813, output_fired_time: 18.5990886688232, propagate_forward_time: 779.629699707031, propagate_backward_time: 1103.26123046875, weight_update_time: 0.315074056386948, other_time: 19.627685546875
epoch time: 94.7211456298828s, input_fired_time: 1.52013158798218, output_fired_time: 0, propagate_forward_time: 90.6784515380859, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.52256011962891
validation[          , genome  5322] predictions:    6211/  10000 (62.11%), best:    6211/10000 (62.11%), error:     10902.80371, best error:     10902.80371 on epoch:    16, epoch:   16/25, mu: 0.7945495248, learning_rate: 0.0001455056, weight_decay: 0.0000596172

epoch time: 1279.1790771484s, input_fired_time: 23.1060791016, output_fired_time: 8.9753608704, propagate_forward_time: 470.9667663574, propagate_backward_time: 761.5015258789, weight_update_time: 0.3044928610, other_time: 14.6293334961
epoch time: 101.1959915161s, input_fired_time: 1.5943933725, output_fired_time: 0.0000000000, propagate_forward_time: 96.9957427979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6058578491
validation[          , genome  5322] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     10770.63770, best error:     10770.63770 on epoch:    17, epoch:   17/25, mu: 0.8062291741, learning_rate: 0.0001321633, weight_decay: 0.0000553174

epoch time: 1323.3985595703s, input_fired_time: 23.3605766296, output_fired_time: 9.1267986298, propagate_forward_time: 490.8511047363, propagate_backward_time: 785.1799926758, weight_update_time: 0.3123054504, other_time: 14.8800659180
epoch time: 94.9271621704s, input_fired_time: 1.5406899452, output_fired_time: 0.0000000000, propagate_forward_time: 90.8637008667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5227737427
validation[          , genome  5322] predictions:    6323/  10000 (63.23%), best:    6323/10000 (63.23%), error:     10650.21191, best error:     10650.21191 on epoch:    18, epoch:   18/25, mu: 0.8172108531, learning_rate: 0.0001200444, weight_decay: 0.0000513277

epoch time: 1177.1137695313s, input_fired_time: 22.2091350555, output_fired_time: 8.2593507767, propagate_forward_time: 426.0909729004, propagate_backward_time: 706.5269165039, weight_update_time: 0.2823870182, other_time: 14.0274047852
epoch time: 77.6384811401s, input_fired_time: 1.3821161985, output_fired_time: 0.0000000000, propagate_forward_time: 73.6497116089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6066513062
validation[          , genome  5322] predictions:    6291/  10000 (62.91%), best:    6323/10000 (63.23%), error:     10699.57910, best error:     10650.21191 on epoch:    18, epoch:   19/25, mu: 0.8275363445, learning_rate: 0.0001090368, weight_decay: 0.0000476258

epoch time: 1031.8693847656s, input_fired_time: 21.7584018707, output_fired_time: 7.4862880707, propagate_forward_time: 366.7253417969, propagate_backward_time: 621.1513061523, weight_update_time: 0.2795795798, other_time: 14.7480468750
epoch time: 75.9671936035s, input_fired_time: 1.3052098751, output_fired_time: 0.0000000000, propagate_forward_time: 72.4039993286, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2579879761
validation[          , genome  5322] predictions:    6334/  10000 (63.34%), best:    6334/10000 (63.34%), error:     10648.09082, best error:     10648.09082 on epoch:    20, epoch:   20/25, mu: 0.8372448087, learning_rate: 0.0000990386, weight_decay: 0.0000441908

epoch time: 1749.0515136719s, input_fired_time: 25.6250572205, output_fired_time: 11.7286367416, propagate_forward_time: 661.9396362305, propagate_backward_time: 1032.4376220703, weight_update_time: 0.3936133385, other_time: 17.3206787109
epoch time: 148.4738769531s, input_fired_time: 2.1592450142, output_fired_time: 0.0000000000, propagate_forward_time: 142.9078979492, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4067382813
validation[          , genome  5322] predictions:    6389/  10000 (63.89%), best:    6389/10000 (63.89%), error:     10541.80469, best error:     10541.80469 on epoch:    21, epoch:   21/25, mu: 0.8463730812, learning_rate: 0.0000899571, weight_decay: 0.0000410037

epoch time: 1641.9959716797s, input_fired_time: 25.2144031525, output_fired_time: 11.1206274033, propagate_forward_time: 615.7646484375, propagate_backward_time: 973.1677246094, weight_update_time: 0.3644025624, other_time: 16.7286376953
epoch time: 129.0770874023s, input_fired_time: 2.0070159435, output_fired_time: 0.0000000000, propagate_forward_time: 124.0416946411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0283737183
validation[          , genome  5322] predictions:    6334/  10000 (63.34%), best:    6389/10000 (63.89%), error:     10643.34375, best error:     10541.80469 on epoch:    21, epoch:   22/25, mu: 0.8549558520, learning_rate: 0.0000817084, weight_decay: 0.0000380463

epoch time: 1591.6982421875s, input_fired_time: 24.8112754822, output_fired_time: 10.7209730148, propagate_forward_time: 594.9692993164, propagate_backward_time: 944.7847900391, weight_update_time: 0.3624290526, other_time: 16.4119262695
epoch time: 123.3410263062s, input_fired_time: 1.8771842718, output_fired_time: 0.0000000000, propagate_forward_time: 118.4615097046, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0023345947
validation[          , genome  5322] predictions:    6420/  10000 (64.20%), best:    6420/10000 (64.20%), error:     10498.01758, best error:     10498.01758 on epoch:    23, epoch:   23/25, mu: 0.8630257845, learning_rate: 0.0000742161, weight_decay: 0.0000353023

epoch time: 1598.7247314453s, input_fired_time: 24.6614494324, output_fired_time: 10.8930845261, propagate_forward_time: 599.2785034180, propagate_backward_time: 947.6929321289, weight_update_time: 0.3592870235, other_time: 16.1987304688
epoch time: 73.6453094482s, input_fired_time: 1.2743095160, output_fired_time: 0.0000000000, propagate_forward_time: 70.1847381592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1862640381
validation[          , genome  5322] predictions:    6343/  10000 (63.43%), best:    6420/10000 (64.20%), error:     10664.14648, best error:     10498.01758 on epoch:    23, epoch:   24/25, mu: 0.8706134558, learning_rate: 0.0000674108, weight_decay: 0.0000327562

epoch time: 827.9615478516s, input_fired_time: 17.3845882416, output_fired_time: 5.9147443771, propagate_forward_time: 294.0634155273, propagate_backward_time: 499.8350219727, weight_update_time: 0.2072225511, other_time: 10.7637939453
epoch time: 59.3432807922s, input_fired_time: 1.0302733183, output_fired_time: 0.0000000000, propagate_forward_time: 56.5679550171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7450523376
validation[          , genome  5322] predictions:    6417/  10000 (64.17%), best:    6417/10000 (64.17%), error:     10448.46191, best error:     10448.46191 on epoch:    25, epoch:   25/25, mu: 0.8777477145, learning_rate: 0.0000612294, weight_decay: 0.0000303937

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 286.0507507324s, input_fired_time: 4.9834055901, output_fired_time: 0.0000000000, propagate_forward_time: 272.5628356934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5045166016
best training[          , genome  5322] predictions:   34651/  50000 (69.30%), best:    6417/10000 (64.17%), error:     45994.21875, best error:     10448.46191 on epoch:    25, epoch:   26/25, mu: 0.8844556212, learning_rate: 0.0000556149, weight_decay: 0.0000282016
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 57.0887794495s, input_fired_time: 0.9920116663, output_fired_time: 0.0000000000, propagate_forward_time: 54.3728332520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7239341736
   testing[          , genome  5322] predictions:    6417/  10000 (64.17%), best:    6417/10000 (64.17%), error:     10448.46191, best error:     10448.46191 on epoch:    25, epoch:   26/25, mu: 0.8844556212, learning_rate: 0.0000556149, weight_decay: 0.0000282016
backpropagation finished successfully!
17:45:48 (26700): called boinc_finish(0)

</stderr_txt>
]]>