Nameexact_genome_1542189904_172_5904_0
Workunit4088932
Created14 Nov 2018, 15:53:38 UTC
Sent14 Nov 2018, 15:54:16 UTC
Report deadline14 Dec 2018, 15:36:16 UTC
Received12 Dec 2018, 9:16:26 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID56670
Run time16 hours 1 min 43 sec
CPU time12 hours 40 min 9 sec
Validate stateValid
Credit7,496.88
Device peak FLOPS3.25 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size582.84 MB
Peak swap size604.46 MB
Peak disk usage13.67 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.507812
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 0.000178691
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.000232647
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '1090375436'
read generator: 1090375436
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1461993001
post shuffle 1: 1200163584
epoch time: 1787.08972167969s, input_fired_time: 35.5925178527832, output_fired_time: 13.2882423400879, propagate_forward_time: 654.372436523438, propagate_backward_time: 1056.740234375, weight_update_time: 0.48683750629425, other_time: 27.0963134765625
epoch time: 140.621459960938s, input_fired_time: 2.58220481872559, output_fired_time: 0, propagate_forward_time: 132.979064941406, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.06019592285156
validation[          , genome  5904] predictions:    6560/  10000 (65.60%), best:    6560/10000 (65.60%), error:     10044.59082, best error:     10044.59082 on epoch:     0, epoch:    0/25, mu: 0.5078120828, learning_rate: 0.0001786912, weight_decay: 0.0002326465

epoch time: 1802.5015869141s, input_fired_time: 35.7007751465, output_fired_time: 13.2182750702, propagate_forward_time: 661.0176391602, propagate_backward_time: 1064.8552246094, weight_update_time: 0.4704445899, other_time: 27.7097167969
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.543749
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 0.000166867
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.00021825
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 1
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '1222716468'
read generator: 1222716468
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.543749
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 0.000166867
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.00021825
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 1
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '1222716468'
read generator: 1222716468
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1815.02172851563s, input_fired_time: 36.3449363708496, output_fired_time: 13.3965978622437, propagate_forward_time: 661.644226074219, propagate_backward_time: 1075.05480957031, weight_update_time: 0.477022051811218, other_time: 28.5811767578125
epoch time: 138.054244995117s, input_fired_time: 2.5316321849823, output_fired_time: 0, propagate_forward_time: 130.345153808594, propagate_backward_time: 0, weight_update_time: 0, other_time: 5.17745971679688
validation[          , genome  5904] predictions:    6516/  10000 (65.16%), best:    6560/10000 (65.60%), error:     10164.50098, best error:     10044.59082 on epoch:     0, epoch:    1/25, mu: 0.5437491536, learning_rate: 0.0001668666, weight_decay: 0.0002182504

epoch time: 1830.1322021484s, input_fired_time: 36.4601440430, output_fired_time: 13.6108188629, propagate_forward_time: 666.1158447266, propagate_backward_time: 1084.5830078125, weight_update_time: 0.4458700120, other_time: 29.3624267578
epoch time: 155.4509429932s, input_fired_time: 3.0501706600, output_fired_time: 0.0000000000, propagate_forward_time: 146.2736663818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1271057129
validation[          , genome  5904] predictions:    6591/  10000 (65.91%), best:    6560/10000 (65.60%), error:     10103.85840, best error:     10044.59082 on epoch:     0, epoch:    2/25, mu: 0.5770078301, learning_rate: 0.0001558245, weight_decay: 0.0002047452

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.607788
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 0.000145513
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.000192076
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 3
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '1850361026'
read generator: 1850361026
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1694.78759765625s, input_fired_time: 32.9813232421875, output_fired_time: 12.6646995544434, propagate_forward_time: 619.58544921875, propagate_backward_time: 1002.63787841797, weight_update_time: 0.438818663358688, other_time: 26.9182739257813
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.607788
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 0.000145513
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.000192076
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 3
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '1850361026'
read generator: 1850361026
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.607788
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 0.000145513
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.000192076
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 3
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '1850361026'
read generator: 1850361026
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1964.20104980469s, input_fired_time: 39.998893737793, output_fired_time: 14.5668163299561, propagate_forward_time: 709.276550292969, propagate_backward_time: 1167.58923339844, weight_update_time: 0.492701768875122, other_time: 32.7696533203125
epoch time: 160.300674438477s, input_fired_time: 3.09585118293762, output_fired_time: 0, propagate_forward_time: 150.982986450195, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.22183227539063
validation[          , genome  5904] predictions:    6540/  10000 (65.40%), best:    6560/10000 (65.60%), error:     10267.89258, best error:     10044.59082 on epoch:     0, epoch:    3/25, mu: 0.6077877879, learning_rate: 0.0001455131, weight_decay: 0.0001920756

epoch time: 1853.2967529297s, input_fired_time: 37.0187644958, output_fired_time: 13.5463256836, propagate_forward_time: 673.4492187500, propagate_backward_time: 1099.8131103516, weight_update_time: 0.4693979621, other_time: 29.4693603516
epoch time: 153.8700408936s, input_fired_time: 2.9009850025, output_fired_time: 0.0000000000, propagate_forward_time: 145.1302490234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.8388061523
validation[          , genome  5904] predictions:    6509/  10000 (65.09%), best:    6560/10000 (65.60%), error:     10355.03711, best error:     10044.59082 on epoch:     0, epoch:    4/25, mu: 0.6362737417, learning_rate: 0.0001358840, weight_decay: 0.0001801901

epoch time: 1905.4860839844s, input_fired_time: 38.6729583740, output_fired_time: 14.3652639389, propagate_forward_time: 689.9750366211, propagate_backward_time: 1132.0793457031, weight_update_time: 0.4930595160, other_time: 30.3935546875
epoch time: 135.3426971436s, input_fired_time: 2.6290981770, output_fired_time: 0.0000000000, propagate_forward_time: 127.6423645020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0712280273
validation[          , genome  5904] predictions:    6393/  10000 (63.93%), best:    6560/10000 (65.60%), error:     10585.13770, best error:     10044.59082 on epoch:     0, epoch:    5/25, mu: 0.6626366377, learning_rate: 0.0001268921, weight_decay: 0.0001690400

epoch time: 1870.5565185547s, input_fired_time: 38.0614776611, output_fired_time: 13.5991678238, propagate_forward_time: 679.1067504883, propagate_backward_time: 1109.4401855469, weight_update_time: 0.4903575182, other_time: 30.3488769531
epoch time: 147.6249694824s, input_fired_time: 2.8244197369, output_fired_time: 0.0000000000, propagate_forward_time: 139.1414489746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6591033936
validation[          , genome  5904] predictions:    5875/  10000 (58.75%), best:    6560/10000 (65.60%), error:     12284.48340, best error:     10044.59082 on epoch:     0, epoch:    6/25, mu: 0.6870347857, learning_rate: 0.0001184952, weight_decay: 0.0001585799

epoch time: 1690.4825439453s, input_fired_time: 33.6706008911, output_fired_time: 12.3010873795, propagate_forward_time: 617.8021240234, propagate_backward_time: 1000.0884399414, weight_update_time: 0.4435217679, other_time: 26.6201782227
epoch time: 132.4393157959s, input_fired_time: 2.5044009686, output_fired_time: 0.0000000000, propagate_forward_time: 124.7565612793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1783599854
validation[          , genome  5904] predictions:    6316/  10000 (63.16%), best:    6560/10000 (65.60%), error:     10710.52344, best error:     10044.59082 on epoch:     0, epoch:    7/25, mu: 0.7096145153, learning_rate: 0.0001106540, weight_decay: 0.0001487670

epoch time: 2056.6237792969s, input_fired_time: 41.8901596069, output_fired_time: 15.4594421387, propagate_forward_time: 739.5908813477, propagate_backward_time: 1224.9569091797, weight_update_time: 0.5507947206, other_time: 34.7264404297
epoch time: 131.9060363770s, input_fired_time: 2.5038976669, output_fired_time: 0.0000000000, propagate_forward_time: 124.5316085815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8705368042
validation[          , genome  5904] predictions:    6416/  10000 (64.16%), best:    6560/10000 (65.60%), error:     10673.37305, best error:     10044.59082 on epoch:     0, epoch:    8/25, mu: 0.7305114269, learning_rate: 0.0001033316, weight_decay: 0.0001395614

epoch time: 2087.3137207031s, input_fired_time: 41.6062431335, output_fired_time: 15.6630182266, propagate_forward_time: 752.3782348633, propagate_backward_time: 1243.2075195313, weight_update_time: 0.6287466884, other_time: 34.4587402344
epoch time: 177.7021636963s, input_fired_time: 3.0308563709, output_fired_time: 0.0000000000, propagate_forward_time: 167.1057434082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5655670166
validation[          , genome  5904] predictions:    6355/  10000 (63.55%), best:    6560/10000 (65.60%), error:     10707.52637, best error:     10044.59082 on epoch:     0, epoch:    9/25, mu: 0.7498508692, learning_rate: 0.0000964938, weight_decay: 0.0001309254

epoch time: 2027.0617675781s, input_fired_time: 40.5956077576, output_fired_time: 15.1164855957, propagate_forward_time: 732.5451049805, propagate_backward_time: 1205.5566406250, weight_update_time: 0.5993694663, other_time: 33.2480468750
epoch time: 172.5234375000s, input_fired_time: 3.3464186192, output_fired_time: 0.0000000000, propagate_forward_time: 162.1930694580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9839477539
validation[          , genome  5904] predictions:    6153/  10000 (61.53%), best:    6560/10000 (65.60%), error:     11374.93945, best error:     10044.59082 on epoch:     0, epoch:   10/25, mu: 0.7677490115, learning_rate: 0.0000901085, weight_decay: 0.0001228238

epoch time: 2199.0524902344s, input_fired_time: 44.6169929504, output_fired_time: 16.3793506622, propagate_forward_time: 790.1452636719, propagate_backward_time: 1312.1228027344, weight_update_time: 0.6734642386, other_time: 35.7880859375
epoch time: 140.6245269775s, input_fired_time: 2.6191825867, output_fired_time: 0.0000000000, propagate_forward_time: 132.7902374268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2151031494
validation[          , genome  5904] predictions:    6181/  10000 (61.81%), best:    6560/10000 (65.60%), error:     10966.50391, best error:     10044.59082 on epoch:     0, epoch:   11/25, mu: 0.7843132019, learning_rate: 0.0000841457, weight_decay: 0.0001152235

epoch time: 1915.4343261719s, input_fired_time: 37.8836746216, output_fired_time: 14.0700931549, propagate_forward_time: 693.7700805664, propagate_backward_time: 1139.2502441406, weight_update_time: 0.5366455317, other_time: 30.4602050781
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.799643
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 7.85775e-05
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.000108094
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 12
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '719206277'
read generator: 719206277
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542189904_172_5904_0_r878214410_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.507812
read mu: 0.799643
read mu_delta: 0.925471
read initial_learning_rate: 0.000178691
read learning_rate: 7.85775e-05
read learning_rate_delta: 0.933827
read initial_weight_decay: 0.000232647
read weight_decay: 0.000108094
read weight_decay_delta: 0.93812
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959862
read input_dropout_probability: 0.00141884
read hidden_dropout_probability: 0.0758997
read velocity_reset: 1903
read epoch: 12
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6560
read best_validation_error: 10044.6
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5904
read normal distribution: '1 -1.39872086048126 -0.0681257322430611'
generator_str: '719206277'
read generator: 719206277
read generated_by_map:
1 crossover 1
reading 115 nodes.
reading 461 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1952.00598144531s, input_fired_time: 38.9566764831543, output_fired_time: 14.8336877822876, propagate_forward_time: 705.542785644531, propagate_backward_time: 1160.13391113281, weight_update_time: 0.512136101722717, other_time: 32.5389404296875
epoch time: 152.617935180664s, input_fired_time: 2.74011373519897, output_fired_time: 0, propagate_forward_time: 143.767333984375, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.11048889160156
validation[          , genome  5904] predictions:    6287/  10000 (62.87%), best:    6560/10000 (65.60%), error:     10812.26074, best error:     10044.59082 on epoch:     0, epoch:   12/25, mu: 0.7996428609, learning_rate: 0.0000785775, weight_decay: 0.0001080935

epoch time: 1958.6516113281s, input_fired_time: 39.0727310181, output_fired_time: 14.4125537872, propagate_forward_time: 707.2449340820, propagate_backward_time: 1165.3348388672, weight_update_time: 0.5269514322, other_time: 32.5865478516
epoch time: 153.8828277588s, input_fired_time: 2.8202562332, output_fired_time: 0.0000000000, propagate_forward_time: 144.7868499756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2757263184
validation[          , genome  5904] predictions:    6342/  10000 (63.42%), best:    6560/10000 (65.60%), error:     10681.73047, best error:     10044.59082 on epoch:     0, epoch:   13/25, mu: 0.8138300180, learning_rate: 0.0000733778, weight_decay: 0.0001014048

epoch time: 1865.4981689453s, input_fired_time: 36.6734504700, output_fired_time: 13.7222099304, propagate_forward_time: 677.6812133789, propagate_backward_time: 1107.2031250000, weight_update_time: 0.5175452828, other_time: 30.2182617188
epoch time: 130.2702178955s, input_fired_time: 2.4162974358, output_fired_time: 0.0000000000, propagate_forward_time: 123.0575332642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7963867188
validation[          , genome  5904] predictions:    6128/  10000 (61.28%), best:    6560/10000 (65.60%), error:     11152.93848, best error:     10044.59082 on epoch:     0, epoch:   14/25, mu: 0.8269598484, learning_rate: 0.0000685221, weight_decay: 0.0000951299

epoch time: 1809.4947509766s, input_fired_time: 35.7959327698, output_fired_time: 13.3848094940, propagate_forward_time: 661.0316772461, propagate_backward_time: 1070.5883789063, weight_update_time: 0.4779758453, other_time: 28.6940917969
epoch time: 126.5109329224s, input_fired_time: 2.2985420227, output_fired_time: 0.0000000000, propagate_forward_time: 119.6393356323, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5730514526
validation[          , genome  5904] predictions:    6274/  10000 (62.74%), best:    6560/10000 (65.60%), error:     10892.77734, best error:     10044.59082 on epoch:     0, epoch:   15/25, mu: 0.8391110897, learning_rate: 0.0000639878, weight_decay: 0.0000892433

epoch time: 2019.5729980469s, input_fired_time: 40.0860061646, output_fired_time: 15.5182695389, propagate_forward_time: 730.7422485352, propagate_backward_time: 1199.8942871094, weight_update_time: 0.5144894719, other_time: 33.3320312500
epoch time: 149.6896362305s, input_fired_time: 2.9262020588, output_fired_time: 0.0000000000, propagate_forward_time: 140.6288146973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1346130371
validation[          , genome  5904] predictions:    6463/  10000 (64.63%), best:    6560/10000 (65.60%), error:     10506.63672, best error:     10044.59082 on epoch:     0, epoch:   16/25, mu: 0.8503566980, learning_rate: 0.0000597535, weight_decay: 0.0000837209

epoch time: 1844.7001953125s, input_fired_time: 37.1294975281, output_fired_time: 13.9019908905, propagate_forward_time: 670.3771972656, propagate_backward_time: 1092.5502929688, weight_update_time: 0.4984103739, other_time: 30.7412109375
epoch time: 137.6486511230s, input_fired_time: 2.5609767437, output_fired_time: 0.0000000000, propagate_forward_time: 129.7801513672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3075256348
validation[          , genome  5904] predictions:    6372/  10000 (63.72%), best:    6560/10000 (65.60%), error:     10572.89355, best error:     10044.59082 on epoch:     0, epoch:   17/25, mu: 0.8607642055, learning_rate: 0.0000557994, weight_decay: 0.0000785403

epoch time: 3296.2634277344s, input_fired_time: 67.8050842285, output_fired_time: 25.5230731964, propagate_forward_time: 1179.0164794922, propagate_backward_time: 1966.1048583984, weight_update_time: 0.9050634503, other_time: 57.8137207031
epoch time: 248.0597686768s, input_fired_time: 5.0388464928, output_fired_time: 0.0000000000, propagate_forward_time: 232.0709075928, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.9500122070
validation[          , genome  5904] predictions:    6366/  10000 (63.66%), best:    6560/10000 (65.60%), error:     10604.25293, best error:     10044.59082 on epoch:     0, epoch:   18/25, mu: 0.8703960180, learning_rate: 0.0000521070, weight_decay: 0.0000736803

epoch time: 3123.2475585938s, input_fired_time: 63.0187149048, output_fired_time: 24.4500770569, propagate_forward_time: 1123.1306152344, propagate_backward_time: 1856.9606933594, weight_update_time: 0.7212916017, other_time: 55.6872558594
epoch time: 129.2275238037s, input_fired_time: 2.3503906727, output_fired_time: 0.0000000000, propagate_forward_time: 122.1598587036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7172775269
validation[          , genome  5904] predictions:    6399/  10000 (63.99%), best:    6560/10000 (65.60%), error:     10490.98926, best error:     10044.59082 on epoch:     0, epoch:   19/25, mu: 0.8793100119, learning_rate: 0.0000486589, weight_decay: 0.0000691210

epoch time: 1947.3685302734s, input_fired_time: 38.4232292175, output_fired_time: 14.1414012909, propagate_forward_time: 707.5384521484, propagate_backward_time: 1155.1831054688, weight_update_time: 0.6358745694, other_time: 32.0823974609
epoch time: 180.0296325684s, input_fired_time: 3.3621273041, output_fired_time: 0.0000000000, propagate_forward_time: 169.0912170410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5762939453
validation[          , genome  5904] predictions:    6276/  10000 (62.76%), best:    6560/10000 (65.60%), error:     10985.64355, best error:     10044.59082 on epoch:     0, epoch:   20/25, mu: 0.8875596523, learning_rate: 0.0000454390, weight_decay: 0.0000648438

epoch time: 2273.6232910156s, input_fired_time: 46.5440788269, output_fired_time: 17.1944332123, propagate_forward_time: 816.4426269531, propagate_backward_time: 1355.2741699219, weight_update_time: 0.6209083200, other_time: 38.1679687500
epoch time: 172.8247680664s, input_fired_time: 2.9875957966, output_fired_time: 0.0000000000, propagate_forward_time: 162.8932037354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9439697266
validation[          , genome  5904] predictions:    6458/  10000 (64.58%), best:    6560/10000 (65.60%), error:     10381.37305, best error:     10044.59082 on epoch:     0, epoch:   21/25, mu: 0.8951944709, learning_rate: 0.0000424321, weight_decay: 0.0000608313

epoch time: 1960.9187011719s, input_fired_time: 38.9795913696, output_fired_time: 14.7669210434, propagate_forward_time: 712.9821166992, propagate_backward_time: 1162.7187500000, weight_update_time: 0.4416348040, other_time: 31.4711914063
epoch time: 168.5208740234s, input_fired_time: 3.0534343719, output_fired_time: 0.0000000000, propagate_forward_time: 159.0907440186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3766937256
validation[          , genome  5904] predictions:    6079/  10000 (60.79%), best:    6560/10000 (65.60%), error:     11422.29688, best error:     10044.59082 on epoch:     0, epoch:   22/25, mu: 0.9022602439, learning_rate: 0.0000396242, weight_decay: 0.0000570671

epoch time: 1966.7976074219s, input_fired_time: 38.9206199646, output_fired_time: 14.6577997208, propagate_forward_time: 716.3364868164, propagate_backward_time: 1165.1206054688, weight_update_time: 0.5872239470, other_time: 31.7619628906
epoch time: 159.6076812744s, input_fired_time: 2.7993712425, output_fired_time: 0.0000000000, propagate_forward_time: 150.6115570068, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1967468262
validation[          , genome  5904] predictions:    6366/  10000 (63.66%), best:    6560/10000 (65.60%), error:     10520.62207, best error:     10044.59082 on epoch:     0, epoch:   23/25, mu: 0.9087994099, learning_rate: 0.0000370022, weight_decay: 0.0000535358

epoch time: 1946.9799804688s, input_fired_time: 38.2924728394, output_fired_time: 14.6377458572, propagate_forward_time: 710.4989624023, propagate_backward_time: 1151.2910156250, weight_update_time: 0.5152518153, other_time: 32.2597656250
epoch time: 138.2072143555s, input_fired_time: 2.5165321827, output_fired_time: 0.0000000000, propagate_forward_time: 130.4754791260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2152099609
validation[          , genome  5904] predictions:    6386/  10000 (63.86%), best:    6560/10000 (65.60%), error:     10529.50098, best error:     10044.59082 on epoch:     0, epoch:   24/25, mu: 0.9148512483, learning_rate: 0.0000345536, weight_decay: 0.0000502230

epoch time: 1748.5880126953s, input_fired_time: 33.6210594177, output_fired_time: 12.8123550415, propagate_forward_time: 642.9344482422, propagate_backward_time: 1031.6007080078, weight_update_time: 0.4827071130, other_time: 27.6193847656
epoch time: 135.2156829834s, input_fired_time: 2.4621415138, output_fired_time: 0.0000000000, propagate_forward_time: 127.8694915771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8840484619
validation[          , genome  5904] predictions:    6386/  10000 (63.86%), best:    6560/10000 (65.60%), error:     10600.20410, best error:     10044.59082 on epoch:     0, epoch:   25/25, mu: 0.9204519987, learning_rate: 0.0000322671, weight_decay: 0.0000471152

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 700.1198120117s, input_fired_time: 12.6927366257, output_fired_time: 0.0000000000, propagate_forward_time: 661.2323608398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 26.1947021484
best training[          , genome  5904] predictions:   36771/  50000 (73.54%), best:    6560/10000 (65.60%), error:     40919.45703, best error:     10044.59082 on epoch:     0, epoch:   26/25, mu: 0.9256353378, learning_rate: 0.0000301319, weight_decay: 0.0000441998
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 154.1780700684s, input_fired_time: 2.8985598087, output_fired_time: 0.0000000000, propagate_forward_time: 145.1256256104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1538848877
   testing[          , genome  5904] predictions:    6560/  10000 (65.60%), best:    6560/10000 (65.60%), error:     10044.59082, best error:     10044.59082 on epoch:     0, epoch:   26/25, mu: 0.9256353378, learning_rate: 0.0000301319, weight_decay: 0.0000441998
backpropagation finished successfully!
02:15:58 (2804): called boinc_finish(0)

</stderr_txt>
]]>