Nameexact_genome_1542031203_172_5642_2
Workunit4082598
Created3 Dec 2018, 3:57:19 UTC
Sent3 Dec 2018, 3:57:21 UTC
Report deadline23 Dec 2018, 10:35:07 UTC
Received3 Dec 2018, 11:28:30 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID21895
Run time5 hours 10 min 29 sec
CPU time5 hours 7 min 24 sec
Validate stateValid
Credit5,069.06
Device peak FLOPS4.29 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size551.63 MB
Peak swap size549.91 MB
Peak disk usage11.10 MB

Stderr output

<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
g_rate: 0.0000042240, weight_decay: 0.0001034791

epoch time: 623.5696411133s, input_fired_time: 14.4954090118, output_fired_time: 5.1667590141, propagate_forward_time: 226.6414337158, propagate_backward_time: 368.0901794434, weight_update_time: 0.2904996574, other_time: 9.1758728027
epoch time: 48.0652465820s, input_fired_time: 0.9433227181, output_fired_time: 0.0000000000, propagate_forward_time: 45.6287574768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4931678772
validation[          , genome  5642] predictions:    6159/  10000 (61.59%), best:    6327/10000 (63.27%), error:     12645.91309, best error:     10808.38477 on epoch:     0, epoch:   14/25, mu: 0.8179010749, learning_rate: 0.0000039531, weight_decay: 0.0000971971

epoch time: 622.7059326172s, input_fired_time: 14.4796962738, output_fired_time: 5.1628961563, propagate_forward_time: 226.4149627686, propagate_backward_time: 367.5052795410, weight_update_time: 0.2898343205, other_time: 9.1430969238
epoch time: 48.0991516113s, input_fired_time: 0.9417036772, output_fired_time: 0.0000000000, propagate_forward_time: 45.6688385010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4886093140
validation[          , genome  5642] predictions:    6130/  10000 (61.30%), best:    6327/10000 (63.27%), error:     12697.55078, best error:     10808.38477 on epoch:     0, epoch:   15/25, mu: 0.8300113678, learning_rate: 0.0000036995, weight_decay: 0.0000912964

epoch time: 622.7717285156s, input_fired_time: 14.4714984894, output_fired_time: 5.1642789841, propagate_forward_time: 226.3749542236, propagate_backward_time: 367.6065673828, weight_update_time: 0.2894477546, other_time: 9.1544189453
epoch time: 48.0660095215s, input_fired_time: 0.9390997887, output_fired_time: 0.0000000000, propagate_forward_time: 45.6330299377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4938812256
validation[          , genome  5642] predictions:    6113/  10000 (61.13%), best:    6327/10000 (63.27%), error:     12734.62012, best error:     10808.38477 on epoch:     0, epoch:   16/25, mu: 0.8412694335, learning_rate: 0.0000034622, weight_decay: 0.0000857540

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.851735
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 3.24015e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 8.0548e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 17
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1816061846'
read generator: 1816061846
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 689.605590820313s, input_fired_time: 14.5842924118042, output_fired_time: 5.17944812774658, propagate_forward_time: 249.094497680664, propagate_backward_time: 411.433349609375, weight_update_time: 0.302905678749084, other_time: 9.31402587890625
epoch time: 48.0230140686035s, input_fired_time: 0.936862945556641, output_fired_time: 0, propagate_forward_time: 45.5932426452637, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.4929084777832
validation[          , genome  5642] predictions:    6078/  10000 (60.78%), best:    6327/10000 (63.27%), error:     12784.18750, best error:     10808.38477 on epoch:     0, epoch:   17/25, mu: 0.8517352939, learning_rate: 0.0000032401, weight_decay: 0.0000805480

epoch time: 621.9674072266s, input_fired_time: 14.4575948715, output_fired_time: 5.1163034439, propagate_forward_time: 226.1574554443, propagate_backward_time: 367.1035461426, weight_update_time: 0.2895641625, other_time: 9.1324768066
epoch time: 48.0102424622s, input_fired_time: 0.9340826273, output_fired_time: 0.0000000000, propagate_forward_time: 45.5684013367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5077590942
validation[          , genome  5642] predictions:    6070/  10000 (60.70%), best:    6327/10000 (63.27%), error:     12827.45801, best error:     10808.38477 on epoch:     0, epoch:   18/25, mu: 0.8614647388, learning_rate: 0.0000030323, weight_decay: 0.0000756581

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.87051
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 2.83782e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 7.1065e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '1629762179'
read generator: 1629762179
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 627.482116699219s, input_fired_time: 14.5825719833374, output_fired_time: 5.17282915115356, propagate_forward_time: 228.190689086914, propagate_backward_time: 370.294067382813, weight_update_time: 0.293277204036713, other_time: 9.241943359375
epoch time: 48.0210151672363s, input_fired_time: 0.935861885547638, output_fired_time: 0, propagate_forward_time: 45.5863723754883, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.498779296875
validation[          , genome  5642] predictions:    6060/  10000 (60.60%), best:    6327/10000 (63.27%), error:     12879.98535, best error:     10808.38477 on epoch:     0, epoch:   19/25, mu: 0.8705095053, learning_rate: 0.0000028378, weight_decay: 0.0000710650

epoch time: 621.9385375977s, input_fired_time: 14.4399652481, output_fired_time: 5.1198430061, propagate_forward_time: 226.0673675537, propagate_backward_time: 367.1632385254, weight_update_time: 0.2915833592, other_time: 9.1481018066
epoch time: 48.0432548523s, input_fired_time: 0.9353559613, output_fired_time: 0.0000000000, propagate_forward_time: 45.6133689880, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4945297241
validation[          , genome  5642] predictions:    6042/  10000 (60.42%), best:    6327/10000 (63.27%), error:     12883.04590, best error:     10808.38477 on epoch:     0, epoch:   20/25, mu: 0.8789178133, learning_rate: 0.0000026558, weight_decay: 0.0000667508

epoch time: 628.1998901367s, input_fired_time: 14.5882978439, output_fired_time: 5.1775598526, propagate_forward_time: 228.4482116699, propagate_backward_time: 370.7349243164, weight_update_time: 0.2936069071, other_time: 9.2508850098
epoch time: 48.1270217896s, input_fired_time: 0.9448228478, output_fired_time: 0.0000000000, propagate_forward_time: 45.6382827759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5439147949
validation[          , genome  5642] predictions:    6048/  10000 (60.48%), best:    6327/10000 (63.27%), error:     12897.40039, best error:     10808.38477 on epoch:     0, epoch:   21/25, mu: 0.8867344260, learning_rate: 0.0000024854, weight_decay: 0.0000626985

epoch time: 621.9128417969s, input_fired_time: 14.4532909393, output_fired_time: 5.1247591972, propagate_forward_time: 226.1382598877, propagate_backward_time: 367.0718688965, weight_update_time: 0.2895509899, other_time: 9.1246643066
epoch time: 48.0390777588s, input_fired_time: 0.9326698780, output_fired_time: 0.0000000000, propagate_forward_time: 45.6118621826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4945449829
validation[          , genome  5642] predictions:    6002/  10000 (60.02%), best:    6327/10000 (63.27%), error:     12939.12988, best error:     10808.38477 on epoch:     0, epoch:   22/25, mu: 0.8940010071, learning_rate: 0.0000023260, weight_decay: 0.0000588922

epoch time: 621.9746093750s, input_fired_time: 14.4382009506, output_fired_time: 5.1207914352, propagate_forward_time: 226.1255035400, propagate_backward_time: 367.1473999023, weight_update_time: 0.2898670137, other_time: 9.1427612305
epoch time: 47.9532356262s, input_fired_time: 0.9297502041, output_fired_time: 0.0000000000, propagate_forward_time: 45.5323295593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4911575317
validation[          , genome  5642] predictions:    6003/  10000 (60.03%), best:    6327/10000 (63.27%), error:     12911.21387, best error:     10808.38477 on epoch:     0, epoch:   23/25, mu: 0.9007562399, learning_rate: 0.0000021768, weight_decay: 0.0000553169

epoch time: 621.9457397461s, input_fired_time: 14.4209175110, output_fired_time: 5.1236233711, propagate_forward_time: 226.0917816162, propagate_backward_time: 367.1774597168, weight_update_time: 0.2902471721, other_time: 9.1319885254
epoch time: 48.0055694580s, input_fired_time: 0.9284926653, output_fired_time: 0.0000000000, propagate_forward_time: 45.5854644775, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4916114807
validation[          , genome  5642] predictions:    5974/  10000 (59.74%), best:    6327/10000 (63.27%), error:     12966.49805, best error:     10808.38477 on epoch:     0, epoch:   24/25, mu: 0.9070361257, learning_rate: 0.0000020372, weight_decay: 0.0000519587

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.912874
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 1.90652e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 4.88044e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 25
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '371175528'
read generator: 371175528
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 841.260803222656s, input_fired_time: 14.5352516174316, output_fired_time: 5.19731712341309, propagate_forward_time: 442.652008056641, propagate_backward_time: 369.610717773438, weight_update_time: 0.292942374944687, other_time: 9.26547241210938
epoch time: 48.0568923950195s, input_fired_time: 0.931904137134552, output_fired_time: 0, propagate_forward_time: 45.6062393188477, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.51874923706055
validation[          , genome  5642] predictions:    5981/  10000 (59.81%), best:    6327/10000 (63.27%), error:     12895.32715, best error:     10808.38477 on epoch:     0, epoch:   25/25, mu: 0.9128741026, learning_rate: 0.0000019065, weight_decay: 0.0000488044

evaluating best weights on full training data.
evaluting training set with running mean/variance:
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_172_5642_2_r809975622_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512005
read mu: 0.918301
read mu_delta: 0.929632
read initial_learning_rate: 1e-05
read learning_rate: 1.78423e-06
read learning_rate_delta: 0.935857
read initial_weight_decay: 0.000233586
read weight_decay: 4.58416e-05
read weight_decay_delta: 0.939292
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0955083
read input_dropout_probability: 0.00135638
read hidden_dropout_probability: 0.0818286
read velocity_reset: 1983
read epoch: 26
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6327
read best_validation_error: 10808.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5642
read normal distribution: '1 0 0'
generator_str: '941183362'
read generator: 941183362
read generated_by_map:
1 enable_edge 1
reading 84 nodes.
reading 342 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 626.026306152344s, input_fired_time: 14.5134296417236, output_fired_time: 5.1864972114563, propagate_forward_time: 227.865493774414, propagate_backward_time: 369.255279541016, weight_update_time: 0.291525095701218, other_time: 9.20559692382813
epoch time: 48.0829925537109s, input_fired_time: 0.935973405838013, output_fired_time: 0, propagate_forward_time: 45.6544036865234, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.49261474609375
validation[          , genome  5642] predictions:    6002/  10000 (60.02%), best:    6327/10000 (63.27%), error:     12888.06348, best error:     10808.38477 on epoch:     0, epoch:   26/25, mu: 0.9183012843, learning_rate: 0.0000017842, weight_decay: 0.0000458416

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 238.4418029785s, input_fired_time: 4.7057609558, output_fired_time: 0.0000000000, propagate_forward_time: 226.2655487061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4704895020
best training[          , genome  5642] predictions:   35474/  50000 (70.95%), best:    6327/10000 (63.27%), error:     44892.27344, best error:     10808.38477 on epoch:     0, epoch:   27/25, mu: 0.9233465791, learning_rate: 0.0000016698, weight_decay: 0.0000430586
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 48.0882263184s, input_fired_time: 0.9450939894, output_fired_time: 0.0000000000, propagate_forward_time: 45.6489143372, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4942169189
   testing[          , genome  5642] predictions:    6327/  10000 (63.27%), best:    6327/10000 (63.27%), error:     10808.38477, best error:     10808.38477 on epoch:     0, epoch:   27/25, mu: 0.9233465791, learning_rate: 0.0000016698, weight_decay: 0.0000430586
backpropagation finished successfully!
04:27:56 (10072): called boinc_finish(0)

</stderr_txt>
]]>