Nameexact_genome_1542031203_179_5587_1
Workunit4081322
Created12 Nov 2018, 18:33:20 UTC
Sent12 Nov 2018, 18:40:59 UTC
Report deadline2 Jan 2019, 1:20:47 UTC
Received13 Nov 2018, 22:17:47 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID10687
Run time21 hours 13 min 44 sec
CPU time20 hours 26 min 47 sec
Validate stateValid
Credit12,569.41
Device peak FLOPS4.48 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size550.86 MB
Peak swap size549.12 MB
Peak disk usage13.88 MB

Stderr output

<core_client_version>7.4.42</core_client_version>
<![CDATA[
<stderr_txt>
es.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.890869
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 7.49672e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 2.33776e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 39
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 37
read number_validation_images: 10000
read best_validation_predictions: 6469
read best_validation_error: 10509.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '1462262743'
read generator: 1462262743
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.890869
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 7.49672e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 2.33776e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 39
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 37
read number_validation_images: 10000
read best_validation_predictions: 6469
read best_validation_error: 10509.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '1462262743'
read generator: 1462262743
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.890869
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 7.49672e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 2.33776e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 39
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 37
read number_validation_images: 10000
read best_validation_predictions: 6469
read best_validation_error: 10509.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '1462262743'
read generator: 1462262743
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1452.52331542969s, input_fired_time: 24.9608745574951, output_fired_time: 8.77950668334961, propagate_forward_time: 544.190490722656, propagate_backward_time: 859.851684570313, weight_update_time: 0.524563908576965, other_time: 14.7407836914063
epoch time: 109.408409118652s, input_fired_time: 1.60994791984558, output_fired_time: 0, propagate_forward_time: 105.397323608398, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.40113830566406
validation[          , genome  5587] predictions:    6437/  10000 (64.37%), best:    6469/10000 (64.69%), error:     10601.91602, best error:     10509.25000 on epoch:    37, epoch:   39/50, mu: 0.8908690810, learning_rate: 0.0000074967, weight_decay: 0.0000233776

epoch time: 1416.2788085938s, input_fired_time: 25.8553123474, output_fired_time: 9.0607900620, propagate_forward_time: 530.2998657227, propagate_backward_time: 836.0984497070, weight_update_time: 0.5078261495, other_time: 14.9643554688
epoch time: 109.8822021484s, input_fired_time: 1.5217349529, output_fired_time: 0.0000000000, propagate_forward_time: 105.8382797241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5221862793
validation[          , genome  5587] predictions:    6487/  10000 (64.87%), best:    6487/10000 (64.87%), error:     10485.78223, best error:     10485.78223 on epoch:    40, epoch:   40/50, mu: 0.8948304653, learning_rate: 0.0000068457, weight_decay: 0.0000217491

epoch time: 1407.0192871094s, input_fired_time: 25.2482872009, output_fired_time: 9.0028228760, propagate_forward_time: 525.8802490234, propagate_backward_time: 832.3430786133, weight_update_time: 0.5647624731, other_time: 14.5448608398
epoch time: 108.6432266235s, input_fired_time: 1.5367381573, output_fired_time: 0.0000000000, propagate_forward_time: 104.6864395142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4200515747
validation[          , genome  5587] predictions:    6448/  10000 (64.48%), best:    6487/10000 (64.87%), error:     10522.18652, best error:     10485.78223 on epoch:    40, epoch:   41/50, mu: 0.8986335397, learning_rate: 0.0000062513, weight_decay: 0.0000202340

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.902285
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 5.70844e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.88245e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 42
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 6487
read best_validation_error: 10485.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '1434280058'
read generator: 1434280058
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1497.29211425781s, input_fired_time: 26.516056060791, output_fired_time: 9.28519916534424, propagate_forward_time: 555.622924804688, propagate_backward_time: 889.725036621094, weight_update_time: 0.53873872756958, other_time: 16.1428833007813
epoch time: 108.33536529541s, input_fired_time: 1.55147206783295, output_fired_time: 0, propagate_forward_time: 104.329658508301, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.45423126220703
validation[          , genome  5587] predictions:    6368/  10000 (63.68%), best:    6487/10000 (64.87%), error:     10614.73926, best error:     10485.78223 on epoch:    40, epoch:   42/50, mu: 0.9022846222, learning_rate: 0.0000057084, weight_decay: 0.0000188245

epoch time: 1399.8597412109s, input_fired_time: 25.0148677826, output_fired_time: 8.9190521240, propagate_forward_time: 519.0488891602, propagate_backward_time: 832.3220825195, weight_update_time: 0.6465637684, other_time: 14.5548095703
epoch time: 107.0207519531s, input_fired_time: 1.5249774456, output_fired_time: 0.0000000000, propagate_forward_time: 103.1878585815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3079147339
validation[          , genome  5587] predictions:    6459/  10000 (64.59%), best:    6459/10000 (64.59%), error:     10460.83398, best error:     10460.83398 on epoch:    43, epoch:   43/50, mu: 0.9057897925, learning_rate: 0.0000052127, weight_decay: 0.0000175131

epoch time: 1372.5603027344s, input_fired_time: 24.5347766876, output_fired_time: 8.7668685913, propagate_forward_time: 510.1973876953, propagate_backward_time: 814.6884765625, weight_update_time: 0.4975861311, other_time: 14.3728027344
epoch time: 104.9482574463s, input_fired_time: 1.5033527613, output_fired_time: 0.0000000000, propagate_forward_time: 101.0511169434, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3937911987
validation[          , genome  5587] predictions:    6419/  10000 (64.19%), best:    6459/10000 (64.59%), error:     10561.50977, best error:     10460.83398 on epoch:    43, epoch:   44/50, mu: 0.9091548920, learning_rate: 0.0000047601, weight_decay: 0.0000162931

epoch time: 1391.7730712891s, input_fired_time: 24.7014656067, output_fired_time: 8.7845687866, propagate_forward_time: 523.4196166992, propagate_backward_time: 819.8467407227, weight_update_time: 0.4826431572, other_time: 15.0207519531
epoch time: 109.5344390869s, input_fired_time: 1.4909211397, output_fired_time: 0.0000000000, propagate_forward_time: 105.5114822388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5320358276
validation[          , genome  5587] predictions:    6466/  10000 (64.66%), best:    6466/10000 (64.66%), error:     10455.54395, best error:     10455.54395 on epoch:    45, epoch:   45/50, mu: 0.9123855233, learning_rate: 0.0000043467, weight_decay: 0.0000151581

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.915487
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.96929e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.41022e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 46
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6466
read best_validation_error: 10455.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '893121473'
read generator: 893121473
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1358.06091308594s, input_fired_time: 24.2625885009766, output_fired_time: 8.66252994537354, propagate_forward_time: 512.62744140625, propagate_backward_time: 798.055236816406, weight_update_time: 0.489161342382431, other_time: 14.4531860351563
epoch time: 112.985549926758s, input_fired_time: 1.50024890899658, output_fired_time: 0, propagate_forward_time: 109.096519470215, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.38877868652344
validation[          , genome  5587] predictions:    6461/  10000 (64.61%), best:    6466/10000 (64.66%), error:     10456.46582, best error:     10455.54395 on epoch:    45, epoch:   46/50, mu: 0.9154870510, learning_rate: 0.0000039693, weight_decay: 0.0000141022

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.918465
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.62461e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.31198e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 47
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6466
read best_validation_error: 10455.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '423602757'
read generator: 423602757
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1343.92822265625s, input_fired_time: 24.2736263275146, output_fired_time: 8.47618389129639, propagate_forward_time: 499.634765625, propagate_backward_time: 797.088012695313, weight_update_time: 0.470199882984161, other_time: 14.45556640625
epoch time: 108.358291625977s, input_fired_time: 1.49919927120209, output_fired_time: 0, propagate_forward_time: 104.460624694824, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.39846801757813
validation[          , genome  5587] predictions:    6371/  10000 (63.71%), best:    6466/10000 (64.66%), error:     10671.62793, best error:     10455.54395 on epoch:    45, epoch:   47/50, mu: 0.9184646606, learning_rate: 0.0000036246, weight_decay: 0.0000131198

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.921323
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.30986e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.22059e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 48
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6466
read best_validation_error: 10455.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '717510049'
read generator: 717510049
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.921323
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.30986e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.22059e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 48
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6466
read best_validation_error: 10455.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '717510049'
read generator: 717510049
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.921323
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.30986e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.22059e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 48
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6466
read best_validation_error: 10455.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '717510049'
read generator: 717510049
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.921323
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.30986e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.22059e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 48
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 45
read number_validation_images: 10000
read best_validation_predictions: 6466
read best_validation_error: 10455.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '717510049'
read generator: 717510049
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1343.13940429688s, input_fired_time: 23.9948863983154, output_fired_time: 8.63178062438965, propagate_forward_time: 509.611511230469, propagate_backward_time: 786.474548339844, weight_update_time: 0.499964952468872, other_time: 14.4266357421875
epoch time: 107.598243713379s, input_fired_time: 1.49534201622009, output_fired_time: 0, propagate_forward_time: 103.727462768555, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.37544250488281
validation[          , genome  5587] predictions:    6512/  10000 (65.12%), best:    6512/10000 (65.12%), error:     10350.87109, best error:     10350.87109 on epoch:    48, epoch:   48/50, mu: 0.9213232994, learning_rate: 0.0000033099, weight_decay: 0.0000122059

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_179_5587_1_r1026365975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.503657
read mu: 0.924068
read mu_delta: 0.960039
read initial_learning_rate: 0.000259101
read learning_rate: 3.02245e-06
read learning_rate_delta: 0.913164
read initial_weight_decay: 0.00039066
read weight_decay: 1.13556e-05
read weight_decay_delta: 0.930339
read batch_size: 100
read epsilon: 1e-07
read alpha: 0.134752
read input_dropout_probability: 0.00137721
read hidden_dropout_probability: 0.0825527
read velocity_reset: 1993
read epoch: 49
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 48
read number_validation_images: 10000
read best_validation_predictions: 6512
read best_validation_error: 10350.9
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5587
read normal distribution: '0 -0.424430876970291 -0.741835951805115'
generator_str: '2060954141'
read generator: 2060954141
read generated_by_map:
1 split_edge 1
reading 92 nodes.
reading 490 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1340.193359375s, input_fired_time: 24.0378894805908, output_fired_time: 8.48868179321289, propagate_forward_time: 503.166412353516, propagate_backward_time: 790.300903320313, weight_update_time: 0.486592292785645, other_time: 14.1995849609375
epoch time: 104.276588439941s, input_fired_time: 1.48177850246429, output_fired_time: 0, propagate_forward_time: 100.518974304199, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.27583312988281
validation[          , genome  5587] predictions:    6485/  10000 (64.85%), best:    6512/10000 (65.12%), error:     10428.33789, best error:     10350.87109 on epoch:    48, epoch:   49/50, mu: 0.9240676761, learning_rate: 0.0000030224, weight_decay: 0.0000113556

epoch time: 1361.8302001953s, input_fired_time: 24.2900619507, output_fired_time: 8.7487535477, propagate_forward_time: 509.1942443848, propagate_backward_time: 805.2550048828, weight_update_time: 0.5549319983, other_time: 14.3421630859
epoch time: 105.0601654053s, input_fired_time: 1.4930418730, output_fired_time: 0.0000000000, propagate_forward_time: 101.1691589355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3979644775
validation[          , genome  5587] predictions:    6524/  10000 (65.24%), best:    6512/10000 (65.12%), error:     10396.49023, best error:     10350.87109 on epoch:    48, epoch:   50/50, mu: 0.9267023802, learning_rate: 0.0000027600, weight_decay: 0.0000105646

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 524.4908447266s, input_fired_time: 7.5208048820, output_fired_time: 0.0000000000, propagate_forward_time: 505.1698303223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.8002014160
best training[          , genome  5587] predictions:   34112/  50000 (68.22%), best:    6512/10000 (65.12%), error:     48784.15234, best error:     10350.87109 on epoch:    48, epoch:   51/50, mu: 0.9292318225, learning_rate: 0.0000025203, weight_decay: 0.0000098286
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 105.0193176270s, input_fired_time: 1.4747087955, output_fired_time: 0.0000000000, propagate_forward_time: 101.2171783447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3274307251
   testing[          , genome  5587] predictions:    6512/  10000 (65.12%), best:    6512/10000 (65.12%), error:     10350.87109, best error:     10350.87109 on epoch:    48, epoch:   51/50, mu: 0.9292318225, learning_rate: 0.0000025203, weight_decay: 0.0000098286
backpropagation finished successfully!
08:34:13 (3168): called boinc_finish(0)

</stderr_txt>
]]>