Nameexact_genome_1542414603_173_6157_0
Workunit4094977
Created17 Nov 2018, 8:19:38 UTC
Sent17 Nov 2018, 8:48:43 UTC
Report deadline28 Dec 2018, 2:21:39 UTC
Received26 Nov 2018, 12:45:06 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID84491
Run time14 hours 29 min 53 sec
CPU time14 hours 18 min 7 sec
Validate stateValid
Credit10,182.80
Device peak FLOPS3.37 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
h time: 4865.13232421875s, input_fired_time: 51.6793060302734, output_fired_time: 41.4555244445801, propagate_forward_time: 1792.95153808594, propagate_backward_time: 2949.61840820313, weight_update_time: 0.335608750581741, other_time: 29.427490234375
epoch time: 365.837219238281s, input_fired_time: 1.64438414573669, output_fired_time: 0, propagate_forward_time: 360.105010986328, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.08782958984375
validation[          , genome  6157] predictions:    6446/  10000 (64.46%), best:    6463/10000 (64.63%), error:     10449.00293, best error:     10303.84961 on epoch:     1, epoch:    2/25, mu: 0.5757922530, learning_rate: 0.0003189811, weight_decay: 0.0002726699

epoch time: 4702.2880859375s, input_fired_time: 56.4717102051, output_fired_time: 23.6630783081, propagate_forward_time: 1714.5766601563, propagate_backward_time: 2873.5925292969, weight_update_time: 2.3338310719, other_time: 33.9841308594
epoch time: 366.8822937012s, input_fired_time: 3.6629393101, output_fired_time: 0.0000000000, propagate_forward_time: 357.1170349121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1023254395
validation[          , genome  6157] predictions:    6138/  10000 (61.38%), best:    6463/10000 (64.63%), error:     11190.24512, best error:     10303.84961 on epoch:     1, epoch:    3/25, mu: 0.5881027579, learning_rate: 0.0002919220, weight_decay: 0.0002493192

epoch time: 4928.4423828125s, input_fired_time: 56.4127655029, output_fired_time: 24.8483619690, propagate_forward_time: 1724.0526123047, propagate_backward_time: 3088.7294921875, weight_update_time: 0.3404285908, other_time: 34.3994140625
epoch time: 344.7481079102s, input_fired_time: 2.5850133896, output_fired_time: 0.0000000000, propagate_forward_time: 332.0956726074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.0674133301
validation[          , genome  6157] predictions:    6395/  10000 (63.95%), best:    6463/10000 (64.63%), error:     10653.05176, best error:     10303.84961 on epoch:     1, epoch:    4/25, mu: 0.6000473499, learning_rate: 0.0002671583, weight_decay: 0.0002279681

epoch time: 4747.4223632813s, input_fired_time: 47.6185951233, output_fired_time: 28.5424346924, propagate_forward_time: 1769.1773681641, propagate_backward_time: 2869.8305664063, weight_update_time: 2.3453717232, other_time: 32.2534179688
epoch time: 371.0946044922s, input_fired_time: 9.6522579193, output_fired_time: 0.0000000000, propagate_forward_time: 356.3515319824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0908203125
validation[          , genome  6157] predictions:    6248/  10000 (62.48%), best:    6463/10000 (64.63%), error:     10926.34375, best error:     10303.84961 on epoch:     1, epoch:    5/25, mu: 0.6116369367, learning_rate: 0.0002444953, weight_decay: 0.0002084455

epoch time: 4748.6943359375s, input_fired_time: 73.6690216064, output_fired_time: 26.5120658875, propagate_forward_time: 1695.8375244141, propagate_backward_time: 2917.4040527344, weight_update_time: 0.3278084397, other_time: 35.2717285156
epoch time: 370.2969055176s, input_fired_time: 5.7026867867, output_fired_time: 0.0000000000, propagate_forward_time: 359.3576354980, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2365722656
validation[          , genome  6157] predictions:    6211/  10000 (62.11%), best:    6463/10000 (64.63%), error:     10889.29688, best error:     10303.84961 on epoch:     1, epoch:    6/25, mu: 0.6228820682, learning_rate: 0.0002237549, weight_decay: 0.0001905948

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.633793
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 0.000204774
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 0.000174273
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 7
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '813468857'
read generator: 813468857
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4718.5556640625s, input_fired_time: 58.6238784790039, output_fired_time: 26.5823135375977, propagate_forward_time: 1740.7744140625, propagate_backward_time: 2864.27880859375, weight_update_time: 1.26548445224762, other_time: 28.2958984375
epoch time: 342.130737304688s, input_fired_time: 1.60352754592896, output_fired_time: 0, propagate_forward_time: 334.517364501953, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.00985717773438
validation[          , genome  6157] predictions:    6291/  10000 (62.91%), best:    6463/10000 (64.63%), error:     10873.58008, best error:     10303.84961 on epoch:     1, epoch:    7/25, mu: 0.6337929964, learning_rate: 0.0002047738, weight_decay: 0.0001742728

epoch time: 4587.3349609375s, input_fired_time: 55.7926292419, output_fired_time: 24.2801494598, propagate_forward_time: 1662.2674560547, propagate_backward_time: 2821.2436523438, weight_update_time: 0.3112668991, other_time: 23.7509765625
epoch time: 352.4252014160s, input_fired_time: 1.6135814190, output_fired_time: 0.0000000000, propagate_forward_time: 345.8193359375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9922790527
validation[          , genome  6157] predictions:    6177/  10000 (61.77%), best:    6463/10000 (64.63%), error:     11214.83203, best error:     10303.84961 on epoch:     1, epoch:    8/25, mu: 0.6443796754, learning_rate: 0.0001874029, weight_decay: 0.0001593485

epoch time: 4792.0234375000s, input_fired_time: 64.7699203491, output_fired_time: 25.7088165283, propagate_forward_time: 1743.0733642578, propagate_backward_time: 2927.3586425781, weight_update_time: 0.3322411180, other_time: 31.1125488281
epoch time: 348.9634399414s, input_fired_time: 3.6175258160, output_fired_time: 0.0000000000, propagate_forward_time: 338.3729248047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9729919434
validation[          , genome  6157] predictions:    6257/  10000 (62.57%), best:    6463/10000 (64.63%), error:     11021.13281, best error:     10303.84961 on epoch:     1, epoch:    9/25, mu: 0.6546517015, learning_rate: 0.0001715055, weight_decay: 0.0001457023

epoch time: 4689.4389648438s, input_fired_time: 51.4695472717, output_fired_time: 24.4614391327, propagate_forward_time: 1709.2681884766, propagate_backward_time: 2875.8293457031, weight_update_time: 1.3227382898, other_time: 28.4104003906
epoch time: 348.3348999023s, input_fired_time: 8.6404294968, output_fired_time: 0.0000000000, propagate_forward_time: 334.7390747070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9553833008
validation[          , genome  6157] predictions:    6315/  10000 (63.15%), best:    6463/10000 (64.63%), error:     10830.09766, best error:     10303.84961 on epoch:     1, epoch:   10/25, mu: 0.6646184325, learning_rate: 0.0001569568, weight_decay: 0.0001332247

epoch time: 4671.8803710938s, input_fired_time: 48.3615760803, output_fired_time: 33.4430351257, propagate_forward_time: 1717.9868164063, propagate_backward_time: 2846.9084472656, weight_update_time: 0.3148683608, other_time: 25.1804199219
epoch time: 353.0856628418s, input_fired_time: 4.6304221153, output_fired_time: 0.0000000000, propagate_forward_time: 342.4503784180, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0048522949
validation[          , genome  6157] predictions:    6246/  10000 (62.46%), best:    6463/10000 (64.63%), error:     10890.22656, best error:     10303.84961 on epoch:     1, epoch:   11/25, mu: 0.6742889285, learning_rate: 0.0001436422, weight_decay: 0.0001218157

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.683672
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 0.000131457
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 0.000111384
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 12
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.683672
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 0.000131457
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 0.000111384
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 12
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '775890536'
read generator: 775890536
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4780.9091796875s, input_fired_time: 54.518196105957, output_fired_time: 20.7333889007568, propagate_forward_time: 1766.42687988281, propagate_backward_time: 2905.46337890625, weight_update_time: 0.316197067499161, other_time: 33.767578125
epoch time: 348.643768310547s, input_fired_time: 6.56828641891479, output_fired_time: 0, propagate_forward_time: 339.109191894531, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.96627807617188
validation[          , genome  6157] predictions:    6107/  10000 (61.07%), best:    6463/10000 (64.63%), error:     11333.14160, best error:     10303.84961 on epoch:     1, epoch:   12/25, mu: 0.6836720109, learning_rate: 0.0001314570, weight_decay: 0.0001113837

epoch time: 4713.9873046875s, input_fired_time: 51.5344429016, output_fired_time: 23.5123157501, propagate_forward_time: 1728.4167480469, propagate_backward_time: 2881.9699707031, weight_update_time: 1.3231251240, other_time: 28.5537109375
epoch time: 368.0091552734s, input_fired_time: 11.6922836304, output_fired_time: 0.0000000000, propagate_forward_time: 352.1756896973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1411743164
validation[          , genome  6157] predictions:    6187/  10000 (61.87%), best:    6463/10000 (64.63%), error:     11097.13477, best error:     10303.84961 on epoch:     1, epoch:   13/25, mu: 0.6927762628, learning_rate: 0.0001203056, weight_decay: 0.0001018451

epoch time: 4701.0078125000s, input_fired_time: 54.3835792542, output_fired_time: 21.4469184875, propagate_forward_time: 1702.6026611328, propagate_backward_time: 2898.3994140625, weight_update_time: 0.3260072470, other_time: 24.1752929688
epoch time: 350.3414001465s, input_fired_time: 3.5089340210, output_fired_time: 0.0000000000, propagate_forward_time: 344.8110046387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0214538574
validation[          , genome  6157] predictions:    6237/  10000 (62.37%), best:    6463/10000 (64.63%), error:     10937.05762, best error:     10303.84961 on epoch:     1, epoch:   14/25, mu: 0.7016099095, learning_rate: 0.0001101001, weight_decay: 0.0000931234

epoch time: 4675.7915039063s, input_fired_time: 59.1385498047, output_fired_time: 20.3909091949, propagate_forward_time: 1730.8287353516, propagate_backward_time: 2850.8605957031, weight_update_time: 0.3116562963, other_time: 14.5725097656
epoch time: 345.4105224609s, input_fired_time: 1.5871282816, output_fired_time: 0.0000000000, propagate_forward_time: 341.8633728027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9600219727
validation[          , genome  6157] predictions:    6368/  10000 (63.68%), best:    6463/10000 (64.63%), error:     10590.72754, best error:     10303.84961 on epoch:     1, epoch:   15/25, mu: 0.7101809978, learning_rate: 0.0001007603, weight_decay: 0.0000851485

epoch time: 4671.0815429688s, input_fired_time: 47.3664703369, output_fired_time: 27.4421386719, propagate_forward_time: 1719.9630126953, propagate_backward_time: 2846.8754882813, weight_update_time: 0.3147321045, other_time: 29.4340820313
epoch time: 347.3557128906s, input_fired_time: 3.5900912285, output_fired_time: 0.0000000000, propagate_forward_time: 335.7133483887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0522766113
validation[          , genome  6157] predictions:    6312/  10000 (63.12%), best:    6463/10000 (64.63%), error:     10768.03320, best error:     10303.84961 on epoch:     1, epoch:   16/25, mu: 0.7184973955, learning_rate: 0.0000922128, weight_decay: 0.0000778566

epoch time: 4640.1411132813s, input_fired_time: 70.9656066895, output_fired_time: 21.2697219849, propagate_forward_time: 1667.1601562500, propagate_backward_time: 2856.7148437500, weight_update_time: 0.3071632087, other_time: 24.0307617188
epoch time: 350.9913940430s, input_fired_time: 10.6574363708, output_fired_time: 0.0000000000, propagate_forward_time: 337.3582458496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9757080078
validation[          , genome  6157] predictions:    6334/  10000 (63.34%), best:    6463/10000 (64.63%), error:     10671.66113, best error:     10303.84961 on epoch:     1, epoch:   17/25, mu: 0.7265666127, learning_rate: 0.0000843904, weight_decay: 0.0000711892

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.734396
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 7.72316e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 6.50927e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 18
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '764411860'
read generator: 764411860
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4704.84423828125s, input_fired_time: 64.3445358276367, output_fired_time: 26.5090045928955, propagate_forward_time: 1676.07397460938, propagate_backward_time: 2901.9130859375, weight_update_time: 1.328977227211, other_time: 36.003662109375
epoch time: 384.901580810547s, input_fired_time: 6.77478122711182, output_fired_time: 0, propagate_forward_time: 371.916564941406, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.21023559570313
validation[          , genome  6157] predictions:    6360/  10000 (63.60%), best:    6463/10000 (64.63%), error:     10642.73926, best error:     10303.84961 on epoch:     1, epoch:   18/25, mu: 0.7343959808, learning_rate: 0.0000772316, weight_decay: 0.0000650927

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.741993
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 7.06801e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 5.95184e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '813208237'
read generator: 813208237
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.741993
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 7.06801e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 5.95184e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '813208237'
read generator: 813208237
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.741993
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 7.06801e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 5.95184e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 19
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '813208237'
read generator: 813208237
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4770.8154296875s, input_fired_time: 59.7660636901855, output_fired_time: 32.973804473877, propagate_forward_time: 1743.82116699219, propagate_backward_time: 2894.84228515625, weight_update_time: 2.34244155883789, other_time: 39.412109375
epoch time: 370.438568115234s, input_fired_time: 3.69078230857849, output_fired_time: 0, propagate_forward_time: 363.671112060547, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.07666015625
validation[          , genome  6157] predictions:    6201/  10000 (62.01%), best:    6463/10000 (64.63%), error:     11136.32520, best error:     10303.84961 on epoch:     1, epoch:   19/25, mu: 0.7419926524, learning_rate: 0.0000706801, weight_decay: 0.0000595184

epoch time: 4612.0483398438s, input_fired_time: 62.2117347717, output_fired_time: 33.2574424744, propagate_forward_time: 1676.4079589844, propagate_backward_time: 2809.5061035156, weight_update_time: 0.3102651238, other_time: 30.6650390625
epoch time: 339.1073608398s, input_fired_time: 1.5662267208, output_fired_time: 0.0000000000, propagate_forward_time: 333.5253295898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0158081055
validation[          , genome  6157] predictions:    6230/  10000 (62.30%), best:    6463/10000 (64.63%), error:     10848.00098, best error:     10303.84961 on epoch:     1, epoch:   20/25, mu: 0.7493635416, learning_rate: 0.0000646843, weight_decay: 0.0000544214

epoch time: 4499.6176757813s, input_fired_time: 44.9165954590, output_fired_time: 16.9451122284, propagate_forward_time: 1599.6020507813, propagate_backward_time: 2808.7136230469, weight_update_time: 0.3043186367, other_time: 29.4401855469
epoch time: 322.8817138672s, input_fired_time: 5.5337047577, output_fired_time: 0.0000000000, propagate_forward_time: 313.4213562012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9266662598
validation[          , genome  6157] predictions:    6226/  10000 (62.26%), best:    6463/10000 (64.63%), error:     10969.04492, best error:     10303.84961 on epoch:     1, epoch:   21/25, mu: 0.7565153837, learning_rate: 0.0000591972, weight_decay: 0.0000497609

epoch time: 4475.6635742188s, input_fired_time: 58.4301033020, output_fired_time: 17.9103317261, propagate_forward_time: 1581.3742675781, propagate_backward_time: 2784.3530273438, weight_update_time: 1.2077053785, other_time: 33.5959472656
epoch time: 345.7457885742s, input_fired_time: 1.9015938044, output_fired_time: 0.0000000000, propagate_forward_time: 337.9243469238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.9198608398
validation[          , genome  6157] predictions:    6411/  10000 (64.11%), best:    6463/10000 (64.63%), error:     10458.16211, best error:     10303.84961 on epoch:     1, epoch:   22/25, mu: 0.7634546757, learning_rate: 0.0000541755, weight_decay: 0.0000454995

epoch time: 4291.5288085938s, input_fired_time: 51.3332633972, output_fired_time: 26.2462348938, propagate_forward_time: 1460.6655273438, propagate_backward_time: 2728.6687011719, weight_update_time: 0.2849758267, other_time: 24.6149902344
epoch time: 276.9528198242s, input_fired_time: 1.3875861168, output_fired_time: 0.0000000000, propagate_forward_time: 271.8712463379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6940002441
validation[          , genome  6157] predictions:    6387/  10000 (63.87%), best:    6463/10000 (64.63%), error:     10502.34180, best error:     10303.84961 on epoch:     1, epoch:   23/25, mu: 0.7701877356, learning_rate: 0.0000495798, weight_decay: 0.0000416030

epoch time: 4114.4145507813s, input_fired_time: 57.0841941833, output_fired_time: 21.8314037323, propagate_forward_time: 1362.7064208984, propagate_backward_time: 2658.2260742188, weight_update_time: 0.2708726823, other_time: 14.5664062500
epoch time: 287.1529541016s, input_fired_time: 1.4173041582, output_fired_time: 0.0000000000, propagate_forward_time: 282.0129394531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7227172852
validation[          , genome  6157] predictions:    6358/  10000 (63.58%), best:    6463/10000 (64.63%), error:     10517.14160, best error:     10303.84961 on epoch:     1, epoch:   24/25, mu: 0.7767207026, learning_rate: 0.0000453739, weight_decay: 0.0000380402

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.783059
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 4.15249e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 3.47826e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 25
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '74178885'
read generator: 74178885
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.783059
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 4.15249e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 3.47826e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 25
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '74178885'
read generator: 74178885
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542414603_173_6157_0_r7464425_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.550029
read mu: 0.783059
read mu_delta: 0.970279
read initial_learning_rate: 0.000380856
read learning_rate: 4.15249e-05
read learning_rate_delta: 0.91517
read initial_weight_decay: 0.000326137
read weight_decay: 3.47826e-05
read weight_decay_delta: 0.914363
read batch_size: 123
read epsilon: 1e-07
read alpha: 0.127456
read input_dropout_probability: 0.00167927
read hidden_dropout_probability: 0.0667358
read velocity_reset: 1808
read epoch: 25
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 1
read number_validation_images: 10000
read best_validation_predictions: 6463
read best_validation_error: 10303.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6157
read normal distribution: '1 0 0'
generator_str: '74178885'
read generator: 74178885
read generated_by_map:
1 enable_edge 1
reading 111 nodes.
reading 473 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 4014.85864257813s, input_fired_time: 72.5241317749023, output_fired_time: 27.5345115661621, propagate_forward_time: 1287.56896972656, propagate_backward_time: 2608.99780273438, weight_update_time: 0.263062238693237, other_time: 18.233154296875
epoch time: 220.216033935547s, input_fired_time: 1.21231460571289, output_fired_time: 0, propagate_forward_time: 217.638763427734, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.36495971679688
validation[          , genome  6157] predictions:    6433/  10000 (64.33%), best:    6463/10000 (64.63%), error:     10514.58496, best error:     10303.84961 on epoch:     1, epoch:   25/25, mu: 0.7830594778, learning_rate: 0.0000415249, weight_decay: 0.0000347826

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1217.4764404297s, input_fired_time: 19.5671768188, output_fired_time: 0.0000000000, propagate_forward_time: 1171.2961425781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 26.6131591797
best training[          , genome  6157] predictions:   36189/  50000 (72.38%), best:    6463/10000 (64.63%), error:     42868.77734, best error:     10303.84961 on epoch:     1, epoch:   26/25, mu: 0.7892098427, learning_rate: 0.0000380023, weight_decay: 0.0000318039
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 223.0452117920s, input_fired_time: 8.2616186142, output_fired_time: 0.0000000000, propagate_forward_time: 211.3839416504, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3996582031
   testing[          , genome  6157] predictions:    6463/  10000 (64.63%), best:    6463/10000 (64.63%), error:     10303.84961, best error:     10303.84961 on epoch:     1, epoch:   26/25, mu: 0.7892098427, learning_rate: 0.0000380023, weight_decay: 0.0000318039
backpropagation finished successfully!
16:20:51 (14544): called boinc_finish(0)

</stderr_txt>
]]>