Nameexact_genome_1542495604_179_6176_1
Workunit4095527
Created18 Nov 2018, 2:01:28 UTC
Sent18 Nov 2018, 2:02:14 UTC
Report deadline21 Jan 2019, 5:24:19 UTC
Received20 Nov 2018, 23:23:53 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID58206
Run time1 days 5 hours 7 min 48 sec
CPU time1 days 4 hours 18 min 22 sec
Validate stateValid
Credit16,035.09
Device peak FLOPS2.94 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33

Stderr output

<core_client_version>6.10.58</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'../../projects/csgrid.org_csg/exact_client_0.33_x86_64-pc-linux-gnu'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176_1_r1900870975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.521074
read mu: 0.521074
read mu_delta: 0.959514
read initial_learning_rate: 0.000595059
read learning_rate: 0.000595059
read learning_rate_delta: 0.9105
read initial_weight_decay: 0.000387729
read weight_decay: 0.000387729
read weight_decay_delta: 0.930591
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.119354
read input_dropout_probability: 0.00134163
read hidden_dropout_probability: 0.0895048
read velocity_reset: 1947
read epoch: 0
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6176
read normal distribution: '1 -0.648370206356049 -0.691193282604218'
generator_str: '1353099690'
read generator: 1353099690
read generated_by_map:
1 add_edge 1
reading 108 nodes.
reading 571 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507812
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1842151747
post shuffle 1: 736438159
arguments:
	'../../projects/csgrid.org_csg/exact_client_0.33_x86_64-pc-linux-gnu'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176_1_r1900870975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.521074
read mu: 0.521074
read mu_delta: 0.959514
read initial_learning_rate: 0.000595059
read learning_rate: 0.000595059
read learning_rate_delta: 0.9105
read initial_weight_decay: 0.000387729
read weight_decay: 0.000387729
read weight_decay_delta: 0.930591
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.119354
read input_dropout_probability: 0.00134163
read hidden_dropout_probability: 0.0895048
read velocity_reset: 1947
read epoch: 0
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6176
read normal distribution: '1 -0.648370206356049 -0.691193282604218'
generator_str: '1353099690'
read generator: 1353099690
read generated_by_map:
1 add_edge 1
reading 108 nodes.
reading 571 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507812
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1842151747
post shuffle 1: 736438159
epoch time: 2316.8994140625s, input_fired_time: 31.5718879699707, output_fired_time: 8.68946838378906, propagate_forward_time: 1070.5078125, propagate_backward_time: 1180.78527832031, weight_update_time: 0.630137085914612, other_time: 25.3450927734375
epoch time: 222.973358154297s, input_fired_time: 1.26169443130493, output_fired_time: 0, propagate_forward_time: 215.593597412109, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.11807250976562
validation[          , genome  6176] predictions:    5823/  10000 (58.23%), best:    5823/10000 (58.23%), error:     12171.36230, best error:     12171.36230 on epoch:     0, epoch:    0/50, mu: 0.5210743546, learning_rate: 0.0005950595, weight_decay: 0.0003877293

epoch time: 2328.2229003906s, input_fired_time: 28.7722721100, output_fired_time: 7.6699113846, propagate_forward_time: 1062.7469482422, propagate_backward_time: 1199.5239257812, weight_update_time: 1.6338261366, other_time: 29.5098876953
epoch time: 218.4972076416s, input_fired_time: 2.2799367905, output_fired_time: 0.0000000000, propagate_forward_time: 210.0014648438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2158050537
validation[          , genome  6176] predictions:    6177/  10000 (61.77%), best:    6177/10000 (61.77%), error:     11221.31641, best error:     11221.31641 on epoch:     1, epoch:    1/50, mu: 0.5400593877, learning_rate: 0.0005418015, weight_decay: 0.0003608175

epoch time: 2318.3540039062s, input_fired_time: 33.5046691895, output_fired_time: 9.7207670212, propagate_forward_time: 1058.2449951172, propagate_backward_time: 1187.5865478516, weight_update_time: 0.6249712110, other_time: 29.2971191406
epoch time: 220.3668823242s, input_fired_time: 1.2253733873, output_fired_time: 0.0000000000, propagate_forward_time: 214.9266052246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2149047852
validation[          , genome  6176] predictions:    5987/  10000 (59.87%), best:    6177/10000 (61.77%), error:     11582.23633, best error:     11221.31641 on epoch:     1, epoch:    2/50, mu: 0.5582758188, learning_rate: 0.0004933102, weight_decay: 0.0003357737

epoch time: 2317.5107421875s, input_fired_time: 30.7098293304, output_fired_time: 11.7070503235, propagate_forward_time: 1056.4853515625, propagate_backward_time: 1188.2951660156, weight_update_time: 0.6235886216, other_time: 30.3134765625
epoch time: 217.0678863525s, input_fired_time: 2.2636828423, output_fired_time: 0.0000000000, propagate_forward_time: 209.6561737061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1480255127
validation[          , genome  6176] predictions:    6050/  10000 (60.50%), best:    6177/10000 (61.77%), error:     11435.02344, best error:     11221.31641 on epoch:     1, epoch:    3/50, mu: 0.5757547021, learning_rate: 0.0004491588, weight_decay: 0.0003124680

epoch time: 2328.9311523438s, input_fired_time: 32.9493980408, output_fired_time: 7.6756324768, propagate_forward_time: 1061.6578369141, propagate_backward_time: 1195.3453369141, weight_update_time: 0.6282276511, other_time: 31.3029785156
epoch time: 219.9946746826s, input_fired_time: 2.3340926170, output_fired_time: 0.0000000000, propagate_forward_time: 210.4924774170, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1681060791
validation[          , genome  6176] predictions:    6083/  10000 (60.83%), best:    6177/10000 (61.77%), error:     11540.05859, best error:     11221.31641 on epoch:     1, epoch:    4/50, mu: 0.5925259590, learning_rate: 0.0004089590, weight_decay: 0.0002907800

epoch time: 2323.1191406250s, input_fired_time: 30.8099784851, output_fired_time: 9.7698020935, propagate_forward_time: 1058.4851074219, propagate_backward_time: 1194.6027832031, weight_update_time: 0.6287102103, other_time: 29.4514160156
epoch time: 216.1198425293s, input_fired_time: 1.2355283499, output_fired_time: 0.0000000000, propagate_forward_time: 209.7628479004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1214599609
validation[          , genome  6176] predictions:    6201/  10000 (62.01%), best:    6201/10000 (62.01%), error:     11025.51953, best error:     11025.51953 on epoch:     5, epoch:    5/50, mu: 0.6086181998, learning_rate: 0.0003723570, weight_decay: 0.0002705974

epoch time: 2317.6354980469s, input_fired_time: 31.6283855438, output_fired_time: 9.6453208923, propagate_forward_time: 1058.0819091797, propagate_backward_time: 1191.9393310547, weight_update_time: 0.6288346648, other_time: 26.3405761719
epoch time: 218.5598297119s, input_fired_time: 2.2762811184, output_fired_time: 0.0000000000, propagate_forward_time: 210.1165771484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1669769287
validation[          , genome  6176] predictions:    6031/  10000 (60.31%), best:    6201/10000 (62.01%), error:     11508.31445, best error:     11025.51953 on epoch:     5, epoch:    6/50, mu: 0.6240589023, learning_rate: 0.0003390310, weight_decay: 0.0002518156

epoch time: 2320.7504882812s, input_fired_time: 28.8035278320, output_fired_time: 10.6304464340, propagate_forward_time: 1057.6096191406, propagate_backward_time: 1196.8436279297, weight_update_time: 0.6252824664, other_time: 26.8634033203
epoch time: 218.6215362549s, input_fired_time: 1.2707417011, output_fired_time: 0.0000000000, propagate_forward_time: 213.2304229736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1203765869
validation[          , genome  6176] predictions:    6225/  10000 (62.25%), best:    6225/10000 (62.25%), error:     11011.92871, best error:     11011.92871 on epoch:     7, epoch:    7/50, mu: 0.6388744712, learning_rate: 0.0003086876, weight_decay: 0.0002343374

epoch time: 2321.7197265625s, input_fired_time: 32.6150474548, output_fired_time: 8.7593212128, propagate_forward_time: 1068.8156738281, propagate_backward_time: 1185.2047119141, weight_update_time: 1.6275023222, other_time: 26.3250732422
epoch time: 222.9059906006s, input_fired_time: 1.2547394037, output_fired_time: 0.0000000000, propagate_forward_time: 217.5092468262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1419982910
validation[          , genome  6176] predictions:    5933/  10000 (59.33%), best:    6225/10000 (62.25%), error:     11595.88184, best error:     11011.92871 on epoch:     7, epoch:    8/50, mu: 0.6530902386, learning_rate: 0.0002810600, weight_decay: 0.0002180723

epoch time: 2324.2751464844s, input_fired_time: 28.7431735992, output_fired_time: 8.6169681549, propagate_forward_time: 1047.4750976562, propagate_backward_time: 1212.4182128906, weight_update_time: 0.6183491945, other_time: 27.0217285156
epoch time: 217.7914886475s, input_fired_time: 1.2583905458, output_fired_time: 0.0000000000, propagate_forward_time: 212.4368743896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0962219238
validation[          , genome  6176] predictions:    6201/  10000 (62.01%), best:    6201/10000 (62.01%), error:     10948.36230, best error:     10948.36230 on epoch:     9, epoch:    9/50, mu: 0.6667304635, learning_rate: 0.0002559051, weight_decay: 0.0002029362

epoch time: 2323.0773925781s, input_fired_time: 31.8730869293, output_fired_time: 10.7301082611, propagate_forward_time: 1058.5296630859, propagate_backward_time: 1193.3631591797, weight_update_time: 0.6213687658, other_time: 28.5812988281
epoch time: 223.1859436035s, input_fired_time: 1.2772765160, output_fired_time: 0.0000000000, propagate_forward_time: 214.7494049072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1592559814
validation[          , genome  6176] predictions:    6255/  10000 (62.55%), best:    6255/10000 (62.55%), error:     10869.10352, best error:     10869.10352 on epoch:    10, epoch:   10/50, mu: 0.6798184514, learning_rate: 0.0002330015, weight_decay: 0.0001888507

epoch time: 2317.7568359375s, input_fired_time: 27.6925487518, output_fired_time: 8.7559289932, propagate_forward_time: 1080.7507324219, propagate_backward_time: 1169.3503417969, weight_update_time: 0.6266185045, other_time: 31.2072753906
epoch time: 218.5773620605s, input_fired_time: 1.2638216019, output_fired_time: 0.0000000000, propagate_forward_time: 213.1966094971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1169281006
validation[          , genome  6176] predictions:    6122/  10000 (61.22%), best:    6255/10000 (62.55%), error:     11201.32129, best error:     10869.10352 on epoch:    10, epoch:   11/50, mu: 0.6923765540, learning_rate: 0.0002121478, weight_decay: 0.0001757428

epoch time: 2339.4030761719s, input_fired_time: 35.0600624084, output_fired_time: 8.7771348953, propagate_forward_time: 1079.8685302734, propagate_backward_time: 1187.1905517578, weight_update_time: 0.6227721572, other_time: 28.5068359375
epoch time: 220.6189880371s, input_fired_time: 1.3118684292, output_fired_time: 0.0000000000, propagate_forward_time: 214.1666412354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1404724121
validation[          , genome  6176] predictions:    6366/  10000 (63.66%), best:    6366/10000 (63.66%), error:     10537.52832, best error:     10537.52832 on epoch:    12, epoch:   12/50, mu: 0.7044262290, learning_rate: 0.0001931605, weight_decay: 0.0001635447

epoch time: 2331.4165039062s, input_fired_time: 29.6942424774, output_fired_time: 8.6900024414, propagate_forward_time: 1063.4023437500, propagate_backward_time: 1197.4252929688, weight_update_time: 0.6179199219, other_time: 32.2045898438
epoch time: 214.9294586182s, input_fired_time: 1.2543323040, output_fired_time: 0.0000000000, propagate_forward_time: 208.5363311768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1387939453
validation[          , genome  6176] predictions:    6133/  10000 (61.33%), best:    6366/10000 (63.66%), error:     11217.41504, best error:     10537.52832 on epoch:    12, epoch:   13/50, mu: 0.7159880400, learning_rate: 0.0001758726, weight_decay: 0.0001521933

epoch time: 2324.7297363281s, input_fired_time: 29.8475589752, output_fired_time: 9.6591463089, propagate_forward_time: 1073.5753173828, propagate_backward_time: 1180.4139404297, weight_update_time: 0.6306303740, other_time: 31.2336425781
epoch time: 220.1607055664s, input_fired_time: 1.2692536116, output_fired_time: 0.0000000000, propagate_forward_time: 214.7053985596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1860504150
validation[          , genome  6176] predictions:    6439/  10000 (64.39%), best:    6439/10000 (64.39%), error:     10457.28809, best error:     10457.28809 on epoch:    14, epoch:   14/50, mu: 0.7270817757, learning_rate: 0.0001601320, weight_decay: 0.0001416297

epoch time: 2332.3466796875s, input_fired_time: 33.7409133911, output_fired_time: 10.7691497803, propagate_forward_time: 1046.6643066406, propagate_backward_time: 1209.9420166016, weight_update_time: 0.6284558177, other_time: 31.2303466797
epoch time: 214.8825225830s, input_fired_time: 1.2626762390, output_fired_time: 0.0000000000, propagate_forward_time: 209.5035552979, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1162872314
validation[          , genome  6176] predictions:    6362/  10000 (63.62%), best:    6439/10000 (64.39%), error:     10607.40820, best error:     10457.28809 on epoch:    14, epoch:   15/50, mu: 0.7377263308, learning_rate: 0.0001458001, weight_decay: 0.0001317994

epoch time: 2319.6218261719s, input_fired_time: 30.8212833405, output_fired_time: 10.6749448776, propagate_forward_time: 1052.9885253906, propagate_backward_time: 1197.7813720703, weight_update_time: 0.6238465905, other_time: 27.3555908203
epoch time: 221.9265594482s, input_fired_time: 1.2784236670, output_fired_time: 0.0000000000, propagate_forward_time: 213.5218963623, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1262359619
validation[          , genome  6176] predictions:    6443/  10000 (64.43%), best:    6443/10000 (64.43%), error:     10424.92090, best error:     10424.92090 on epoch:    16, epoch:   16/50, mu: 0.7479399443, learning_rate: 0.0001327510, weight_decay: 0.0001226514

epoch time: 2326.0183105469s, input_fired_time: 31.4419307709, output_fired_time: 9.1887159348, propagate_forward_time: 1049.0876464844, propagate_backward_time: 1198.8671875000, weight_update_time: 1.6248576641, other_time: 37.4328613281
epoch time: 218.3981628418s, input_fired_time: 1.2801221609, output_fired_time: 0.0000000000, propagate_forward_time: 210.9347229004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1833190918
validation[          , genome  6176] predictions:    6353/  10000 (63.53%), best:    6443/10000 (64.43%), error:     10583.29395, best error:     10424.92090 on epoch:    16, epoch:   17/50, mu: 0.7577400804, learning_rate: 0.0001208697, weight_decay: 0.0001141383

epoch time: 2314.6567382812s, input_fired_time: 31.8309440613, output_fired_time: 10.7557220459, propagate_forward_time: 1050.2893066406, propagate_backward_time: 1192.6224365234, weight_update_time: 1.6195503473, other_time: 29.1583251953
epoch time: 220.7173919678s, input_fired_time: 1.2900199890, output_fired_time: 0.0000000000, propagate_forward_time: 215.3021087646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1252593994
validation[          , genome  6176] predictions:    6230/  10000 (62.30%), best:    6443/10000 (64.43%), error:     10926.66797, best error:     10424.92090 on epoch:    16, epoch:   18/50, mu: 0.7671434283, learning_rate: 0.0001100518, weight_decay: 0.0001062161

epoch time: 2314.0505371094s, input_fired_time: 26.8288116455, output_fired_time: 10.6547145844, propagate_forward_time: 1035.9152832031, propagate_backward_time: 1210.4543457031, weight_update_time: 0.6176331639, other_time: 30.1972656250
arguments:
	'../../projects/csgrid.org_csg/exact_client_0.33_x86_64-pc-linux-gnu'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_179_6176_1_r1900870975_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.521074
read mu: 0.776166
read mu_delta: 0.959514
read initial_learning_rate: 0.000595059
read learning_rate: 0.000100202
read learning_rate_delta: 0.9105
read initial_weight_decay: 0.000387729
read weight_decay: 9.88438e-05
read weight_decay_delta: 0.930591
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.119354
read input_dropout_probability: 0.00134163
read hidden_dropout_probability: 0.0895048
read velocity_reset: 1947
read epoch: 19
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 16
read number_validation_images: 10000
read best_validation_predictions: 6443
read best_validation_error: 10424.9
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6176
read normal distribution: '1 -0.648370206356049 -0.691193282604218'
generator_str: '1889568332'
read generator: 1889568332
read generated_by_map:
1 add_edge 1
reading 108 nodes.
reading 571 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507812
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2324.41088867188s, input_fired_time: 28.1972923278809, output_fired_time: 8.69780158996582, propagate_forward_time: 1054.0576171875, propagate_backward_time: 1199.37890625, weight_update_time: 0.619313776493073, other_time: 34.079345703125
epoch time: 218.970596313477s, input_fired_time: 1.2778445482254, output_fired_time: 0, propagate_forward_time: 213.594390869141, propagate_backward_time: 0, weight_update_time: 0, other_time: 4.09835815429688
validation[          , genome  6176] predictions:    6460/  10000 (64.60%), best:    6460/10000 (64.60%), error:     10345.19043, best error:     10345.19043 on epoch:    19, epoch:   19/50, mu: 0.7761660814, learning_rate: 0.0001002022, weight_decay: 0.0000988438

epoch time: 2323.4714355469s, input_fired_time: 34.2797164917, output_fired_time: 10.6990175247, propagate_forward_time: 1069.1866455078, propagate_backward_time: 1171.1437988281, weight_update_time: 0.6232252717, other_time: 38.1622314453
epoch time: 220.0711822510s, input_fired_time: 2.2861282825, output_fired_time: 0.0000000000, propagate_forward_time: 213.6259460449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1591033936
validation[          , genome  6176] predictions:    6435/  10000 (64.35%), best:    6460/10000 (64.60%), error:     10366.56934, best error:     10345.19043 on epoch:    19, epoch:   20/50, mu: 0.7848234177, learning_rate: 0.0000912341, weight_decay: 0.0000919832

epoch time: 2328.3850097656s, input_fired_time: 32.8395729065, output_fired_time: 8.7424640656, propagate_forward_time: 1057.5031738281, propagate_backward_time: 1196.2927246094, weight_update_time: 0.6334408522, other_time: 33.0070800781
epoch time: 222.8359985352s, input_fired_time: 1.2983102798, output_fired_time: 0.0000000000, propagate_forward_time: 216.3950805664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1426086426
validation[          , genome  6176] predictions:    6571/  10000 (65.71%), best:    6571/10000 (65.71%), error:     10119.34863, best error:     10119.34863 on epoch:    21, epoch:   21/50, mu: 0.7931302786, learning_rate: 0.0000830686, weight_decay: 0.0000855987

epoch time: 2331.7145996094s, input_fired_time: 28.8359375000, output_fired_time: 10.6869621277, propagate_forward_time: 1067.1165771484, propagate_backward_time: 1196.2224121094, weight_update_time: 0.6146780252, other_time: 28.8526611328
epoch time: 223.7511444092s, input_fired_time: 2.3008229733, output_fired_time: 0.0000000000, propagate_forward_time: 214.2487640381, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2015533447
validation[          , genome  6176] predictions:    6418/  10000 (64.18%), best:    6571/10000 (65.71%), error:     10301.57031, best error:     10119.34863 on epoch:    21, epoch:   22/50, mu: 0.8011007905, learning_rate: 0.0000756339, weight_decay: 0.0000796574

epoch time: 2320.2409667969s, input_fired_time: 32.9611549377, output_fired_time: 11.7844429016, propagate_forward_time: 1057.1096191406, propagate_backward_time: 1189.0012207031, weight_update_time: 0.6241863966, other_time: 29.3845214844
epoch time: 223.5613098145s, input_fired_time: 1.2856531143, output_fired_time: 0.0000000000, propagate_forward_time: 217.6522521973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6233978271
validation[          , genome  6176] predictions:    6492/  10000 (64.92%), best:    6571/10000 (65.71%), error:     10197.85449, best error:     10119.34863 on epoch:    21, epoch:   23/50, mu: 0.8087486029, learning_rate: 0.0000688647, weight_decay: 0.0000741285

epoch time: 2323.8388671875s, input_fired_time: 37.8726806641, output_fired_time: 10.6661405563, propagate_forward_time: 1046.0432128906, propagate_backward_time: 1197.8023681641, weight_update_time: 0.6189557910, other_time: 31.4544677734
epoch time: 220.9250488281s, input_fired_time: 1.3285657167, output_fired_time: 0.0000000000, propagate_forward_time: 215.4180145264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1784667969
validation[          , genome  6176] predictions:    6506/  10000 (65.06%), best:    6571/10000 (65.71%), error:     10164.90137, best error:     10119.34863 on epoch:    21, epoch:   24/50, mu: 0.8160867691, learning_rate: 0.0000627013, weight_decay: 0.0000689833

epoch time: 2332.4812011719s, input_fired_time: 33.1864089966, output_fired_time: 9.7818536758, propagate_forward_time: 1079.5417480469, propagate_backward_time: 1173.6807861328, weight_update_time: 0.6270833015, other_time: 36.2904052734
epoch time: 219.7618560791s, input_fired_time: 2.2883749008, output_fired_time: 0.0000000000, propagate_forward_time: 210.3538513184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1196289062
validation[          , genome  6176] predictions:    6524/  10000 (65.24%), best:    6571/10000 (65.71%), error:     10119.93262, best error:     10119.34863 on epoch:    21, epoch:   25/50, mu: 0.8231278658, learning_rate: 0.0000570895, weight_decay: 0.0000641953

epoch time: 2319.3750000000s, input_fired_time: 32.9856376648, output_fired_time: 8.7083930969, propagate_forward_time: 1055.2918701172, propagate_backward_time: 1187.3629150391, weight_update_time: 0.6280322075, other_time: 35.0261230469
epoch time: 225.5240020752s, input_fired_time: 1.3230347633, output_fired_time: 0.0000000000, propagate_forward_time: 217.6987304688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5022430420
validation[          , genome  6176] predictions:    6601/  10000 (66.01%), best:    6601/10000 (66.01%), error:      9994.93066, best error:      9994.93066 on epoch:    26, epoch:   26/50, mu: 0.8298838735, learning_rate: 0.0000519800, weight_decay: 0.0000597396

epoch time: 2336.2758789062s, input_fired_time: 26.9705944061, output_fired_time: 7.8187017441, propagate_forward_time: 1047.4605712891, propagate_backward_time: 1221.7635498047, weight_update_time: 0.6189262867, other_time: 32.2624511719
epoch time: 223.6401214600s, input_fired_time: 1.3178353310, output_fired_time: 0.0000000000, propagate_forward_time: 218.1992950439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1229858398
validation[          , genome  6176] predictions:    6669/  10000 (66.69%), best:    6669/10000 (66.69%), error:      9908.36914, best error:      9908.36914 on epoch:    27, epoch:   27/50, mu: 0.8363663554, learning_rate: 0.0000473277, weight_decay: 0.0000555931

epoch time: 2317.8591308594s, input_fired_time: 37.8590469360, output_fired_time: 11.6483860016, propagate_forward_time: 1043.6235351562, propagate_backward_time: 1189.5347900391, weight_update_time: 0.6224620938, other_time: 35.1932373047
epoch time: 218.1791381836s, input_fired_time: 1.2820135355, output_fired_time: 0.0000000000, propagate_forward_time: 211.5861053467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3110198975
validation[          , genome  6176] predictions:    6620/  10000 (66.20%), best:    6669/10000 (66.69%), error:      9914.30078, best error:      9908.36914 on epoch:    27, epoch:   28/50, mu: 0.8425863981, learning_rate: 0.0000430919, weight_decay: 0.0000517345

epoch time: 2317.3913574219s, input_fired_time: 29.7956504822, output_fired_time: 9.6523046494, propagate_forward_time: 1065.2619628906, propagate_backward_time: 1184.6381835938, weight_update_time: 0.6181884408, other_time: 28.0432128906
epoch time: 220.9485015869s, input_fired_time: 1.3006287813, output_fired_time: 0.0000000000, propagate_forward_time: 213.5228424072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1250305176
validation[          , genome  6176] predictions:    6538/  10000 (65.38%), best:    6669/10000 (66.69%), error:     10126.73145, best error:      9908.36914 on epoch:    27, epoch:   29/50, mu: 0.8485546112, learning_rate: 0.0000392352, weight_decay: 0.0000481437

epoch time: 2327.8083496094s, input_fired_time: 32.0910453796, output_fired_time: 8.6235990524, propagate_forward_time: 1048.5391845703, propagate_backward_time: 1208.2358398438, weight_update_time: 1.6280575991, other_time: 30.3187255859
epoch time: 215.4336242676s, input_fired_time: 1.2897235155, output_fired_time: 0.0000000000, propagate_forward_time: 210.0447692871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0991363525
validation[          , genome  6176] predictions:    6613/  10000 (66.13%), best:    6613/10000 (66.13%), error:      9854.01758, best error:      9854.01758 on epoch:    30, epoch:   30/50, mu: 0.8542811871, learning_rate: 0.0000357236, weight_decay: 0.0000448021

epoch time: 2314.7355957031s, input_fired_time: 28.8724765778, output_fired_time: 9.7613325119, propagate_forward_time: 1062.4617919922, propagate_backward_time: 1181.3468017578, weight_update_time: 0.6374918222, other_time: 32.2932128906
epoch time: 219.8871307373s, input_fired_time: 2.3062839508, output_fired_time: 0.0000000000, propagate_forward_time: 213.0116271973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5692138672
validation[          , genome  6176] predictions:    6609/  10000 (66.09%), best:    6613/10000 (66.13%), error:      9862.30078, best error:      9854.01758 on epoch:    30, epoch:   31/50, mu: 0.8597759604, learning_rate: 0.0000325263, weight_decay: 0.0000416924

epoch time: 2328.4072265625s, input_fired_time: 30.1332435608, output_fired_time: 9.6686277390, propagate_forward_time: 1067.3737792969, propagate_backward_time: 1192.8588867188, weight_update_time: 0.6197357178, other_time: 28.3725585938
epoch time: 216.4707794189s, input_fired_time: 1.2893584967, output_fired_time: 0.0000000000, propagate_forward_time: 209.0831298828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0982971191
validation[          , genome  6176] predictions:    6579/  10000 (65.79%), best:    6613/10000 (66.13%), error:      9882.58008, best error:      9854.01758 on epoch:    30, epoch:   32/50, mu: 0.8650482297, learning_rate: 0.0000296152, weight_decay: 0.0000387986

epoch time: 2325.3510742188s, input_fired_time: 32.2793350220, output_fired_time: 7.6855893135, propagate_forward_time: 1060.6999511719, propagate_backward_time: 1191.4409179688, weight_update_time: 0.6365689635, other_time: 33.2453613281
epoch time: 224.3239593506s, input_fired_time: 1.2982513905, output_fired_time: 0.0000000000, propagate_forward_time: 217.8641967773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1615142822
validation[          , genome  6176] predictions:    6617/  10000 (66.17%), best:    6613/10000 (66.13%), error:      9984.26660, best error:      9854.01758 on epoch:    30, epoch:   33/50, mu: 0.8701070547, learning_rate: 0.0000269647, weight_decay: 0.0000361056

epoch time: 2322.7839355469s, input_fired_time: 30.8694553375, output_fired_time: 9.7056493759, propagate_forward_time: 1055.5196533203, propagate_backward_time: 1189.2667236328, weight_update_time: 0.6212343574, other_time: 37.4226074219
epoch time: 217.2319793701s, input_fired_time: 1.3176745176, output_fired_time: 0.0000000000, propagate_forward_time: 210.7408142090, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1734924316
validation[          , genome  6176] predictions:    6654/  10000 (66.54%), best:    6654/10000 (66.54%), error:      9747.34668, best error:      9747.34668 on epoch:    34, epoch:   34/50, mu: 0.8749610782, learning_rate: 0.0000245513, weight_decay: 0.0000335996

epoch time: 2326.2673339844s, input_fired_time: 33.8384017944, output_fired_time: 10.6767578125, propagate_forward_time: 1067.2403564453, propagate_backward_time: 1182.9658203125, weight_update_time: 1.6294291019, other_time: 31.5460205078
epoch time: 221.9529113770s, input_fired_time: 1.3322232962, output_fired_time: 0.0000000000, propagate_forward_time: 213.3672332764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2534484863
validation[          , genome  6176] predictions:    6633/  10000 (66.33%), best:    6654/10000 (66.54%), error:      9807.05469, best error:      9747.34668 on epoch:    34, epoch:   35/50, mu: 0.8796185851, learning_rate: 0.0000223540, weight_decay: 0.0000312675

epoch time: 2333.2807617188s, input_fired_time: 29.0239334106, output_fired_time: 8.2173852921, propagate_forward_time: 1062.8010253906, propagate_backward_time: 1196.2883300781, weight_update_time: 1.6742073298, other_time: 36.9501953125
epoch time: 214.9579620361s, input_fired_time: 1.2946727276, output_fired_time: 0.0000000000, propagate_forward_time: 206.5892791748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.0740051270
validation[          , genome  6176] predictions:    6539/  10000 (65.39%), best:    6654/10000 (66.54%), error:     10008.07715, best error:      9747.34668 on epoch:    34, epoch:   36/50, mu: 0.8840875030, learning_rate: 0.0000203533, weight_decay: 0.0000290972

epoch time: 2322.7465820312s, input_fired_time: 36.0454597473, output_fired_time: 8.7466049194, propagate_forward_time: 1059.0904541016, propagate_backward_time: 1186.5554199219, weight_update_time: 0.6184200048, other_time: 32.3087158203
epoch time: 220.8316497803s, input_fired_time: 1.3106280565, output_fired_time: 0.0000000000, propagate_forward_time: 213.2824096680, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2386169434
validation[          , genome  6176] predictions:    6654/  10000 (66.54%), best:    6654/10000 (66.54%), error:      9790.32324, best error:      9747.34668 on epoch:    34, epoch:   37/50, mu: 0.8883755207, learning_rate: 0.0000185317, weight_decay: 0.0000270776

epoch time: 2327.8344726562s, input_fired_time: 34.0155563354, output_fired_time: 12.6542434692, propagate_forward_time: 1042.0142822266, propagate_backward_time: 1209.7327880859, weight_update_time: 0.6224530339, other_time: 29.4174804688
epoch time: 217.6202087402s, input_fired_time: 1.3013654947, output_fired_time: 0.0000000000, propagate_forward_time: 211.2065887451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1122589111
validation[          , genome  6176] predictions:    6696/  10000 (66.96%), best:    6654/10000 (66.54%), error:      9752.38574, best error:      9747.34668 on epoch:    34, epoch:   38/50, mu: 0.8924899101, learning_rate: 0.0000168731, weight_decay: 0.0000251982

epoch time: 2328.4436035156s, input_fired_time: 32.9152374268, output_fired_time: 9.7079429626, propagate_forward_time: 1076.5424804688, propagate_backward_time: 1177.9184570312, weight_update_time: 0.6214800477, other_time: 31.3593750000
epoch time: 222.1069946289s, input_fired_time: 1.3167338371, output_fired_time: 0.0000000000, propagate_forward_time: 213.5767059326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2135620117
validation[          , genome  6176] predictions:    6716/  10000 (67.16%), best:    6716/10000 (67.16%), error:      9680.68945, best error:      9680.68945 on epoch:    39, epoch:   39/50, mu: 0.8964377046, learning_rate: 0.0000153629, weight_decay: 0.0000234492

epoch time: 2327.2749023438s, input_fired_time: 30.9918441772, output_fired_time: 7.6858963966, propagate_forward_time: 1067.5010986328, propagate_backward_time: 1184.8194580078, weight_update_time: 0.6311241984, other_time: 36.2766113281
epoch time: 216.5749359131s, input_fired_time: 1.2989687920, output_fired_time: 0.0000000000, propagate_forward_time: 209.1732940674, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1026763916
validation[          , genome  6176] predictions:    6610/  10000 (66.10%), best:    6716/10000 (67.16%), error:      9869.82520, best error:      9680.68945 on epoch:    39, epoch:   40/50, mu: 0.9002256989, learning_rate: 0.0000139879, weight_decay: 0.0000218217

epoch time: 2318.2749023438s, input_fired_time: 28.0578918457, output_fired_time: 7.6865811348, propagate_forward_time: 1075.1352539062, propagate_backward_time: 1177.2355957031, weight_update_time: 0.6186342239, other_time: 30.1596679688
epoch time: 220.7497863770s, input_fired_time: 1.3033078909, output_fired_time: 0.0000000000, propagate_forward_time: 214.3064270020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1400451660
validation[          , genome  6176] predictions:    6735/  10000 (67.35%), best:    6735/10000 (67.35%), error:      9602.80664, best error:      9602.80664 on epoch:    41, epoch:   41/50, mu: 0.9038603306, learning_rate: 0.0000127360, weight_decay: 0.0000203070

epoch time: 2327.1572265625s, input_fired_time: 28.0314350128, output_fired_time: 8.7774085999, propagate_forward_time: 1067.5633544922, propagate_backward_time: 1190.4504394531, weight_update_time: 0.6263971329, other_time: 32.3345947266
epoch time: 218.4358978271s, input_fired_time: 2.3001198769, output_fired_time: 0.0000000000, propagate_forward_time: 211.9584960938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1772766113
validation[          , genome  6176] predictions:    6645/  10000 (66.45%), best:    6735/10000 (67.35%), error:      9740.73926, best error:      9602.80664 on epoch:    41, epoch:   42/50, mu: 0.9073477983, learning_rate: 0.0000115961, weight_decay: 0.0000188976

epoch time: 2325.3725585938s, input_fired_time: 29.9485378265, output_fired_time: 9.6526432037, propagate_forward_time: 1077.6998291016, propagate_backward_time: 1176.9067382812, weight_update_time: 0.6265341640, other_time: 31.1649169922
epoch time: 222.3848266602s, input_fired_time: 1.3223373890, output_fired_time: 0.0000000000, propagate_forward_time: 216.8708038330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1916809082
validation[          , genome  6176] predictions:    6737/  10000 (67.37%), best:    6735/10000 (67.35%), error:      9612.12988, best error:      9602.80664 on epoch:    41, epoch:   43/50, mu: 0.9106940627, learning_rate: 0.0000105583, weight_decay: 0.0000175859

epoch time: 2324.4941406250s, input_fired_time: 30.1399021149, output_fired_time: 9.6988248825, propagate_forward_time: 1054.0878906250, propagate_backward_time: 1197.4719238281, weight_update_time: 0.6214568019, other_time: 33.0957031250
epoch time: 215.1188659668s, input_fired_time: 1.3114165068, output_fired_time: 0.0000000000, propagate_forward_time: 208.6938934326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1135559082
validation[          , genome  6176] predictions:    6667/  10000 (66.67%), best:    6735/10000 (67.35%), error:      9672.57617, best error:      9602.80664 on epoch:    41, epoch:   44/50, mu: 0.9139048457, learning_rate: 0.0000096133, weight_decay: 0.0000163653

epoch time: 2329.6535644531s, input_fired_time: 34.1562614441, output_fired_time: 10.6658029556, propagate_forward_time: 1083.2952880859, propagate_backward_time: 1170.8902587891, weight_update_time: 0.6309086084, other_time: 30.6459960938
epoch time: 219.0310516357s, input_fired_time: 1.3358006477, output_fired_time: 0.0000000000, propagate_forward_time: 212.5474243164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1478271484
validation[          , genome  6176] predictions:    6676/  10000 (66.76%), best:    6735/10000 (67.35%), error:      9745.00684, best error:      9602.80664 on epoch:    41, epoch:   45/50, mu: 0.9169856310, learning_rate: 0.0000087529, weight_decay: 0.0000152294

epoch time: 2323.1989746094s, input_fired_time: 30.6707706451, output_fired_time: 10.6791763306, propagate_forward_time: 1063.1361083984, propagate_backward_time: 1189.4716796875, weight_update_time: 0.6729609966, other_time: 29.2413330078
epoch time: 219.8972778320s, input_fired_time: 1.3105857372, output_fired_time: 0.0000000000, propagate_forward_time: 213.3763122559, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2103729248
validation[          , genome  6176] predictions:    6734/  10000 (67.34%), best:    6734/10000 (67.34%), error:      9532.02441, best error:      9532.02441 on epoch:    46, epoch:   46/50, mu: 0.9199417233, learning_rate: 0.0000079695, weight_decay: 0.0000141723

epoch time: 2322.9331054688s, input_fired_time: 33.4019813538, output_fired_time: 9.7844905853, propagate_forward_time: 1055.9923095703, propagate_backward_time: 1191.4848632812, weight_update_time: 0.6221232414, other_time: 32.2694091797
epoch time: 219.2838439941s, input_fired_time: 1.3231956959, output_fired_time: 0.0000000000, propagate_forward_time: 212.8038635254, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1567840576
validation[          , genome  6176] predictions:    6743/  10000 (67.43%), best:    6734/10000 (67.34%), error:      9553.17480, best error:      9532.02441 on epoch:    46, epoch:   47/50, mu: 0.9227781296, learning_rate: 0.0000072563, weight_decay: 0.0000131887

epoch time: 2322.1577148438s, input_fired_time: 32.0252265930, output_fired_time: 10.6585750580, propagate_forward_time: 1053.6839599609, propagate_backward_time: 1192.6778564453, weight_update_time: 0.6230493188, other_time: 33.1120605469
epoch time: 220.6955261230s, input_fired_time: 1.3372929096, output_fired_time: 0.0000000000, propagate_forward_time: 214.1417388916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2164916992
validation[          , genome  6176] predictions:    6645/  10000 (66.45%), best:    6734/10000 (67.34%), error:      9939.62891, best error:      9532.02441 on epoch:    46, epoch:   48/50, mu: 0.9254996777, learning_rate: 0.0000066068, weight_decay: 0.0000122733

epoch time: 2319.6557617188s, input_fired_time: 29.0892276764, output_fired_time: 9.6610145569, propagate_forward_time: 1065.9471435547, propagate_backward_time: 1181.7622070312, weight_update_time: 0.6335426569, other_time: 33.1961669922
epoch time: 219.1089477539s, input_fired_time: 1.3185569048, output_fired_time: 0.0000000000, propagate_forward_time: 212.5803375244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2100524902
validation[          , genome  6176] predictions:    6733/  10000 (67.33%), best:    6734/10000 (67.34%), error:      9574.65820, best error:      9532.02441 on epoch:    46, epoch:   49/50, mu: 0.9281110764, learning_rate: 0.0000060155, weight_decay: 0.0000114214

epoch time: 2314.7729492188s, input_fired_time: 34.9540519714, output_fired_time: 9.6855163574, propagate_forward_time: 1044.7933349609, propagate_backward_time: 1196.0264892578, weight_update_time: 1.6209729910, other_time: 29.3134765625
epoch time: 221.1254577637s, input_fired_time: 2.3232769966, output_fired_time: 0.0000000000, propagate_forward_time: 213.7021484375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1000366211
validation[          , genome  6176] predictions:    6736/  10000 (67.36%), best:    6734/10000 (67.34%), error:      9547.01270, best error:      9532.02441 on epoch:    46, epoch:   50/50, mu: 0.9306167364, learning_rate: 0.0000054771, weight_decay: 0.0000106286

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1091.6944580078s, input_fired_time: 9.9407644272, output_fired_time: 0.0000000000, propagate_forward_time: 1054.9036865234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 26.8499755859
best training[          , genome  6176] predictions:   36043/  50000 (72.09%), best:    6734/10000 (67.34%), error:     42513.47656, best error:      9532.02441 on epoch:    46, epoch:   51/50, mu: 0.9330209494, learning_rate: 0.0000049869, weight_decay: 0.0000098909
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 216.2738800049s, input_fired_time: 2.3018410206, output_fired_time: 0.0000000000, propagate_forward_time: 208.8868255615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0852203369
   testing[          , genome  6176] predictions:    6734/  10000 (67.34%), best:    6734/10000 (67.34%), error:      9532.02441, best error:      9532.02441 on epoch:    46, epoch:   51/50, mu: 0.9330209494, learning_rate: 0.0000049869, weight_decay: 0.0000098909
backpropagation finished successfully!
18:40:19 (32467): called boinc_finish(0)

</stderr_txt>
]]>