Nameexact_genome_1542495604_172_6201_1
Workunit4096037
Created18 Nov 2018, 3:21:22 UTC
Sent18 Nov 2018, 3:40:35 UTC
Report deadline13 Dec 2018, 23:10:45 UTC
Received21 Nov 2018, 12:28:50 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID83973
Run time22 hours 14 min 50 sec
CPU time22 hours 8 min 32 sec
Validate stateValid
Credit6,453.16
Device peak FLOPS2.50 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size573.77 MB
Peak swap size593.52 MB
Peak disk usage12.57 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_172_6201.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_172_6201_1_r36149101_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542495604_172_6201.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.50446
read mu: 0.50446
read mu_delta: 0.929311
read initial_learning_rate: 1e-05
read learning_rate: 1e-05
read learning_rate_delta: 0.931609
read initial_weight_decay: 0.000240915
read weight_decay: 0.000240915
read weight_decay_delta: 0.93909
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0932409
read input_dropout_probability: 0.00139963
read hidden_dropout_probability: 0.0786787
read velocity_reset: 1855
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6201
read normal distribution: '1 0 0'
generator_str: '1264631010'
read generator: 1264631010
read generated_by_map:
1 crossover 1
reading 99 nodes.
reading 419 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1007730711
post shuffle 1: 699226025
epoch time: 3139.14404296875s, input_fired_time: 45.8561325073242, output_fired_time: 24.027006149292, propagate_forward_time: 1208.48461914063, propagate_backward_time: 1822.97546386719, weight_update_time: 1.78844082355499, other_time: 37.8006591796875
epoch time: 254.117874145508s, input_fired_time: 3.60042643547058, output_fired_time: 0, propagate_forward_time: 241.952880859375, propagate_backward_time: 0, weight_update_time: 0, other_time: 8.56455993652344
validation[          , genome  6201] predictions:    6528/  10000 (65.28%), best:    6528/10000 (65.28%), error:     10283.17871, best error:     10283.17871 on epoch:     0, epoch:    0/25, mu: 0.5044602752, learning_rate: 0.0000100000, weight_decay: 0.0002409152

epoch time: 3121.4860839844s, input_fired_time: 47.4869689941, output_fired_time: 28.0425682068, propagate_forward_time: 1193.6743164063, propagate_backward_time: 1815.3166503906, weight_update_time: 1.8750208616, other_time: 36.9655761719
epoch time: 253.8411102295s, input_fired_time: 3.5591163635, output_fired_time: 0.0000000000, propagate_forward_time: 240.7306823730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.5513153076
validation[          , genome  6201] predictions:    6571/  10000 (65.71%), best:    6528/10000 (65.28%), error:     10351.91504, best error:     10283.17871 on epoch:     0, epoch:    1/25, mu: 0.5387824774, learning_rate: 0.0000093161, weight_decay: 0.0002262410

epoch time: 3123.8764648438s, input_fired_time: 43.6600379944, output_fired_time: 25.1326751709, propagate_forward_time: 1196.7785644531, propagate_backward_time: 1818.1519775391, weight_update_time: 0.7923608422, other_time: 40.1531982422
epoch time: 252.0099639893s, input_fired_time: 5.5242390633, output_fired_time: 0.0000000000, propagate_forward_time: 240.0661010742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4196166992
validation[          , genome  6201] predictions:    6546/  10000 (65.46%), best:    6528/10000 (65.28%), error:     10532.89453, best error:     10283.17871 on epoch:     0, epoch:    2/25, mu: 0.5706784725, learning_rate: 0.0000086789, weight_decay: 0.0002124606

epoch time: 3122.5429687500s, input_fired_time: 49.5298919678, output_fired_time: 24.1512374878, propagate_forward_time: 1188.5606689453, propagate_backward_time: 1820.2211914063, weight_update_time: 0.7843509912, other_time: 40.0802001953
epoch time: 252.2761383057s, input_fired_time: 3.5384266376, output_fired_time: 0.0000000000, propagate_forward_time: 241.4239654541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.3137512207
validation[          , genome  6201] predictions:    6545/  10000 (65.45%), best:    6528/10000 (65.28%), error:     10776.71387, best error:     10283.17871 on epoch:     0, epoch:    3/25, mu: 0.6003198028, learning_rate: 0.0000080854, weight_decay: 0.0001995196

epoch time: 3130.1374511719s, input_fired_time: 49.7210998535, output_fired_time: 26.9141368866, propagate_forward_time: 1202.3798828125, propagate_backward_time: 1813.4930419922, weight_update_time: 0.7777198553, other_time: 37.6292724609
epoch time: 252.9605102539s, input_fired_time: 3.5476212502, output_fired_time: 0.0000000000, propagate_forward_time: 241.1429748535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.2699127197
validation[          , genome  6201] predictions:    6540/  10000 (65.40%), best:    6528/10000 (65.28%), error:     10980.36328, best error:     10283.17871 on epoch:     0, epoch:    4/25, mu: 0.6278658509, learning_rate: 0.0000075324, weight_decay: 0.0001873668

epoch time: 3123.9489746094s, input_fired_time: 51.5451965332, output_fired_time: 27.1637496948, propagate_forward_time: 1187.5833740234, propagate_backward_time: 1816.7005615234, weight_update_time: 0.7657173276, other_time: 40.9560546875
epoch time: 251.6822814941s, input_fired_time: 3.5384156704, output_fired_time: 0.0000000000, propagate_forward_time: 240.6470184326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4968414307
validation[          , genome  6201] predictions:    6517/  10000 (65.17%), best:    6528/10000 (65.28%), error:     11178.73828, best error:     10283.17871 on epoch:     0, epoch:    5/25, mu: 0.6534646749, learning_rate: 0.0000070173, weight_decay: 0.0001759543

epoch time: 3123.6811523438s, input_fired_time: 49.7447166443, output_fired_time: 26.2166080475, propagate_forward_time: 1195.3658447266, propagate_backward_time: 1813.7889404297, weight_update_time: 0.7768887281, other_time: 38.5651855469
epoch time: 250.4116058350s, input_fired_time: 4.5156245232, output_fired_time: 0.0000000000, propagate_forward_time: 238.6286773682, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2673034668
validation[          , genome  6201] predictions:    6491/  10000 (64.91%), best:    6528/10000 (65.28%), error:     11404.40723, best error:     10283.17871 on epoch:     0, epoch:    6/25, mu: 0.6772539616, learning_rate: 0.0000065373, weight_decay: 0.0001652368

epoch time: 3126.2980957031s, input_fired_time: 49.0630760193, output_fired_time: 28.0439586639, propagate_forward_time: 1201.2673339844, propagate_backward_time: 1812.3648681641, weight_update_time: 0.7764817476, other_time: 35.5589599609
epoch time: 252.1658782959s, input_fired_time: 3.5812256336, output_fired_time: 0.0000000000, propagate_forward_time: 241.0414123535, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5432434082
validation[          , genome  6201] predictions:    6430/  10000 (64.30%), best:    6528/10000 (65.28%), error:     11607.08594, best error:     10283.17871 on epoch:     0, epoch:    7/25, mu: 0.6993616223, learning_rate: 0.0000060902, weight_decay: 0.0001551722

epoch time: 3124.8708496094s, input_fired_time: 51.8904228210, output_fired_time: 25.8980808258, propagate_forward_time: 1194.6380615234, propagate_backward_time: 1814.0216064453, weight_update_time: 0.7756087184, other_time: 38.4226074219
epoch time: 251.4583740234s, input_fired_time: 3.5147786140, output_fired_time: 0.0000000000, propagate_forward_time: 239.5688781738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.3747100830
validation[          , genome  6201] predictions:    6395/  10000 (63.95%), best:    6528/10000 (65.28%), error:     11783.78516, best error:     10283.17871 on epoch:     0, epoch:    8/25, mu: 0.7199065089, learning_rate: 0.0000056737, weight_decay: 0.0001457207

epoch time: 3122.0974121094s, input_fired_time: 46.6523399353, output_fired_time: 24.9224624634, propagate_forward_time: 1202.7429199219, propagate_backward_time: 1810.0972900391, weight_update_time: 0.7681022286, other_time: 37.6824951172
epoch time: 254.9895019531s, input_fired_time: 4.5356540680, output_fired_time: 0.0000000000, propagate_forward_time: 241.9378051758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5160369873
validation[          , genome  6201] predictions:    6354/  10000 (63.54%), best:    6528/10000 (65.28%), error:     11893.39648, best error:     10283.17871 on epoch:     0, epoch:    9/25, mu: 0.7389990687, learning_rate: 0.0000052857, weight_decay: 0.0001368448

epoch time: 3133.2856445313s, input_fired_time: 46.7111244202, output_fired_time: 29.0627174377, propagate_forward_time: 1198.2148437500, propagate_backward_time: 1820.6773681641, weight_update_time: 0.7824803591, other_time: 38.6195068359
epoch time: 251.3930816650s, input_fired_time: 4.6141180992, output_fired_time: 0.0000000000, propagate_forward_time: 240.4097747803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3691864014
validation[          , genome  6201] predictions:    6351/  10000 (63.51%), best:    6528/10000 (65.28%), error:     12024.16504, best error:     10283.17871 on epoch:     0, epoch:   10/25, mu: 0.7567420006, learning_rate: 0.0000049242, weight_decay: 0.0001285095

epoch time: 3119.7563476563s, input_fired_time: 50.7414932251, output_fired_time: 25.8668899536, propagate_forward_time: 1196.6811523438, propagate_backward_time: 1808.6784667969, weight_update_time: 0.7835853696, other_time: 37.7883300781
epoch time: 254.6086425781s, input_fired_time: 5.5332250595, output_fired_time: 0.0000000000, propagate_forward_time: 241.4743652344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.6010589600
validation[          , genome  6201] predictions:    6327/  10000 (63.27%), best:    6528/10000 (65.28%), error:     12155.37598, best error:     10283.17871 on epoch:     0, epoch:   11/25, mu: 0.7732307315, learning_rate: 0.0000045874, weight_decay: 0.0001206820

epoch time: 3124.4833984375s, input_fired_time: 49.5984802246, output_fired_time: 26.2762317657, propagate_forward_time: 1192.9571533203, propagate_backward_time: 1818.2143554688, weight_update_time: 0.7752490044, other_time: 37.4373779297
epoch time: 255.4991455078s, input_fired_time: 3.5831205845, output_fired_time: 0.0000000000, propagate_forward_time: 245.3219451904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5940856934
validation[          , genome  6201] predictions:    6284/  10000 (62.84%), best:    6528/10000 (65.28%), error:     12229.05957, best error:     10283.17871 on epoch:     0, epoch:   12/25, mu: 0.7885538936, learning_rate: 0.0000042737, weight_decay: 0.0001133312

epoch time: 3137.8935546875s, input_fired_time: 49.4942054749, output_fired_time: 25.1578178406, propagate_forward_time: 1196.9042968750, propagate_backward_time: 1827.2508544922, weight_update_time: 0.8073579073, other_time: 39.0865478516
epoch time: 252.2207794189s, input_fired_time: 4.6290378571, output_fired_time: 0.0000000000, propagate_forward_time: 240.2547149658, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.3370208740
validation[          , genome  6201] predictions:    6183/  10000 (61.83%), best:    6528/10000 (65.28%), error:     12334.54004, best error:     10283.17871 on epoch:     0, epoch:   13/25, mu: 0.8027938604, learning_rate: 0.0000039814, weight_decay: 0.0001064282

epoch time: 3113.5190429688s, input_fired_time: 46.8987388611, output_fired_time: 25.0394859314, propagate_forward_time: 1188.6518554688, propagate_backward_time: 1816.5760498047, weight_update_time: 0.7738507986, other_time: 36.3529052734
epoch time: 251.0667419434s, input_fired_time: 3.5130939484, output_fired_time: 0.0000000000, propagate_forward_time: 241.3537292480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1999206543
validation[          , genome  6201] predictions:    6226/  10000 (62.26%), best:    6528/10000 (65.28%), error:     12414.63477, best error:     10283.17871 on epoch:     0, epoch:   14/25, mu: 0.8160272241, learning_rate: 0.0000037091, weight_decay: 0.0000999456

epoch time: 3093.3337402344s, input_fired_time: 45.7010154724, output_fired_time: 24.8219356537, propagate_forward_time: 1184.9942626953, propagate_backward_time: 1801.3880615234, weight_update_time: 0.7577382922, other_time: 36.4284667969
epoch time: 250.4585876465s, input_fired_time: 4.4964222908, output_fired_time: 0.0000000000, propagate_forward_time: 238.2420654297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.7200927734
validation[          , genome  6201] predictions:    6184/  10000 (61.84%), best:    6528/10000 (65.28%), error:     12441.10059, best error:     10283.17871 on epoch:     0, epoch:   15/25, mu: 0.8283251524, learning_rate: 0.0000034554, weight_decay: 0.0000938579

epoch time: 3091.0932617188s, input_fired_time: 47.9872436523, output_fired_time: 24.9668407440, propagate_forward_time: 1176.9079589844, propagate_backward_time: 1803.2622070313, weight_update_time: 0.7778047919, other_time: 37.9689941406
epoch time: 250.8157348633s, input_fired_time: 3.4639213085, output_fired_time: 0.0000000000, propagate_forward_time: 240.9660949707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.3857116699
validation[          , genome  6201] predictions:    6136/  10000 (61.36%), best:    6528/10000 (65.28%), error:     12521.71387, best error:     10283.17871 on epoch:     0, epoch:   16/25, mu: 0.8397537470, learning_rate: 0.0000032191, weight_decay: 0.0000881410

epoch time: 3101.6320800781s, input_fired_time: 50.0846633911, output_fired_time: 26.0532684326, propagate_forward_time: 1172.3209228516, propagate_backward_time: 1815.9088134766, weight_update_time: 1.7478812933, other_time: 37.2644042969
epoch time: 253.9213256836s, input_fired_time: 3.5467081070, output_fired_time: 0.0000000000, propagate_forward_time: 244.1548614502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2197570801
validation[          , genome  6201] predictions:    6150/  10000 (61.50%), best:    6528/10000 (65.28%), error:     12585.77148, best error:     10283.17871 on epoch:     0, epoch:   17/25, mu: 0.8503744602, learning_rate: 0.0000029989, weight_decay: 0.0000827723

epoch time: 3090.8981933594s, input_fired_time: 42.0475082397, output_fired_time: 28.6505775452, propagate_forward_time: 1172.8514404297, propagate_backward_time: 1809.6345214844, weight_update_time: 0.7726575732, other_time: 37.7139892578
epoch time: 251.2675170898s, input_fired_time: 3.4597675800, output_fired_time: 0.0000000000, propagate_forward_time: 240.6588287354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1489257813
validation[          , genome  6201] predictions:    6110/  10000 (61.10%), best:    6528/10000 (65.28%), error:     12549.86426, best error:     10283.17871 on epoch:     0, epoch:   18/25, mu: 0.8602443933, learning_rate: 0.0000027938, weight_decay: 0.0000777306

epoch time: 3090.7353515625s, input_fired_time: 48.3694953918, output_fired_time: 26.8836021423, propagate_forward_time: 1183.4353027344, propagate_backward_time: 1793.6004638672, weight_update_time: 0.7765336037, other_time: 38.4466552734
epoch time: 253.8811950684s, input_fired_time: 3.4830346107, output_fired_time: 0.0000000000, propagate_forward_time: 244.1482849121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2498779297
validation[          , genome  6201] predictions:    6106/  10000 (61.06%), best:    6528/10000 (65.28%), error:     12607.29688, best error:     10283.17871 on epoch:     0, epoch:   19/25, mu: 0.8694166541, learning_rate: 0.0000026028, weight_decay: 0.0000729960

epoch time: 3083.2353515625s, input_fired_time: 47.5465888977, output_fired_time: 26.0995044708, propagate_forward_time: 1172.3724365234, propagate_backward_time: 1803.3441162109, weight_update_time: 0.7801712155, other_time: 33.8725585938
epoch time: 250.4846343994s, input_fired_time: 4.4747719765, output_fired_time: 0.0000000000, propagate_forward_time: 238.8237152100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1861419678
validation[          , genome  6201] predictions:    6061/  10000 (60.61%), best:    6528/10000 (65.28%), error:     12665.81348, best error:     10283.17871 on epoch:     0, epoch:   20/25, mu: 0.8779405355, learning_rate: 0.0000024248, weight_decay: 0.0000685498

epoch time: 3115.2810058594s, input_fired_time: 45.8201828003, output_fired_time: 24.8625659943, propagate_forward_time: 1197.2517089844, propagate_backward_time: 1810.3560791016, weight_update_time: 0.7716033459, other_time: 36.9906005859
epoch time: 248.1766662598s, input_fired_time: 3.4367289543, output_fired_time: 0.0000000000, propagate_forward_time: 238.4410705566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2988739014
validation[          , genome  6201] predictions:    6093/  10000 (60.93%), best:    6528/10000 (65.28%), error:     12650.77246, best error:     10283.17871 on epoch:     0, epoch:   21/25, mu: 0.8858618736, learning_rate: 0.0000022589, weight_decay: 0.0000643744

epoch time: 3066.5908203125s, input_fired_time: 45.4425926208, output_fired_time: 25.0189018250, propagate_forward_time: 1161.4145507813, propagate_backward_time: 1798.6744384766, weight_update_time: 1.7513631582, other_time: 36.0404052734
epoch time: 249.0936126709s, input_fired_time: 4.4056544304, output_fired_time: 0.0000000000, propagate_forward_time: 238.5466918945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1412658691
validation[          , genome  6201] predictions:    6066/  10000 (60.66%), best:    6528/10000 (65.28%), error:     12711.07422, best error:     10283.17871 on epoch:     0, epoch:   22/25, mu: 0.8932232857, learning_rate: 0.0000021044, weight_decay: 0.0000604534

epoch time: 3075.9060058594s, input_fired_time: 47.0091934204, output_fired_time: 24.9417285919, propagate_forward_time: 1176.5449218750, propagate_backward_time: 1790.8289794922, weight_update_time: 0.7601581216, other_time: 36.5811767578
epoch time: 250.3469390869s, input_fired_time: 3.4294471741, output_fired_time: 0.0000000000, propagate_forward_time: 238.7898406982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.1276550293
validation[          , genome  6201] predictions:    6043/  10000 (60.43%), best:    6528/10000 (65.28%), error:     12764.47949, best error:     10283.17871 on epoch:     0, epoch:   23/25, mu: 0.9000642896, learning_rate: 0.0000019605, weight_decay: 0.0000567712

epoch time: 3056.4719238281s, input_fired_time: 44.3148117065, output_fired_time: 25.5277271271, propagate_forward_time: 1166.9726562500, propagate_backward_time: 1781.8081054688, weight_update_time: 0.7615130544, other_time: 37.8486328125
epoch time: 253.1158599854s, input_fired_time: 3.5014560223, output_fired_time: 0.0000000000, propagate_forward_time: 243.1669616699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4474487305
validation[          , genome  6201] predictions:    6049/  10000 (60.49%), best:    6528/10000 (65.28%), error:     12713.33594, best error:     10283.17871 on epoch:     0, epoch:   24/25, mu: 0.9064217210, learning_rate: 0.0000018264, weight_decay: 0.0000533132

epoch time: 3062.9121093750s, input_fired_time: 44.6767845154, output_fired_time: 25.5848979950, propagate_forward_time: 1168.3469238281, propagate_backward_time: 1788.3626708984, weight_update_time: 0.7499066591, other_time: 35.9407958984
epoch time: 252.9578094482s, input_fired_time: 4.5191140175, output_fired_time: 0.0000000000, propagate_forward_time: 241.0301666260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4085235596
validation[          , genome  6201] predictions:    5955/  10000 (59.55%), best:    6528/10000 (65.28%), error:     12888.87305, best error:     10283.17871 on epoch:     0, epoch:   25/25, mu: 0.9123297930, learning_rate: 0.0000017015, weight_decay: 0.0000500659

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1210.3081054688s, input_fired_time: 16.7168292999, output_fired_time: 0.0000000000, propagate_forward_time: 1159.3875732422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 34.2037353516
best training[          , genome  6201] predictions:   36163/  50000 (72.33%), best:    6528/10000 (65.28%), error:     43356.34766, best error:     10283.17871 on epoch:     0, epoch:   26/25, mu: 0.9178202152, learning_rate: 0.0000015851, weight_decay: 0.0000470164
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 252.1750030518s, input_fired_time: 3.5352327824, output_fired_time: 0.0000000000, propagate_forward_time: 241.2214355469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4183349609
   testing[          , genome  6201] predictions:    6528/  10000 (65.28%), best:    6528/10000 (65.28%), error:     10283.17871, best error:     10283.17871 on epoch:     0, epoch:   26/25, mu: 0.9178202152, learning_rate: 0.0000015851, weight_decay: 0.0000470164
backpropagation finished successfully!
05:47:21 (13856): called boinc_finish(0)

</stderr_txt>
]]>