Nameexact_genome_1542727803_170_6407_2
Workunit4101242
Created21 Nov 2018, 19:56:32 UTC
Sent21 Nov 2018, 19:56:42 UTC
Report deadline18 Dec 2018, 9:59:22 UTC
Received22 Nov 2018, 2:47:42 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID87483
Run time6 hours 50 min 3 sec
CPU time6 hours 48 min 58 sec
Validate stateValid
Credit6,646.30
Device peak FLOPS4.23 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size570.92 MB
Peak swap size590.56 MB
Peak disk usage11.13 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542727803_170_6407.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542727803_170_6407_2_r648207453_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542727803_170_6407.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.465417
read mu: 0.465417
read mu_delta: 0.938004
read initial_learning_rate: 0.000760538
read learning_rate: 0.000760538
read learning_rate_delta: 0.907858
read initial_weight_decay: 0.000185818
read weight_decay: 0.000185818
read weight_decay_delta: 0.927723
read batch_size: 105
read epsilon: 1e-07
read alpha: 0.0544597
read input_dropout_probability: 0.00147653
read hidden_dropout_probability: 0.076776
read velocity_reset: 1375
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6407
read normal distribution: '0 0.188173338770866 -1.22087144851685'
generator_str: '1662880538'
read generator: 1662880538
read generated_by_map:
1 split_node 1
reading 105 nodes.
reading 382 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 681020108
post shuffle 1: 1430441438
epoch time: 862.39306640625s, input_fired_time: 18.3947429656982, output_fired_time: 5.26779937744141, propagate_forward_time: 315.867279052734, propagate_backward_time: 503.692474365234, weight_update_time: 0.230165928602219, other_time: 19.1708068847656
epoch time: 67.3408203125s, input_fired_time: 1.11130058765411, output_fired_time: 0, propagate_forward_time: 62.6798286437988, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.5496940612793
validation[          , genome  6407] predictions:    6034/  10000 (60.34%), best:    6034/10000 (60.34%), error:     11367.93262, best error:     11367.93262 on epoch:     0, epoch:    0/25, mu: 0.4654174447, learning_rate: 0.0007605383, weight_decay: 0.0001858183

epoch time: 857.6723022461s, input_fired_time: 18.3559036255, output_fired_time: 5.2328553200, propagate_forward_time: 311.6640930176, propagate_backward_time: 503.3442077637, weight_update_time: 0.2345257998, other_time: 19.0752258301
epoch time: 68.1749420166s, input_fired_time: 1.1117533445, output_fired_time: 0.0000000000, propagate_forward_time: 63.4931221008, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5700645447
validation[          , genome  6407] predictions:    5922/  10000 (59.22%), best:    6034/10000 (60.34%), error:     11635.33301, best error:     11367.93262 on epoch:     0, epoch:    1/25, mu: 0.4979394078, learning_rate: 0.0006904609, weight_decay: 0.0001723880

epoch time: 863.3915405273s, input_fired_time: 18.3848972321, output_fired_time: 5.2701792717, propagate_forward_time: 316.5871582031, propagate_backward_time: 504.0211486816, weight_update_time: 0.2406383753, other_time: 19.1281433105
epoch time: 67.3286437988s, input_fired_time: 1.1112993956, output_fired_time: 0.0000000000, propagate_forward_time: 62.6548500061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5624961853
validation[          , genome  6407] predictions:    6041/  10000 (60.41%), best:    6041/10000 (60.41%), error:     11314.12988, best error:     11314.12988 on epoch:     2, epoch:    2/25, mu: 0.5284451246, learning_rate: 0.0006268406, weight_decay: 0.0001599283

epoch time: 864.5186157227s, input_fired_time: 18.3817272186, output_fired_time: 5.2794260979, propagate_forward_time: 318.0765686035, propagate_backward_time: 503.5709533691, weight_update_time: 0.2336959392, other_time: 19.2099304199
epoch time: 67.5074996948s, input_fired_time: 1.1352187395, output_fired_time: 0.0000000000, propagate_forward_time: 62.7775344849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5947494507
validation[          , genome  6407] predictions:    5539/  10000 (55.39%), best:    6041/10000 (60.41%), error:     13392.86816, best error:     11314.12988 on epoch:     2, epoch:    3/25, mu: 0.5570596457, learning_rate: 0.0005690823, weight_decay: 0.0001483692

epoch time: 857.7819824219s, input_fired_time: 18.4024868011, output_fired_time: 5.1550936699, propagate_forward_time: 311.5842895508, propagate_backward_time: 503.6491699219, weight_update_time: 0.2068819255, other_time: 18.9909667969
epoch time: 67.2533035278s, input_fired_time: 1.1390117407, output_fired_time: 0.0000000000, propagate_forward_time: 62.5142364502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6000518799
validation[          , genome  6407] predictions:    5942/  10000 (59.42%), best:    6041/10000 (60.41%), error:     11646.97363, best error:     11314.12988 on epoch:     2, epoch:    4/25, mu: 0.5839001536, learning_rate: 0.0005166460, weight_decay: 0.0001376455

epoch time: 864.8353881836s, input_fired_time: 18.4441108704, output_fired_time: 5.2875204086, propagate_forward_time: 318.4571533203, propagate_backward_time: 503.2225341797, weight_update_time: 0.2328119725, other_time: 19.4240722656
epoch time: 69.4174194336s, input_fired_time: 1.1480568647, output_fired_time: 0.0000000000, propagate_forward_time: 64.6946868896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5746765137
validation[          , genome  6407] predictions:    5961/  10000 (59.61%), best:    6041/10000 (60.41%), error:     11445.71484, best error:     11314.12988 on epoch:     2, epoch:    5/25, mu: 0.6090766788, learning_rate: 0.0004690413, weight_decay: 0.0001276969

epoch time: 862.4979248047s, input_fired_time: 18.4139556885, output_fired_time: 5.2797665596, propagate_forward_time: 316.5161743164, propagate_backward_time: 502.9258728027, weight_update_time: 0.2378244102, other_time: 19.3621520996
epoch time: 66.8480682373s, input_fired_time: 1.1490303278, output_fired_time: 0.0000000000, propagate_forward_time: 62.1965026855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5025329590
validation[          , genome  6407] predictions:    6075/  10000 (60.75%), best:    6075/10000 (60.75%), error:     11228.50684, best error:     11228.50684 on epoch:     6, epoch:    6/25, mu: 0.6326923370, learning_rate: 0.0004258229, weight_decay: 0.0001184674

epoch time: 864.2645263672s, input_fired_time: 18.4180774689, output_fired_time: 5.2801833153, propagate_forward_time: 317.5379333496, propagate_backward_time: 503.7042541504, weight_update_time: 0.2379349917, other_time: 19.3240661621
epoch time: 68.2205505371s, input_fired_time: 1.1395003796, output_fired_time: 0.0000000000, propagate_forward_time: 63.5067901611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5742568970
validation[          , genome  6407] predictions:    5985/  10000 (59.85%), best:    6075/10000 (60.75%), error:     11697.42773, best error:     11228.50684 on epoch:     6, epoch:    7/25, mu: 0.6548439264, learning_rate: 0.0003865868, weight_decay: 0.0001099049

epoch time: 869.4412841797s, input_fired_time: 18.4389076233, output_fired_time: 5.2988786697, propagate_forward_time: 320.8858642578, propagate_backward_time: 505.4602661133, weight_update_time: 0.2330496013, other_time: 19.3573608398
epoch time: 68.0530395508s, input_fired_time: 1.1451644897, output_fired_time: 0.0000000000, propagate_forward_time: 63.3083763123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5994987488
validation[          , genome  6407] predictions:    6249/  10000 (62.49%), best:    6249/10000 (62.49%), error:     10876.00488, best error:     10876.00488 on epoch:     8, epoch:    8/25, mu: 0.6756222248, learning_rate: 0.0003509660, weight_decay: 0.0001019613

epoch time: 865.0887451172s, input_fired_time: 18.4227905273, output_fired_time: 5.2859220505, propagate_forward_time: 317.8316345215, propagate_backward_time: 504.1116638184, weight_update_time: 0.2352516353, other_time: 19.4366760254
epoch time: 67.5222549438s, input_fired_time: 1.1618535519, output_fired_time: 0.0000000000, propagate_forward_time: 62.8080368042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5523681641
validation[          , genome  6407] predictions:    6302/  10000 (63.02%), best:    6302/10000 (63.02%), error:     10757.57813, best error:     10757.57813 on epoch:     9, epoch:    9/25, mu: 0.6951123476, learning_rate: 0.0003186273, weight_decay: 0.0000945919

epoch time: 867.4575195313s, input_fired_time: 18.4667205811, output_fired_time: 5.3545560837, propagate_forward_time: 316.6657714844, propagate_backward_time: 507.5047607422, weight_update_time: 0.2389281094, other_time: 19.4656982422
epoch time: 67.6037673950s, input_fired_time: 1.1643353701, output_fired_time: 0.0000000000, propagate_forward_time: 62.8500404358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5893898010
validation[          , genome  6407] predictions:    6271/  10000 (62.71%), best:    6271/10000 (62.71%), error:     10724.18848, best error:     10724.18848 on epoch:    10, epoch:   10/25, mu: 0.7133941650, learning_rate: 0.0002892684, weight_decay: 0.0000877551

epoch time: 862.2790527344s, input_fired_time: 18.4479770660, output_fired_time: 5.2950944901, propagate_forward_time: 314.6899719238, propagate_backward_time: 504.2798156738, weight_update_time: 0.2393244058, other_time: 19.5661315918
epoch time: 66.9082565308s, input_fired_time: 1.1552150249, output_fired_time: 0.0000000000, propagate_forward_time: 62.1056823730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6473617554
validation[          , genome  6407] predictions:    6003/  10000 (60.03%), best:    6271/10000 (62.71%), error:     11624.12012, best error:     10724.18848 on epoch:    10, epoch:   11/25, mu: 0.7305426002, learning_rate: 0.0002626147, weight_decay: 0.0000814124

epoch time: 861.2536621094s, input_fired_time: 18.4466972351, output_fired_time: 5.2655625343, propagate_forward_time: 313.7905883789, propagate_backward_time: 504.2873535156, weight_update_time: 0.2302186489, other_time: 19.4634399414
epoch time: 67.5158233643s, input_fired_time: 1.1327880621, output_fired_time: 0.0000000000, propagate_forward_time: 62.8398323059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5432014465
validation[          , genome  6407] predictions:    6173/  10000 (61.73%), best:    6271/10000 (62.71%), error:     11144.61426, best error:     10724.18848 on epoch:    10, epoch:   12/25, mu: 0.7466278672, learning_rate: 0.0002384169, weight_decay: 0.0000755282

epoch time: 855.8868408203s, input_fired_time: 18.4293270111, output_fired_time: 5.1540145874, propagate_forward_time: 309.2685241699, propagate_backward_time: 503.9449462891, weight_update_time: 0.2051152438, other_time: 19.0900878906
epoch time: 68.2581787109s, input_fired_time: 1.1319850683, output_fired_time: 0.0000000000, propagate_forward_time: 63.5744514465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5517387390
validation[          , genome  6407] predictions:    6231/  10000 (62.31%), best:    6271/10000 (62.71%), error:     10849.36816, best error:     10724.18848 on epoch:    10, epoch:   13/25, mu: 0.7617159486, learning_rate: 0.0002164487, weight_decay: 0.0000700693

epoch time: 857.6137695313s, input_fired_time: 18.4349727631, output_fired_time: 5.1486821175, propagate_forward_time: 312.1642456055, propagate_backward_time: 502.6421508789, weight_update_time: 0.2094634324, other_time: 19.2236938477
epoch time: 66.0593948364s, input_fired_time: 1.1339515448, output_fired_time: 0.0000000000, propagate_forward_time: 61.2863922119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6390533447
validation[          , genome  6407] predictions:    6315/  10000 (63.15%), best:    6315/10000 (63.15%), error:     10713.24121, best error:     10713.24121 on epoch:    14, epoch:   14/25, mu: 0.7758685946, learning_rate: 0.0001965047, weight_decay: 0.0000650049

epoch time: 861.4429321289s, input_fired_time: 18.4405117035, output_fired_time: 5.2043561935, propagate_forward_time: 312.6066284180, propagate_backward_time: 506.0643005371, weight_update_time: 0.2127947360, other_time: 19.1271667480
epoch time: 67.3365325928s, input_fired_time: 1.1500259638, output_fired_time: 0.0000000000, propagate_forward_time: 62.6317405701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5547676086
validation[          , genome  6407] predictions:    6304/  10000 (63.04%), best:    6304/10000 (63.04%), error:     10588.40430, best error:     10588.40430 on epoch:    15, epoch:   15/25, mu: 0.7891438603, learning_rate: 0.0001783984, weight_decay: 0.0000603065

epoch time: 861.3670043945s, input_fired_time: 18.4755916595, output_fired_time: 5.1600270271, propagate_forward_time: 314.3450622559, propagate_backward_time: 504.4411621094, weight_update_time: 0.2070468366, other_time: 18.9451904297
epoch time: 66.5815124512s, input_fired_time: 1.1365689039, output_fired_time: 0.0000000000, propagate_forward_time: 61.8892898560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5556564331
validation[          , genome  6407] predictions:    6313/  10000 (63.13%), best:    6304/10000 (63.04%), error:     10691.24121, best error:     10588.40430 on epoch:    15, epoch:   16/25, mu: 0.8015961051, learning_rate: 0.0001619604, weight_decay: 0.0000559477

epoch time: 860.6737670898s, input_fired_time: 18.4888839722, output_fired_time: 5.1894526482, propagate_forward_time: 313.4661254883, propagate_backward_time: 504.3227233887, weight_update_time: 0.2073287219, other_time: 19.2065734863
epoch time: 66.3197937012s, input_fired_time: 1.1450440884, output_fired_time: 0.0000000000, propagate_forward_time: 61.6278495789, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5469017029
validation[          , genome  6407] predictions:    6403/  10000 (64.03%), best:    6403/10000 (64.03%), error:     10464.66016, best error:     10464.66016 on epoch:    17, epoch:   17/25, mu: 0.8132763505, learning_rate: 0.0001470371, weight_decay: 0.0000519040

epoch time: 855.3784179688s, input_fired_time: 18.4816627502, output_fired_time: 5.1762962341, propagate_forward_time: 308.6021118164, propagate_backward_time: 503.7375488281, weight_update_time: 0.2065606862, other_time: 19.3807983398
epoch time: 67.1534957886s, input_fired_time: 1.1382325888, output_fired_time: 0.0000000000, propagate_forward_time: 62.4584617615, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5568046570
validation[          , genome  6407] predictions:    6342/  10000 (63.42%), best:    6403/10000 (64.03%), error:     10485.79199, best error:     10464.66016 on epoch:    17, epoch:   18/25, mu: 0.8242324591, learning_rate: 0.0001334888, weight_decay: 0.0000481526

epoch time: 858.0483398438s, input_fired_time: 18.4843330383, output_fired_time: 5.1727433205, propagate_forward_time: 311.0313720703, propagate_backward_time: 504.0400390625, weight_update_time: 0.2076044232, other_time: 19.3198852539
epoch time: 68.5836639404s, input_fired_time: 1.1491017342, output_fired_time: 0.0000000000, propagate_forward_time: 63.9048347473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5297279358
validation[          , genome  6407] predictions:    6424/  10000 (64.24%), best:    6424/10000 (64.24%), error:     10433.75488, best error:     10433.75488 on epoch:    19, epoch:   19/25, mu: 0.8345093727, learning_rate: 0.0001211889, weight_decay: 0.0000446722

epoch time: 864.5447387695s, input_fired_time: 18.5225696564, output_fired_time: 5.2646532059, propagate_forward_time: 316.9978942871, propagate_backward_time: 504.2846984863, weight_update_time: 0.2322960496, other_time: 19.4749450684
epoch time: 70.4866638184s, input_fired_time: 1.1583026648, output_fired_time: 0.0000000000, propagate_forward_time: 65.7186737061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6096878052
validation[          , genome  6407] predictions:    6217/  10000 (62.17%), best:    6424/10000 (64.24%), error:     10925.20313, best error:     10433.75488 on epoch:    19, epoch:   20/25, mu: 0.8441491723, learning_rate: 0.0001100224, weight_decay: 0.0000414435

epoch time: 863.8776245117s, input_fired_time: 18.5188121796, output_fired_time: 5.2915525436, propagate_forward_time: 316.9031982422, propagate_backward_time: 503.4326171875, weight_update_time: 0.2349738777, other_time: 19.7314453125
epoch time: 67.9109115601s, input_fired_time: 1.1662600040, output_fired_time: 0.0000000000, propagate_forward_time: 63.1443405151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6003112793
validation[          , genome  6407] predictions:    6329/  10000 (63.29%), best:    6424/10000 (64.24%), error:     10635.86816, best error:     10433.75488 on epoch:    19, epoch:   21/25, mu: 0.8531913161, learning_rate: 0.0000998847, weight_decay: 0.0000384481

epoch time: 862.9728393555s, input_fired_time: 18.5318889618, output_fired_time: 5.2776193619, propagate_forward_time: 316.1007385254, propagate_backward_time: 503.4815673828, weight_update_time: 0.2370348573, other_time: 19.5810546875
epoch time: 68.9669876099s, input_fired_time: 1.1673754454, output_fired_time: 0.0000000000, propagate_forward_time: 64.2165603638, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5830535889
validation[          , genome  6407] predictions:    6368/  10000 (63.68%), best:    6424/10000 (64.24%), error:     10438.14453, best error:     10433.75488 on epoch:    19, epoch:   22/25, mu: 0.8616728783, learning_rate: 0.0000906811, weight_decay: 0.0000356692

epoch time: 866.6027221680s, input_fired_time: 18.5478210449, output_fired_time: 5.3046813011, propagate_forward_time: 318.5246276855, propagate_backward_time: 504.7389221191, weight_update_time: 0.2358028591, other_time: 19.4866638184
epoch time: 66.5284271240s, input_fired_time: 1.1688586473, output_fired_time: 0.0000000000, propagate_forward_time: 61.7989196777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5606460571
validation[          , genome  6407] predictions:    6282/  10000 (62.82%), best:    6424/10000 (64.24%), error:     10682.93359, best error:     10433.75488 on epoch:    19, epoch:   23/25, mu: 0.8696286082, learning_rate: 0.0000823256, weight_decay: 0.0000330911

epoch time: 861.8375244141s, input_fired_time: 18.5414867401, output_fired_time: 5.2786784172, propagate_forward_time: 315.7816772461, propagate_backward_time: 502.6481018066, weight_update_time: 0.2346296906, other_time: 19.5875549316
epoch time: 68.5441436768s, input_fired_time: 1.1739290953, output_fired_time: 0.0000000000, propagate_forward_time: 63.7875137329, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5827026367
validation[          , genome  6407] predictions:    6290/  10000 (62.90%), best:    6424/10000 (64.24%), error:     10800.94336, best error:     10433.75488 on epoch:    19, epoch:   24/25, mu: 0.8770911098, learning_rate: 0.0000747400, weight_decay: 0.0000306994

epoch time: 864.0267944336s, input_fired_time: 18.5740318298, output_fired_time: 5.2666053772, propagate_forward_time: 315.8373413086, propagate_backward_time: 504.5992126465, weight_update_time: 0.2315071672, other_time: 19.7496032715
epoch time: 68.4721221924s, input_fired_time: 1.1734988689, output_fired_time: 0.0000000000, propagate_forward_time: 63.6665802002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6320419312
validation[          , genome  6407] predictions:    6419/  10000 (64.19%), best:    6419/10000 (64.19%), error:     10306.08008, best error:     10306.08008 on epoch:    25, epoch:   25/25, mu: 0.8840910196, learning_rate: 0.0000678533, weight_decay: 0.0000284805

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 337.9306945801s, input_fired_time: 5.8657450676, output_fired_time: 0.0000000000, propagate_forward_time: 313.9817810059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.0831604004
best training[          , genome  6407] predictions:   35346/  50000 (70.69%), best:    6419/10000 (64.19%), error:     44232.01172, best error:     10306.08008 on epoch:    25, epoch:   26/25, mu: 0.8906569481, learning_rate: 0.0000616012, weight_decay: 0.0000264220
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 69.2007141113s, input_fired_time: 1.1820549965, output_fired_time: 0.0000000000, propagate_forward_time: 64.4483413696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5703201294
   testing[          , genome  6407] predictions:    6419/  10000 (64.19%), best:    6419/10000 (64.19%), error:     10306.08008, best error:     10306.08008 on epoch:    25, epoch:   26/25, mu: 0.8906569481, learning_rate: 0.0000616012, weight_decay: 0.0000264220
backpropagation finished successfully!
06:46:48 (8260): called boinc_finish(0)

</stderr_txt>
]]>