Nameexact_genome_1542727803_172_6421_0
Workunit4101317
Created20 Nov 2018, 20:14:39 UTC
Sent20 Nov 2018, 20:15:03 UTC
Report deadline16 Dec 2018, 20:29:19 UTC
Received21 Nov 2018, 6:16:47 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID60660
Run time8 hours 18 min 23 sec
CPU time7 hours 59 min 25 sec
Validate stateValid
Credit6,502.48
Device peak FLOPS3.44 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size573.34 MB
Peak swap size593.20 MB
Peak disk usage12.41 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542727803_172_6421.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542727803_172_6421_0_r2029499302_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542727803_172_6421.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495051
read mu: 0.495051
read mu_delta: 0.935167
read initial_learning_rate: 1e-05
read learning_rate: 1e-05
read learning_rate_delta: 0.928606
read initial_weight_decay: 0.00023213
read weight_decay: 0.00023213
read weight_decay_delta: 0.941462
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0923785
read input_dropout_probability: 0.00136497
read hidden_dropout_probability: 0.0815468
read velocity_reset: 1821
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6421
read normal distribution: '1 0 0'
generator_str: '1523503638'
read generator: 1523503638
read generated_by_map:
1 disable_edge 1
reading 99 nodes.
reading 410 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1078120685
post shuffle 1: 1367077763
epoch time: 1031.57556152344s, input_fired_time: 22.9836006164551, output_fired_time: 7.9572639465332, propagate_forward_time: 376.202941894531, propagate_backward_time: 610.498962402344, weight_update_time: 0.322768598794937, other_time: 13.9328002929688
epoch time: 80.2254791259766s, input_fired_time: 1.46233510971069, output_fired_time: 0, propagate_forward_time: 76.3763885498047, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.38675689697266
validation[          , genome  6421] predictions:    6568/  10000 (65.68%), best:    6568/10000 (65.68%), error:     10103.60645, best error:     10103.60645 on epoch:     0, epoch:    0/25, mu: 0.4950514734, learning_rate: 0.0000100000, weight_decay: 0.0002321304

epoch time: 1033.5902099609s, input_fired_time: 23.0109405518, output_fired_time: 8.0966768265, propagate_forward_time: 376.9865112305, propagate_backward_time: 611.5897827148, weight_update_time: 0.3264701366, other_time: 13.9063110352
epoch time: 79.3621292114s, input_fired_time: 1.4500766993, output_fired_time: 0.0000000000, propagate_forward_time: 75.5169143677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3951416016
validation[          , genome  6421] predictions:    6634/  10000 (66.34%), best:    6568/10000 (65.68%), error:     10224.58301, best error:     10103.60645 on epoch:     0, epoch:    1/25, mu: 0.5271403193, learning_rate: 0.0000092861, weight_decay: 0.0002185420

epoch time: 1032.5369873047s, input_fired_time: 23.0240268707, output_fired_time: 8.0274257660, propagate_forward_time: 376.6749267578, propagate_backward_time: 610.9280395508, weight_update_time: 0.3267015815, other_time: 13.8825683594
epoch time: 79.5203323364s, input_fired_time: 1.4905873537, output_fired_time: 0.0000000000, propagate_forward_time: 75.5968704224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4328765869
validation[          , genome  6421] predictions:    6650/  10000 (66.50%), best:    6568/10000 (65.68%), error:     10352.70117, best error:     10103.60645 on epoch:     0, epoch:    2/25, mu: 0.5571487546, learning_rate: 0.0000086231, weight_decay: 0.0002057490

epoch time: 1034.5675048828s, input_fired_time: 23.0382556915, output_fired_time: 8.0173234940, propagate_forward_time: 378.0593872070, propagate_backward_time: 611.5228881836, weight_update_time: 0.3235523701, other_time: 13.9296264648
epoch time: 79.6560363770s, input_fired_time: 1.4608050585, output_fired_time: 0.0000000000, propagate_forward_time: 75.7920761108, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4031524658
validation[          , genome  6421] predictions:    6666/  10000 (66.66%), best:    6568/10000 (65.68%), error:     10544.57422, best error:     10103.60645 on epoch:     0, epoch:    3/25, mu: 0.5852116346, learning_rate: 0.0000080074, weight_decay: 0.0001937049

epoch time: 1031.0628662109s, input_fired_time: 22.9084415436, output_fired_time: 8.0411396027, propagate_forward_time: 376.1526184082, propagate_backward_time: 610.0309448242, weight_update_time: 0.3213413060, other_time: 13.9297485352
epoch time: 79.0476760864s, input_fired_time: 1.4792708158, output_fired_time: 0.0000000000, propagate_forward_time: 75.1545257568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4138793945
validation[          , genome  6421] predictions:    6666/  10000 (66.66%), best:    6568/10000 (65.68%), error:     10731.00391, best error:     10103.60645 on epoch:     0, epoch:    4/25, mu: 0.6114551425, learning_rate: 0.0000074358, weight_decay: 0.0001823659

epoch time: 1255.8608398438s, input_fired_time: 22.9576072693, output_fired_time: 8.0199346542, propagate_forward_time: 600.2835693359, propagate_backward_time: 610.6947631836, weight_update_time: 0.3199910820, other_time: 13.9049682617
epoch time: 79.3499908447s, input_fired_time: 1.4600484371, output_fired_time: 0.0000000000, propagate_forward_time: 75.4560470581, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4338989258
validation[          , genome  6421] predictions:    6635/  10000 (66.35%), best:    6568/10000 (65.68%), error:     10931.38281, best error:     10103.60645 on epoch:     0, epoch:    5/25, mu: 0.6359972358, learning_rate: 0.0000069049, weight_decay: 0.0001716906

epoch time: 1031.1285400391s, input_fired_time: 22.9777736664, output_fired_time: 8.0570402145, propagate_forward_time: 376.0946044922, propagate_backward_time: 609.9310302734, weight_update_time: 0.3282753229, other_time: 14.0680541992
epoch time: 78.6507949829s, input_fired_time: 1.4633615017, output_fired_time: 0.0000000000, propagate_forward_time: 74.7689666748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4184646606
validation[          , genome  6421] predictions:    6601/  10000 (66.01%), best:    6568/10000 (65.68%), error:     11131.62109, best error:     10103.60645 on epoch:     0, epoch:    6/25, mu: 0.6589481831, learning_rate: 0.0000064119, weight_decay: 0.0001616402

epoch time: 1207.9697265625s, input_fired_time: 23.0206241608, output_fired_time: 8.0895633698, propagate_forward_time: 552.1313476563, propagate_backward_time: 610.7096557617, weight_update_time: 0.3218739331, other_time: 14.0184936523
epoch time: 78.9077911377s, input_fired_time: 1.4461003542, output_fired_time: 0.0000000000, propagate_forward_time: 75.0523605347, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4093322754
validation[          , genome  6421] predictions:    6562/  10000 (65.62%), best:    6568/10000 (65.68%), error:     11332.87500, best error:     10103.60645 on epoch:     0, epoch:    7/25, mu: 0.6804111600, learning_rate: 0.0000059541, weight_decay: 0.0001521781

epoch time: 1026.8869628906s, input_fired_time: 22.8843822479, output_fired_time: 7.9553446770, propagate_forward_time: 374.5277404785, propagate_backward_time: 607.6247558594, weight_update_time: 0.3206966519, other_time: 13.8947753906
epoch time: 80.3752365112s, input_fired_time: 1.4988834858, output_fired_time: 0.0000000000, propagate_forward_time: 76.4235916138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4527587891
validation[          , genome  6421] predictions:    6510/  10000 (65.10%), best:    6568/10000 (65.68%), error:     11521.17285, best error:     10103.60645 on epoch:     0, epoch:    8/25, mu: 0.7004826069, learning_rate: 0.0000055291, weight_decay: 0.0001432699

epoch time: 1030.2445068359s, input_fired_time: 22.8566493988, output_fired_time: 8.0443658829, propagate_forward_time: 375.4253540039, propagate_backward_time: 609.8204956055, weight_update_time: 0.3230631053, other_time: 14.0976562500
epoch time: 79.5763931274s, input_fired_time: 1.4564867020, output_fired_time: 0.0000000000, propagate_forward_time: 75.7010040283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4188995361
validation[          , genome  6421] predictions:    6464/  10000 (64.64%), best:    6568/10000 (65.68%), error:     11665.74219, best error:     10103.60645 on epoch:     0, epoch:    9/25, mu: 0.7192528248, learning_rate: 0.0000051343, weight_decay: 0.0001348832

epoch time: 1028.4399414063s, input_fired_time: 22.9884433746, output_fired_time: 7.9780106544, propagate_forward_time: 375.0225219727, propagate_backward_time: 608.5180053711, weight_update_time: 0.3241289556, other_time: 13.9329223633
epoch time: 77.7991104126s, input_fired_time: 1.4395372868, output_fired_time: 0.0000000000, propagate_forward_time: 74.0215988159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3379745483
validation[          , genome  6421] predictions:    6442/  10000 (64.42%), best:    6568/10000 (65.68%), error:     11764.47363, best error:     10103.60645 on epoch:     0, epoch:   10/25, mu: 0.7368060946, learning_rate: 0.0000047677, weight_decay: 0.0001269875

epoch time: 1659.5394287109s, input_fired_time: 23.0314350128, output_fired_time: 7.9910907745, propagate_forward_time: 376.6965026855, propagate_backward_time: 1237.9149169922, weight_update_time: 0.3237247467, other_time: 13.9053955078
epoch time: 79.8871765137s, input_fired_time: 1.4782251120, output_fired_time: 0.0000000000, propagate_forward_time: 76.0192489624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3897018433
validation[          , genome  6421] predictions:    6434/  10000 (64.34%), best:    6568/10000 (65.68%), error:     11883.81738, best error:     10103.60645 on epoch:     0, epoch:   11/25, mu: 0.7532213330, learning_rate: 0.0000044274, weight_decay: 0.0001195539

epoch time: 1030.8522949219s, input_fired_time: 22.9919815063, output_fired_time: 7.9774613380, propagate_forward_time: 376.0354003906, propagate_backward_time: 609.8084106445, weight_update_time: 0.3213788271, other_time: 14.0390014648
epoch time: 80.2147445679s, input_fired_time: 1.4776259661, output_fired_time: 0.0000000000, propagate_forward_time: 76.3178787231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4192428589
validation[          , genome  6421] predictions:    6360/  10000 (63.60%), best:    6568/10000 (65.68%), error:     12002.89258, best error:     10103.60645 on epoch:     0, epoch:   12/25, mu: 0.7685723305, learning_rate: 0.0000041113, weight_decay: 0.0001125555

epoch time: 1034.3935546875s, input_fired_time: 23.0983772278, output_fired_time: 8.0221862793, propagate_forward_time: 377.3377075195, propagate_backward_time: 611.9136962891, weight_update_time: 0.3239313066, other_time: 14.0215454102
epoch time: 80.7013168335s, input_fired_time: 1.4664206505, output_fired_time: 0.0000000000, propagate_forward_time: 76.8535690308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3813247681
validation[          , genome  6421] predictions:    6350/  10000 (63.50%), best:    6568/10000 (65.68%), error:     12080.89844, best error:     10103.60645 on epoch:     0, epoch:   13/25, mu: 0.7829281092, learning_rate: 0.0000038177, weight_decay: 0.0001059667

epoch time: 1404.7740478516s, input_fired_time: 22.8389835358, output_fired_time: 7.9461631775, propagate_forward_time: 750.4057617188, propagate_backward_time: 609.6861572266, weight_update_time: 0.3210274279, other_time: 13.8969726563
epoch time: 79.0183639526s, input_fired_time: 1.4534777403, output_fired_time: 0.0000000000, propagate_forward_time: 75.1782302856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3866577148
validation[          , genome  6421] predictions:    6304/  10000 (63.04%), best:    6568/10000 (65.68%), error:     12175.41113, best error:     10103.60645 on epoch:     0, epoch:   14/25, mu: 0.7963531613, learning_rate: 0.0000035452, weight_decay: 0.0000997637

epoch time: 1632.2958984375s, input_fired_time: 22.9167118073, output_fired_time: 7.9310874939, propagate_forward_time: 977.7666625977, propagate_backward_time: 609.8637084961, weight_update_time: 0.3215299249, other_time: 13.8177490234
epoch time: 79.3211898804s, input_fired_time: 1.4354270697, output_fired_time: 0.0000000000, propagate_forward_time: 75.5455780029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3401870728
validation[          , genome  6421] predictions:    6290/  10000 (62.90%), best:    6568/10000 (65.68%), error:     12252.92676, best error:     10103.60645 on epoch:     0, epoch:   15/25, mu: 0.8089078069, learning_rate: 0.0000032921, weight_decay: 0.0000939237

epoch time: 1026.3811035156s, input_fired_time: 22.8508090973, output_fired_time: 7.9524435997, propagate_forward_time: 374.2154541016, propagate_backward_time: 607.5565185547, weight_update_time: 0.3189843297, other_time: 13.8058471680
epoch time: 79.1098327637s, input_fired_time: 1.4517685175, output_fired_time: 0.0000000000, propagate_forward_time: 75.2312240601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4268417358
validation[          , genome  6421] predictions:    6255/  10000 (62.55%), best:    6568/10000 (65.68%), error:     12325.99902, best error:     10103.60645 on epoch:     0, epoch:   16/25, mu: 0.8206484914, learning_rate: 0.0000030570, weight_decay: 0.0000884256

epoch time: 1026.1733398438s, input_fired_time: 22.8481578827, output_fired_time: 7.8986997604, propagate_forward_time: 374.3181762695, propagate_backward_time: 607.4127197266, weight_update_time: 0.3203069270, other_time: 13.6956176758
epoch time: 79.3180618286s, input_fired_time: 1.4992209673, output_fired_time: 0.0000000000, propagate_forward_time: 75.4092407227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4095993042
validation[          , genome  6421] predictions:    6237/  10000 (62.37%), best:    6568/10000 (65.68%), error:     12338.99219, best error:     10103.60645 on epoch:     0, epoch:   17/25, mu: 0.8316280246, learning_rate: 0.0000028388, weight_decay: 0.0000832494

epoch time: 1026.5285644531s, input_fired_time: 22.8565883636, output_fired_time: 7.9581074715, propagate_forward_time: 374.6870727539, propagate_backward_time: 607.0036621094, weight_update_time: 0.3228308558, other_time: 14.0231323242
epoch time: 79.4763717651s, input_fired_time: 1.4592970610, output_fired_time: 0.0000000000, propagate_forward_time: 75.6519317627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3651428223
validation[          , genome  6421] predictions:    6239/  10000 (62.39%), best:    6568/10000 (65.68%), error:     12438.85645, best error:     10103.60645 on epoch:     0, epoch:   18/25, mu: 0.8418956995, learning_rate: 0.0000026361, weight_decay: 0.0000783762

epoch time: 1246.3243408203s, input_fired_time: 22.9048061371, output_fired_time: 7.9173254967, propagate_forward_time: 593.6081542969, propagate_backward_time: 608.0935058594, weight_update_time: 0.3224582672, other_time: 13.8005371094
epoch time: 820.7410888672s, input_fired_time: 1.4695466757, output_fired_time: 0.0000000000, propagate_forward_time: 816.7391967773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5323486328
validation[          , genome  6421] predictions:    6166/  10000 (61.66%), best:    6568/10000 (65.68%), error:     12544.17188, best error:     10103.60645 on epoch:     0, epoch:   19/25, mu: 0.8514977098, learning_rate: 0.0000024479, weight_decay: 0.0000737882

epoch time: 1032.9434814453s, input_fired_time: 23.0161056519, output_fired_time: 8.0544672012, propagate_forward_time: 376.8902893066, propagate_backward_time: 611.0491333008, weight_update_time: 0.3260028064, other_time: 13.9335327148
epoch time: 79.2347564697s, input_fired_time: 1.4529682398, output_fired_time: 0.0000000000, propagate_forward_time: 75.3431472778, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4386444092
validation[          , genome  6421] predictions:    6120/  10000 (61.20%), best:    6568/10000 (65.68%), error:     12529.72656, best error:     10103.60645 on epoch:     0, epoch:   20/25, mu: 0.8604772091, learning_rate: 0.0000022731, weight_decay: 0.0000694688

epoch time: 1026.6915283203s, input_fired_time: 22.8253440857, output_fired_time: 8.0127325058, propagate_forward_time: 374.2473144531, propagate_backward_time: 607.8569946289, weight_update_time: 0.3504817784, other_time: 13.7491455078
epoch time: 79.3939590454s, input_fired_time: 1.4440404177, output_fired_time: 0.0000000000, propagate_forward_time: 75.4299850464, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5199356079
validation[          , genome  6421] predictions:    6146/  10000 (61.46%), best:    6568/10000 (65.68%), error:     12512.82227, best error:     10103.60645 on epoch:     0, epoch:   21/25, mu: 0.8688744903, learning_rate: 0.0000021109, weight_decay: 0.0000654023

epoch time: 1074.7629394531s, input_fired_time: 23.8766174316, output_fired_time: 8.2681713104, propagate_forward_time: 394.0390625000, propagate_backward_time: 633.5507202148, weight_update_time: 0.3578107357, other_time: 15.0283813477
epoch time: 89.7178115845s, input_fired_time: 1.7267608643, output_fired_time: 0.0000000000, propagate_forward_time: 85.2965393066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6945114136
validation[          , genome  6421] predictions:    6122/  10000 (61.22%), best:    6568/10000 (65.68%), error:     12542.74316, best error:     10103.60645 on epoch:     0, epoch:   22/25, mu: 0.8767274022, learning_rate: 0.0000019602, weight_decay: 0.0000615738

epoch time: 1287.7497558594s, input_fired_time: 28.9808444977, output_fired_time: 10.2328414917, propagate_forward_time: 469.2239074707, propagate_backward_time: 761.8330688477, weight_update_time: 0.4021581113, other_time: 17.4791870117
epoch time: 97.2871322632s, input_fired_time: 1.8248907328, output_fired_time: 0.0000000000, propagate_forward_time: 92.4774475098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9847946167
validation[          , genome  6421] predictions:    6072/  10000 (60.72%), best:    6568/10000 (65.68%), error:     12588.01660, best error:     10103.60645 on epoch:     0, epoch:   23/25, mu: 0.8840711713, learning_rate: 0.0000018202, weight_decay: 0.0000579694

epoch time: 1204.0764160156s, input_fired_time: 26.7941112518, output_fired_time: 9.3314266205, propagate_forward_time: 439.4171752930, propagate_backward_time: 711.9863281250, weight_update_time: 0.4075118005, other_time: 16.5474243164
epoch time: 92.2179107666s, input_fired_time: 1.6945149899, output_fired_time: 0.0000000000, propagate_forward_time: 87.7530517578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7703475952
validation[          , genome  6421] predictions:    6083/  10000 (60.83%), best:    6568/10000 (65.68%), error:     12591.15723, best error:     10103.60645 on epoch:     0, epoch:   24/25, mu: 0.8909388185, learning_rate: 0.0000016903, weight_decay: 0.0000545760

epoch time: 1073.1441650391s, input_fired_time: 23.9573211670, output_fired_time: 8.3352794647, propagate_forward_time: 392.2519226074, propagate_backward_time: 633.6851806641, weight_update_time: 0.3503388166, other_time: 14.9144287109
epoch time: 79.8346939087s, input_fired_time: 1.4800499678, output_fired_time: 0.0000000000, propagate_forward_time: 75.8878860474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4667587280
validation[          , genome  6421] predictions:    6089/  10000 (60.89%), best:    6568/10000 (65.68%), error:     12605.10449, best error:     10103.60645 on epoch:     0, epoch:   25/25, mu: 0.8973612189, learning_rate: 0.0000015696, weight_decay: 0.0000513812

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 391.0976562500s, input_fired_time: 7.2397322655, output_fired_time: 0.0000000000, propagate_forward_time: 371.6427612305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.2151489258
best training[          , genome  6421] predictions:   36314/  50000 (72.63%), best:    6568/10000 (65.68%), error:     42578.83594, best error:     10103.60645 on epoch:     0, epoch:   26/25, mu: 0.9033672214, learning_rate: 0.0000014575, weight_decay: 0.0000483735
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 79.4663619995s, input_fired_time: 1.4660104513, output_fired_time: 0.0000000000, propagate_forward_time: 75.5541763306, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4461746216
   testing[          , genome  6421] predictions:    6568/  10000 (65.68%), best:    6568/10000 (65.68%), error:     10103.60645, best error:     10103.60645 on epoch:     0, epoch:   26/25, mu: 0.9033672214, learning_rate: 0.0000014575, weight_decay: 0.0000483735
backpropagation finished successfully!
00:24:21 (12192): called boinc_finish(0)

</stderr_txt>
]]>