Nameexact_genome_1542692703_170_6360_1
Workunit4100163
Created20 Nov 2018, 6:15:10 UTC
Sent20 Nov 2018, 6:31:07 UTC
Report deadline21 Dec 2018, 19:42:34 UTC
Received23 Nov 2018, 16:07:49 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID31505
Run time11 hours 48 min 37 sec
CPU time11 hours 43 min 9 sec
Validate stateValid
Credit7,887.41
Device peak FLOPS4.20 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size583.59 MB
Peak swap size581.37 MB
Peak disk usage12.81 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542692703_170_6360.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542692703_170_6360_1_r1767589231_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542692703_170_6360.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.460564
read mu: 0.460564
read mu_delta: 0.937213
read initial_learning_rate: 2.0074e-05
read learning_rate: 2.0074e-05
read learning_rate_delta: 0.90475
read initial_weight_decay: 0.000184677
read weight_decay: 0.000184677
read weight_decay_delta: 0.924022
read batch_size: 105
read epsilon: 1e-07
read alpha: 0.0503562
read input_dropout_probability: 0.00155205
read hidden_dropout_probability: 0.0776225
read velocity_reset: 1378
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6360
read normal distribution: '1 0 0'
generator_str: '1300792808'
read generator: 1300792808
read generated_by_map:
1 crossover 1
reading 129 nodes.
reading 472 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1041197596
post shuffle 1: 1088284519
epoch time: 1485.02954101563s, input_fired_time: 21.5107421875, output_fired_time: 10.3623495101929, propagate_forward_time: 566.754760742188, propagate_backward_time: 873.402465820313, weight_update_time: 0.350353866815567, other_time: 12.999267578125
epoch time: 117.80973815918s, input_fired_time: 1.67612028121948, output_fired_time: 0, propagate_forward_time: 113.846862792969, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.28675842285156
validation[          , genome  6360] predictions:    6369/  10000 (63.69%), best:    6369/10000 (63.69%), error:     10592.52930, best error:     10592.52930 on epoch:     0, epoch:    0/25, mu: 0.4605637491, learning_rate: 0.0000200740, weight_decay: 0.0001846772

epoch time: 1486.3990478516s, input_fired_time: 21.5161705017, output_fired_time: 10.3528747559, propagate_forward_time: 567.5195312500, propagate_backward_time: 874.0903930664, weight_update_time: 0.3512560725, other_time: 12.9201049805
epoch time: 117.7108154297s, input_fired_time: 1.6737054586, output_fired_time: 0.0000000000, propagate_forward_time: 113.7525558472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2845535278
validation[          , genome  6360] predictions:    6387/  10000 (63.87%), best:    6369/10000 (63.69%), error:     10620.26855, best error:     10592.52930 on epoch:     0, epoch:    1/25, mu: 0.4938052297, learning_rate: 0.0000181619, weight_decay: 0.0001706458

epoch time: 1486.0953369141s, input_fired_time: 21.5469131470, output_fired_time: 10.3510007858, propagate_forward_time: 567.1314086914, propagate_backward_time: 874.1511230469, weight_update_time: 0.3467296660, other_time: 12.9149780273
epoch time: 117.8954315186s, input_fired_time: 1.6758682728, output_fired_time: 0.0000000000, propagate_forward_time: 113.9429016113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2766647339
validation[          , genome  6360] predictions:    6365/  10000 (63.65%), best:    6369/10000 (63.69%), error:     10728.68359, best error:     10592.52930 on epoch:     0, epoch:    2/25, mu: 0.5249596238, learning_rate: 0.0000164320, weight_decay: 0.0001576804

epoch time: 1486.0655517578s, input_fired_time: 21.5559673309, output_fired_time: 10.3911104202, propagate_forward_time: 566.4829711914, propagate_backward_time: 874.6163330078, weight_update_time: 0.3526432812, other_time: 13.0192260742
epoch time: 118.1313705444s, input_fired_time: 1.6824799776, output_fired_time: 0.0000000000, propagate_forward_time: 114.1586303711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2902603149
validation[          , genome  6360] predictions:    6374/  10000 (63.74%), best:    6369/10000 (63.69%), error:     10812.10059, best error:     10592.52930 on epoch:     0, epoch:    3/25, mu: 0.5541579127, learning_rate: 0.0000148669, weight_decay: 0.0001457002

epoch time: 1486.3699951172s, input_fired_time: 21.5556335449, output_fired_time: 10.3997335434, propagate_forward_time: 567.2094116211, propagate_backward_time: 874.2687988281, weight_update_time: 0.3484062254, other_time: 12.9363403320
epoch time: 117.7256698608s, input_fired_time: 1.6775295734, output_fired_time: 0.0000000000, propagate_forward_time: 113.7533111572, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2948303223
validation[          , genome  6360] predictions:    6360/  10000 (63.60%), best:    6369/10000 (63.69%), error:     10913.34277, best error:     10592.52930 on epoch:     0, epoch:    4/25, mu: 0.5815229416, learning_rate: 0.0000134508, weight_decay: 0.0001346302

epoch time: 1513.2487792969s, input_fired_time: 21.8745708466, output_fired_time: 10.5327720642, propagate_forward_time: 578.8391113281, propagate_backward_time: 888.8672485352, weight_update_time: 0.3579117656, other_time: 13.1351928711
epoch time: 118.2538223267s, input_fired_time: 1.6794254780, output_fired_time: 0.0000000000, propagate_forward_time: 114.2717819214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3026123047
validation[          , genome  6360] predictions:    6345/  10000 (63.45%), best:    6369/10000 (63.69%), error:     11042.37012, best error:     10592.52930 on epoch:     0, epoch:    5/25, mu: 0.6071698070, learning_rate: 0.0000121696, weight_decay: 0.0001244013

epoch time: 1487.0513916016s, input_fired_time: 21.5776100159, output_fired_time: 10.3385839462, propagate_forward_time: 567.4466552734, propagate_backward_time: 874.7388916016, weight_update_time: 0.3495541513, other_time: 12.9495849609
epoch time: 118.1303329468s, input_fired_time: 1.6743443012, output_fired_time: 0.0000000000, propagate_forward_time: 114.1767349243, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2792510986
validation[          , genome  6360] predictions:    6344/  10000 (63.44%), best:    6369/10000 (63.69%), error:     11160.27539, best error:     10592.52930 on epoch:     0, epoch:    6/25, mu: 0.6312063932, learning_rate: 0.0000110105, weight_decay: 0.0001149495

epoch time: 1488.8824462891s, input_fired_time: 21.5766868591, output_fired_time: 10.3233757019, propagate_forward_time: 568.2706298828, propagate_backward_time: 875.7178955078, weight_update_time: 0.3528796434, other_time: 12.9938964844
epoch time: 117.9379653931s, input_fired_time: 1.6824289560, output_fired_time: 0.0000000000, propagate_forward_time: 113.9910888672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2644500732
validation[          , genome  6360] predictions:    6379/  10000 (63.79%), best:    6369/10000 (63.69%), error:     11247.86035, best error:     10592.52930 on epoch:     0, epoch:    7/25, mu: 0.6537337899, learning_rate: 0.0000099617, weight_decay: 0.0001062159

epoch time: 1487.9304199219s, input_fired_time: 21.5712795258, output_fired_time: 10.3498926163, propagate_forward_time: 567.7662963867, propagate_backward_time: 875.3464965820, weight_update_time: 0.3452847004, other_time: 12.8964843750
epoch time: 119.7029266357s, input_fired_time: 1.7012261152, output_fired_time: 0.0000000000, propagate_forward_time: 115.6999435425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3017578125
validation[          , genome  6360] predictions:    6324/  10000 (63.24%), best:    6369/10000 (63.69%), error:     11326.72754, best error:     10592.52930 on epoch:     0, epoch:    8/25, mu: 0.6748467684, learning_rate: 0.0000090129, weight_decay: 0.0000981458

epoch time: 1488.4978027344s, input_fired_time: 21.5513496399, output_fired_time: 10.4368038177, propagate_forward_time: 568.0333862305, propagate_backward_time: 875.4982299805, weight_update_time: 0.3493655324, other_time: 12.9780273438
epoch time: 117.9436645508s, input_fired_time: 1.6747536659, output_fired_time: 0.0000000000, propagate_forward_time: 113.9927444458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2761688232
validation[          , genome  6360] predictions:    6332/  10000 (63.32%), best:    6369/10000 (63.69%), error:     11451.95996, best error:     10592.52930 on epoch:     0, epoch:    9/25, mu: 0.6946341395, learning_rate: 0.0000081544, weight_decay: 0.0000906889

epoch time: 1485.4757080078s, input_fired_time: 21.5340347290, output_fired_time: 10.3403768539, propagate_forward_time: 566.9304809570, propagate_backward_time: 873.7050781250, weight_update_time: 0.3493877351, other_time: 12.9657592773
epoch time: 117.6270065308s, input_fired_time: 1.6716432571, output_fired_time: 0.0000000000, propagate_forward_time: 113.6790924072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2762680054
validation[          , genome  6360] predictions:    6314/  10000 (63.14%), best:    6369/10000 (63.69%), error:     11530.24414, best error:     10592.52930 on epoch:     0, epoch:   10/25, mu: 0.7131791711, learning_rate: 0.0000073777, weight_decay: 0.0000837985

epoch time: 1488.3250732422s, input_fired_time: 21.6260967255, output_fired_time: 10.3346910477, propagate_forward_time: 568.0920410156, propagate_backward_time: 875.3108520508, weight_update_time: 0.3486907780, other_time: 12.9613647461
epoch time: 118.2171630859s, input_fired_time: 1.6756485701, output_fired_time: 0.0000000000, propagate_forward_time: 114.2541198730, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2873916626
validation[          , genome  6360] predictions:    6281/  10000 (62.81%), best:    6369/10000 (63.69%), error:     11577.68457, best error:     10592.52930 on epoch:     0, epoch:   11/25, mu: 0.7305598259, learning_rate: 0.0000066750, weight_decay: 0.0000774317

epoch time: 1492.1923828125s, input_fired_time: 21.6071891785, output_fired_time: 10.3754262924, propagate_forward_time: 569.5784301758, propagate_backward_time: 877.6271362305, weight_update_time: 0.3543483317, other_time: 13.0042724609
epoch time: 118.0017776489s, input_fired_time: 1.6824207306, output_fired_time: 0.0000000000, propagate_forward_time: 114.0407333374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2786254883
validation[          , genome  6360] predictions:    6293/  10000 (62.93%), best:    6369/10000 (63.69%), error:     11644.75000, best error:     10592.52930 on epoch:     0, epoch:   12/25, mu: 0.7468491793, learning_rate: 0.0000060392, weight_decay: 0.0000715486

epoch time: 1486.9932861328s, input_fired_time: 21.5727481842, output_fired_time: 10.3529577255, propagate_forward_time: 567.3500976563, propagate_backward_time: 874.7972412109, weight_update_time: 0.3486508727, other_time: 12.9202880859
epoch time: 117.9964904785s, input_fired_time: 1.6849937439, output_fired_time: 0.0000000000, propagate_forward_time: 114.0425186157, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2689743042
validation[          , genome  6360] predictions:    6282/  10000 (62.82%), best:    6369/10000 (63.69%), error:     11697.78223, best error:     10592.52930 on epoch:     0, epoch:   13/25, mu: 0.7621157765, learning_rate: 0.0000054640, weight_decay: 0.0000661125

epoch time: 1488.9949951172s, input_fired_time: 21.5692386627, output_fired_time: 10.3464841843, propagate_forward_time: 568.3659667969, propagate_backward_time: 875.7708129883, weight_update_time: 0.3501215279, other_time: 12.9425659180
epoch time: 117.9318466187s, input_fired_time: 1.6794112921, output_fired_time: 0.0000000000, propagate_forward_time: 113.9674453735, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2849884033
validation[          , genome  6360] predictions:    6306/  10000 (63.06%), best:    6369/10000 (63.69%), error:     11746.61133, best error:     10592.52930 on epoch:     0, epoch:   14/25, mu: 0.7764238715, learning_rate: 0.0000049435, weight_decay: 0.0000610894

epoch time: 1488.6934814453s, input_fired_time: 21.5875434875, output_fired_time: 10.3566398621, propagate_forward_time: 567.9307861328, propagate_backward_time: 875.8658447266, weight_update_time: 0.3427780569, other_time: 12.9526367188
epoch time: 117.9237289429s, input_fired_time: 1.6853486300, output_fired_time: 0.0000000000, propagate_forward_time: 113.9491195679, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2892608643
validation[          , genome  6360] predictions:    6269/  10000 (62.69%), best:    6369/10000 (63.69%), error:     11802.13281, best error:     10592.52930 on epoch:     0, epoch:   15/25, mu: 0.7898336053, learning_rate: 0.0000044727, weight_decay: 0.0000564479

epoch time: 1488.2166748047s, input_fired_time: 21.5604457855, output_fired_time: 10.3629589081, propagate_forward_time: 567.4332275391, propagate_backward_time: 875.9265747070, weight_update_time: 0.3477395475, other_time: 12.9335327148
epoch time: 118.2215347290s, input_fired_time: 1.6839156151, output_fired_time: 0.0000000000, propagate_forward_time: 114.2614288330, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2761917114
validation[          , genome  6360] predictions:    6262/  10000 (62.62%), best:    6369/10000 (63.69%), error:     11841.02246, best error:     10592.52930 on epoch:     0, epoch:   16/25, mu: 0.8024013638, learning_rate: 0.0000040466, weight_decay: 0.0000521591

epoch time: 1487.4587402344s, input_fired_time: 21.5774612427, output_fired_time: 10.3680887222, propagate_forward_time: 567.8130493164, propagate_backward_time: 874.7673950195, weight_update_time: 0.3476108313, other_time: 12.9327392578
epoch time: 118.1370925903s, input_fired_time: 1.6817661524, output_fired_time: 0.0000000000, propagate_forward_time: 114.1829299927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2723999023
validation[          , genome  6360] predictions:    6258/  10000 (62.58%), best:    6369/10000 (63.69%), error:     11874.81738, best error:     10592.52930 on epoch:     0, epoch:   17/25, mu: 0.8141800165, learning_rate: 0.0000036612, weight_decay: 0.0000481962

epoch time: 1487.9112548828s, input_fired_time: 21.5336723328, output_fired_time: 10.3536424637, propagate_forward_time: 567.6921997070, propagate_backward_time: 875.3581542969, weight_update_time: 0.3495696187, other_time: 12.9735717773
epoch time: 117.7922897339s, input_fired_time: 1.6784656048, output_fired_time: 0.0000000000, propagate_forward_time: 113.8224716187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2913513184
validation[          , genome  6360] predictions:    6253/  10000 (62.53%), best:    6369/10000 (63.69%), error:     11920.10840, best error:     10592.52930 on epoch:     0, epoch:   18/25, mu: 0.8252191544, learning_rate: 0.0000033125, weight_decay: 0.0000445343

epoch time: 1493.3554687500s, input_fired_time: 21.5936641693, output_fired_time: 10.4046525955, propagate_forward_time: 569.5223999023, propagate_backward_time: 878.8613891602, weight_update_time: 0.3489316404, other_time: 12.9733886719
epoch time: 117.8891220093s, input_fired_time: 1.6800570488, output_fired_time: 0.0000000000, propagate_forward_time: 113.8967666626, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3123016357
validation[          , genome  6360] predictions:    6251/  10000 (62.51%), best:    6369/10000 (63.69%), error:     11928.44727, best error:     10592.52930 on epoch:     0, epoch:   19/25, mu: 0.8355652094, learning_rate: 0.0000029970, weight_decay: 0.0000411507

epoch time: 1486.7349853516s, input_fired_time: 21.5302047729, output_fired_time: 10.3452062607, propagate_forward_time: 567.2094116211, propagate_backward_time: 874.7388305664, weight_update_time: 0.3500821590, other_time: 12.9113769531
epoch time: 118.5392150879s, input_fired_time: 1.6812206507, output_fired_time: 0.0000000000, propagate_forward_time: 114.5765075684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2814865112
validation[          , genome  6360] predictions:    6234/  10000 (62.34%), best:    6369/10000 (63.69%), error:     11946.12793, best error:     10592.52930 on epoch:     0, epoch:   20/25, mu: 0.8452616334, learning_rate: 0.0000027115, weight_decay: 0.0000380242

epoch time: 1487.6168212891s, input_fired_time: 21.5299396515, output_fired_time: 10.3620395660, propagate_forward_time: 567.4717407227, propagate_backward_time: 875.2593383789, weight_update_time: 0.3454935253, other_time: 12.9937744141
epoch time: 118.0522613525s, input_fired_time: 1.6826689243, output_fired_time: 0.0000000000, propagate_forward_time: 114.0708541870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2987365723
validation[          , genome  6360] predictions:    6209/  10000 (62.09%), best:    6369/10000 (63.69%), error:     11985.34668, best error:     10592.52930 on epoch:     0, epoch:   21/25, mu: 0.8543492556, learning_rate: 0.0000024532, weight_decay: 0.0000351352

epoch time: 1492.7962646484s, input_fired_time: 21.5839786530, output_fired_time: 10.3979921341, propagate_forward_time: 569.9406738281, propagate_backward_time: 877.9417114258, weight_update_time: 0.3449561298, other_time: 12.9319458008
epoch time: 118.4458389282s, input_fired_time: 1.6853948832, output_fired_time: 0.0000000000, propagate_forward_time: 114.4647674561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2956771851
validation[          , genome  6360] predictions:    6236/  10000 (62.36%), best:    6369/10000 (63.69%), error:     12038.78027, best error:     10592.52930 on epoch:     0, epoch:   22/25, mu: 0.8628662825, learning_rate: 0.0000022196, weight_decay: 0.0000324657

epoch time: 1488.9090576172s, input_fired_time: 21.5823631287, output_fired_time: 10.4097328186, propagate_forward_time: 567.7138061523, propagate_backward_time: 876.2202148438, weight_update_time: 0.3505063951, other_time: 12.9828491211
epoch time: 118.0296707153s, input_fired_time: 1.6864187717, output_fired_time: 0.0000000000, propagate_forward_time: 114.0408172607, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3024368286
validation[          , genome  6360] predictions:    6222/  10000 (62.22%), best:    6369/10000 (63.69%), error:     12029.45117, best error:     10592.52930 on epoch:     0, epoch:   23/25, mu: 0.8708485961, learning_rate: 0.0000020081, weight_decay: 0.0000299990

epoch time: 1489.0406494141s, input_fired_time: 21.6311969757, output_fired_time: 10.4094657898, propagate_forward_time: 568.2125244141, propagate_backward_time: 875.7794189453, weight_update_time: 0.3511121571, other_time: 13.0080566406
epoch time: 117.8523330688s, input_fired_time: 1.6797312498, output_fired_time: 0.0000000000, propagate_forward_time: 113.8852005005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2873992920
validation[          , genome  6360] predictions:    6241/  10000 (62.41%), best:    6369/10000 (63.69%), error:     12025.35352, best error:     10592.52930 on epoch:     0, epoch:   24/25, mu: 0.8783296943, learning_rate: 0.0000018169, weight_decay: 0.0000277197

epoch time: 1491.7944335938s, input_fired_time: 21.5990924835, output_fired_time: 10.4076538086, propagate_forward_time: 569.1222534180, propagate_backward_time: 877.6515502930, weight_update_time: 0.3473073542, other_time: 13.0137939453
epoch time: 118.0776824951s, input_fired_time: 1.6838940382, output_fired_time: 0.0000000000, propagate_forward_time: 114.1215591431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2722320557
validation[          , genome  6360] predictions:    6221/  10000 (62.21%), best:    6369/10000 (63.69%), error:     12054.85254, best error:     10592.52930 on epoch:     0, epoch:   25/25, mu: 0.8853411078, learning_rate: 0.0000016438, weight_decay: 0.0000256136

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 586.9845581055s, input_fired_time: 8.3356819153, output_fired_time: 0.0000000000, propagate_forward_time: 567.2609252930, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.3879394531
best training[          , genome  6360] predictions:   35649/  50000 (71.30%), best:    6369/10000 (63.69%), error:     44111.60938, best error:     10592.52930 on epoch:     0, epoch:   26/25, mu: 0.8919122815, learning_rate: 0.0000014872, weight_decay: 0.0000236676
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 118.1498870850s, input_fired_time: 1.6812280416, output_fired_time: 0.0000000000, propagate_forward_time: 114.1707839966, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2978744507
   testing[          , genome  6360] predictions:    6369/  10000 (63.69%), best:    6369/10000 (63.69%), error:     10592.52930, best error:     10592.52930 on epoch:     0, epoch:   26/25, mu: 0.8919122815, learning_rate: 0.0000014872, weight_decay: 0.0000236676
backpropagation finished successfully!
01:06:47 (10940): called boinc_finish(0)

</stderr_txt>
]]>