Nameexact_genome_1542605141_172_6299_1
Workunit4098455
Created19 Nov 2018, 6:39:18 UTC
Sent19 Nov 2018, 6:57:24 UTC
Report deadline18 Dec 2018, 0:49:56 UTC
Received21 Nov 2018, 7:50:47 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID80138
Run time7 hours 28 min 43 sec
CPU time7 hours 27 min 5 sec
Validate stateValid
Credit7,186.21
Device peak FLOPS4.49 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size583.70 MB
Peak swap size603.70 MB
Peak disk usage13.09 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542605141_172_6299.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542605141_172_6299_1_r804003250_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542605141_172_6299.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.480447
read mu: 0.480447
read mu_delta: 0.939751
read initial_learning_rate: 0.0016269
read learning_rate: 0.0016269
read learning_rate_delta: 0.922622
read initial_weight_decay: 0.000230485
read weight_decay: 0.000230485
read weight_decay_delta: 0.943521
read batch_size: 104
read epsilon: 1e-07
read alpha: 0.0892642
read input_dropout_probability: 0.00137477
read hidden_dropout_probability: 0.081123
read velocity_reset: 1682
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6299
read normal distribution: '0 0.271294146776199 -0.244710609316826'
generator_str: '1896640551'
read generator: 1896640551
read generated_by_map:
1 change_size_x 1
reading 106 nodes.
reading 429 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1737968236
post shuffle 1: 580655037
epoch time: 961.408447265625s, input_fired_time: 18.3701210021973, output_fired_time: 6.1736946105957, propagate_forward_time: 275.101013183594, propagate_backward_time: 653.283386230469, weight_update_time: 0.218840539455414, other_time: 8.480224609375
epoch time: 57.977954864502s, input_fired_time: 1.15601944923401, output_fired_time: 0, propagate_forward_time: 55.4289855957031, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.39294815063477
validation[          , genome  6299] predictions:    6246/  10000 (62.46%), best:    6246/10000 (62.46%), error:     10894.19141, best error:     10894.19141 on epoch:     0, epoch:    0/25, mu: 0.4804465771, learning_rate: 0.0016268980, weight_decay: 0.0002304852

epoch time: 961.9869384766s, input_fired_time: 18.3881797791, output_fired_time: 6.1636371613, propagate_forward_time: 275.1235046387, propagate_backward_time: 653.5180053711, weight_update_time: 0.2183740586, other_time: 8.7936401367
epoch time: 58.0311660767s, input_fired_time: 1.1554141045, output_fired_time: 0.0000000000, propagate_forward_time: 55.4873809814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3883705139
validation[          , genome  6299] predictions:    6273/  10000 (62.73%), best:    6273/10000 (62.73%), error:     10772.26855, best error:     10772.26855 on epoch:     1, epoch:    1/25, mu: 0.5111467838, learning_rate: 0.0015010114, weight_decay: 0.0002174676

epoch time: 962.4519653320s, input_fired_time: 18.4474182129, output_fired_time: 6.1836748123, propagate_forward_time: 275.2853088379, propagate_backward_time: 653.7804565430, weight_update_time: 0.2179208994, other_time: 8.7550659180
epoch time: 57.8362770081s, input_fired_time: 1.1619148254, output_fired_time: 0.0000000000, propagate_forward_time: 55.2824172974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3919448853
validation[          , genome  6299] predictions:    6283/  10000 (62.83%), best:    6283/10000 (62.83%), error:     10665.95508, best error:     10665.95508 on epoch:     2, epoch:    2/25, mu: 0.5399973392, learning_rate: 0.0013848657, weight_decay: 0.0002051852

epoch time: 961.5969238281s, input_fired_time: 18.4195041656, output_fired_time: 6.1833353043, propagate_forward_time: 274.6153259277, propagate_backward_time: 653.7258911133, weight_update_time: 0.2168986350, other_time: 8.6528930664
epoch time: 57.8761444092s, input_fired_time: 1.1518790722, output_fired_time: 0.0000000000, propagate_forward_time: 55.3395423889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3847236633
validation[          , genome  6299] predictions:    5906/  10000 (59.06%), best:    6283/10000 (62.83%), error:     11898.63477, best error:     10665.95508 on epoch:     2, epoch:    3/25, mu: 0.5671096444, learning_rate: 0.0012777072, weight_decay: 0.0001935966

epoch time: 962.2613525391s, input_fired_time: 18.4427661896, output_fired_time: 6.2172126770, propagate_forward_time: 275.1514282227, propagate_backward_time: 653.7830200195, weight_update_time: 0.2176284641, other_time: 8.6669311523
epoch time: 58.1994323730s, input_fired_time: 1.1768646240, output_fired_time: 0.0000000000, propagate_forward_time: 55.6087799072, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4137878418
validation[          , genome  6299] predictions:    6265/  10000 (62.65%), best:    6265/10000 (62.65%), error:     10587.85645, best error:     10587.85645 on epoch:     4, epoch:    4/25, mu: 0.5925884843, learning_rate: 0.0011788404, weight_decay: 0.0001826624

epoch time: 963.5496826172s, input_fired_time: 18.4162044525, output_fired_time: 6.1813206673, propagate_forward_time: 275.0459289551, propagate_backward_time: 655.0863647461, weight_update_time: 0.2187315077, other_time: 8.8198852539
epoch time: 58.1639404297s, input_fired_time: 1.1588299274, output_fired_time: 0.0000000000, propagate_forward_time: 55.5912437439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4138679504
validation[          , genome  6299] predictions:    6209/  10000 (62.09%), best:    6265/10000 (62.65%), error:     10965.70898, best error:     10587.85645 on epoch:     4, epoch:    5/25, mu: 0.6165322661, learning_rate: 0.0010876238, weight_decay: 0.0001723458

epoch time: 962.1110229492s, input_fired_time: 18.4540367126, output_fired_time: 6.1779603958, propagate_forward_time: 275.3030090332, propagate_backward_time: 653.5042724609, weight_update_time: 0.2181320190, other_time: 8.6717529297
epoch time: 57.9554290771s, input_fired_time: 1.1522175074, output_fired_time: 0.0000000000, propagate_forward_time: 55.4127883911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3904228210
validation[          , genome  6299] predictions:    6161/  10000 (61.61%), best:    6265/10000 (62.65%), error:     10916.16504, best error:     10587.85645 on epoch:     4, epoch:    6/25, mu: 0.6390334368, learning_rate: 0.0010034653, weight_decay: 0.0001626119

epoch time: 962.7687988281s, input_fired_time: 18.4358596802, output_fired_time: 6.1904277802, propagate_forward_time: 275.0358886719, propagate_backward_time: 654.3755493164, weight_update_time: 0.2198887318, other_time: 8.7310791016
epoch time: 57.9607086182s, input_fired_time: 1.1585685015, output_fired_time: 0.0000000000, propagate_forward_time: 55.4067192078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3954200745
validation[          , genome  6299] predictions:    6361/  10000 (63.61%), best:    6361/10000 (63.61%), error:     10495.53027, best error:     10495.53027 on epoch:     7, epoch:    7/25, mu: 0.6601788998, learning_rate: 0.0009258189, weight_decay: 0.0001534277

epoch time: 961.9329833984s, input_fired_time: 18.4757118225, output_fired_time: 6.1802554131, propagate_forward_time: 275.2492370605, propagate_backward_time: 653.3888549805, weight_update_time: 0.2180184573, other_time: 8.6389770508
epoch time: 57.8930168152s, input_fired_time: 1.1573075056, output_fired_time: 0.0000000000, propagate_forward_time: 55.3477401733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3879699707
validation[          , genome  6299] predictions:    6293/  10000 (62.93%), best:    6361/10000 (63.61%), error:     10754.71875, best error:     10495.53027 on epoch:     7, epoch:    8/25, mu: 0.6800503731, learning_rate: 0.0008541806, weight_decay: 0.0001447623

epoch time: 962.3491821289s, input_fired_time: 18.4113464355, output_fired_time: 6.1873507500, propagate_forward_time: 274.5669555664, propagate_backward_time: 654.4291381836, weight_update_time: 0.2217798382, other_time: 8.7543945313
epoch time: 58.0693817139s, input_fired_time: 1.1624218225, output_fired_time: 0.0000000000, propagate_forward_time: 55.5103530884, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3966064453
validation[          , genome  6299] predictions:    6284/  10000 (62.84%), best:    6361/10000 (63.61%), error:     10508.34277, best error:     10495.53027 on epoch:     7, epoch:    9/25, mu: 0.6987246275, learning_rate: 0.0007880856, weight_decay: 0.0001365862

epoch time: 961.8505859375s, input_fired_time: 18.4713973999, output_fired_time: 6.1915183067, propagate_forward_time: 274.8569030762, propagate_backward_time: 653.6296386719, weight_update_time: 0.2174211293, other_time: 8.7011718750
epoch time: 57.9561996460s, input_fired_time: 1.1607806683, output_fired_time: 0.0000000000, propagate_forward_time: 55.4062614441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3891563416
validation[          , genome  6299] predictions:    6410/  10000 (64.10%), best:    6410/10000 (64.10%), error:     10236.27734, best error:     10236.27734 on epoch:    10, epoch:   10/25, mu: 0.7162737846, learning_rate: 0.0007271049, weight_decay: 0.0001288720

epoch time: 963.9326782227s, input_fired_time: 18.5445365906, output_fired_time: 6.1927328110, propagate_forward_time: 275.9592590332, propagate_backward_time: 654.5427246094, weight_update_time: 0.2176007777, other_time: 8.6933593750
epoch time: 57.9104423523s, input_fired_time: 1.1548895836, output_fired_time: 0.0000000000, propagate_forward_time: 55.3717231750, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3838310242
validation[          , genome  6299] predictions:    6291/  10000 (62.91%), best:    6410/10000 (64.10%), error:     10585.97070, best error:     10236.27734 on epoch:    10, epoch:   11/25, mu: 0.7327656150, learning_rate: 0.0006708428, weight_decay: 0.0001215934

epoch time: 961.7622680664s, input_fired_time: 18.4865207672, output_fired_time: 6.1959042549, propagate_forward_time: 275.0475158691, propagate_backward_time: 653.3556518555, weight_update_time: 0.2173392177, other_time: 8.6766967773
epoch time: 58.1592903137s, input_fired_time: 1.1673195362, output_fired_time: 0.0000000000, propagate_forward_time: 55.5954246521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3965454102
validation[          , genome  6299] predictions:    6187/  10000 (61.87%), best:    6410/10000 (64.10%), error:     10886.91016, best error:     10236.27734 on epoch:    10, epoch:   12/25, mu: 0.7482637763, learning_rate: 0.0006189341, weight_decay: 0.0001147259

epoch time: 961.6992797852s, input_fired_time: 18.5043582916, output_fired_time: 6.1909832954, propagate_forward_time: 275.1924743652, propagate_backward_time: 653.1504516602, weight_update_time: 0.2176273167, other_time: 8.6610717773
epoch time: 57.9474372864s, input_fired_time: 1.1566435099, output_fired_time: 0.0000000000, propagate_forward_time: 55.4023818970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3884124756
validation[          , genome  6299] predictions:    6334/  10000 (63.34%), best:    6410/10000 (64.10%), error:     10583.23535, best error:     10236.27734 on epoch:    10, epoch:   13/25, mu: 0.7628282309, learning_rate: 0.0005710421, weight_decay: 0.0001082463

epoch time: 962.7416381836s, input_fired_time: 18.4988479614, output_fired_time: 6.1763086319, propagate_forward_time: 275.5476379395, propagate_backward_time: 653.8318481445, weight_update_time: 0.2172514051, other_time: 8.6869506836
epoch time: 58.0047760010s, input_fired_time: 1.1814007759, output_fired_time: 0.0000000000, propagate_forward_time: 55.4373207092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3860549927
validation[          , genome  6299] predictions:    6361/  10000 (63.61%), best:    6410/10000 (64.10%), error:     10437.39160, best error:     10236.27734 on epoch:    10, epoch:   14/25, mu: 0.7765151858, learning_rate: 0.0005268558, weight_decay: 0.0001021327

epoch time: 961.7179565430s, input_fired_time: 18.4480533600, output_fired_time: 6.1908516884, propagate_forward_time: 274.6464843750, propagate_backward_time: 653.7183227539, weight_update_time: 0.2179338336, other_time: 8.7142333984
epoch time: 57.8494224548s, input_fired_time: 1.1683763266, output_fired_time: 0.0000000000, propagate_forward_time: 55.2901229858, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3909225464
validation[          , genome  6299] predictions:    6443/  10000 (64.43%), best:    6410/10000 (64.10%), error:     10253.55859, best error:     10236.27734 on epoch:    10, epoch:   15/25, mu: 0.7893775105, learning_rate: 0.0004860886, weight_decay: 0.0000963643

epoch time: 963.5782470703s, input_fired_time: 18.5051689148, output_fired_time: 6.1809754372, propagate_forward_time: 275.5371704102, propagate_backward_time: 654.6700439453, weight_update_time: 0.2190401852, other_time: 8.6848754883
epoch time: 57.9471626282s, input_fired_time: 1.1770654917, output_fired_time: 0.0000000000, propagate_forward_time: 55.3841514587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3859443665
validation[          , genome  6299] predictions:    6467/  10000 (64.67%), best:    6467/10000 (64.67%), error:     10137.74609, best error:     10137.74609 on epoch:    16, epoch:   16/25, mu: 0.8014648557, learning_rate: 0.0004484759, weight_decay: 0.0000909218

epoch time: 962.4589843750s, input_fired_time: 18.4882698059, output_fired_time: 6.1897759438, propagate_forward_time: 275.1641235352, propagate_backward_time: 653.9190063477, weight_update_time: 0.2190331966, other_time: 8.6978149414
epoch time: 57.9863548279s, input_fired_time: 1.1545283794, output_fired_time: 0.0000000000, propagate_forward_time: 55.4464988708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3853263855
validation[          , genome  6299] predictions:    6298/  10000 (62.98%), best:    6467/10000 (64.67%), error:     10465.94629, best error:     10137.74609 on epoch:    16, epoch:   17/25, mu: 0.8128239512, learning_rate: 0.0004137736, weight_decay: 0.0000857866

epoch time: 962.1939697266s, input_fired_time: 18.5118255615, output_fired_time: 6.2002511024, propagate_forward_time: 274.8110656738, propagate_backward_time: 653.9848632813, weight_update_time: 0.2179071456, other_time: 8.6859130859
epoch time: 58.0222930908s, input_fired_time: 1.1657253504, output_fired_time: 0.0000000000, propagate_forward_time: 55.4681892395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3883781433
validation[          , genome  6299] predictions:    6308/  10000 (63.08%), best:    6467/10000 (64.67%), error:     10450.75195, best error:     10137.74609 on epoch:    16, epoch:   18/25, mu: 0.8234986663, learning_rate: 0.0003817565, weight_decay: 0.0000809414

epoch time: 962.2819824219s, input_fired_time: 18.4875659943, output_fired_time: 6.1892704964, propagate_forward_time: 274.7726440430, propagate_backward_time: 654.1223754883, weight_update_time: 0.2177036256, other_time: 8.7101440430
epoch time: 58.3062667847s, input_fired_time: 1.1802003384, output_fired_time: 0.0000000000, propagate_forward_time: 55.7273101807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3987579346
validation[          , genome  6299] predictions:    6486/  10000 (64.86%), best:    6467/10000 (64.67%), error:     10176.17090, best error:     10137.74609 on epoch:    16, epoch:   19/25, mu: 0.8335302472, learning_rate: 0.0003522169, weight_decay: 0.0000763699

epoch time: 962.2396240234s, input_fired_time: 18.4972457886, output_fired_time: 6.1625995636, propagate_forward_time: 275.2001342773, propagate_backward_time: 653.6315917969, weight_update_time: 0.2195478827, other_time: 8.7480468750
epoch time: 57.9737091064s, input_fired_time: 1.1731832027, output_fired_time: 0.0000000000, propagate_forward_time: 55.4105644226, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3899612427
validation[          , genome  6299] predictions:    6439/  10000 (64.39%), best:    6467/10000 (64.67%), error:     10281.32813, best error:     10137.74609 on epoch:    16, epoch:   20/25, mu: 0.8429574370, learning_rate: 0.0003249630, weight_decay: 0.0000720566

epoch time: 962.4205322266s, input_fired_time: 18.5143737793, output_fired_time: 6.1825218201, propagate_forward_time: 274.8822021484, propagate_backward_time: 654.1345825195, weight_update_time: 0.2185378224, other_time: 8.7068481445
epoch time: 58.0594215393s, input_fired_time: 1.1719311476, output_fired_time: 0.0000000000, propagate_forward_time: 55.4959754944, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3915138245
validation[          , genome  6299] predictions:    6381/  10000 (63.81%), best:    6467/10000 (64.67%), error:     10283.24121, best error:     10137.74609 on epoch:    16, epoch:   21/25, mu: 0.8518166542, learning_rate: 0.0002998179, weight_decay: 0.0000679870

epoch time: 961.8693847656s, input_fired_time: 18.5650348663, output_fired_time: 6.1754932404, propagate_forward_time: 275.1613769531, propagate_backward_time: 653.2661132813, weight_update_time: 0.2164257467, other_time: 8.7013549805
epoch time: 57.9723510742s, input_fired_time: 1.1739845276, output_fired_time: 0.0000000000, propagate_forward_time: 55.4110755920, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3872909546
validation[          , genome  6299] predictions:    6399/  10000 (63.99%), best:    6467/10000 (64.67%), error:     10260.95117, best error:     10137.74609 on epoch:    16, epoch:   22/25, mu: 0.8601421118, learning_rate: 0.0002766185, weight_decay: 0.0000641471

epoch time: 962.1466064453s, input_fired_time: 18.5310058594, output_fired_time: 6.1702537537, propagate_forward_time: 275.1775207520, propagate_backward_time: 653.5733032227, weight_update_time: 0.2166713029, other_time: 8.6945190430
epoch time: 57.9738807678s, input_fired_time: 1.1755626202, output_fired_time: 0.0000000000, propagate_forward_time: 55.4101943970, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3881225586
validation[          , genome  6299] predictions:    6420/  10000 (64.20%), best:    6467/10000 (64.67%), error:     10288.97656, best error:     10137.74609 on epoch:    16, epoch:   23/25, mu: 0.8679659367, learning_rate: 0.0002552142, weight_decay: 0.0000605242

epoch time: 962.1102905273s, input_fired_time: 18.5100231171, output_fired_time: 6.2252554893, propagate_forward_time: 274.5619506836, propagate_backward_time: 654.1108398438, weight_update_time: 0.2173655182, other_time: 8.7022094727
epoch time: 57.9311904907s, input_fired_time: 1.1795120239, output_fired_time: 0.0000000000, propagate_forward_time: 55.3661689758, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3855094910
validation[          , genome  6299] predictions:    6557/  10000 (65.57%), best:    6557/10000 (65.57%), error:      9982.00195, best error:      9982.00195 on epoch:    24, epoch:   24/25, mu: 0.8753184080, learning_rate: 0.0002354662, weight_decay: 0.0000571058

epoch time: 964.1127319336s, input_fired_time: 18.5837745667, output_fired_time: 6.1961956024, propagate_forward_time: 275.6123657227, propagate_backward_time: 654.9478149414, weight_update_time: 0.2176136822, other_time: 8.7725830078
epoch time: 58.2655258179s, input_fired_time: 1.1802057028, output_fired_time: 0.0000000000, propagate_forward_time: 55.6985206604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3867988586
validation[          , genome  6299] predictions:    6458/  10000 (64.58%), best:    6557/10000 (65.57%), error:     10149.04395, best error:      9982.00195 on epoch:    24, epoch:   25/25, mu: 0.8822278976, learning_rate: 0.0002172462, weight_decay: 0.0000538805

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 288.9623413086s, input_fired_time: 5.9204678535, output_fired_time: 0.0000000000, propagate_forward_time: 276.1180419922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9238281250
best training[          , genome  6299] predictions:   36664/  50000 (73.33%), best:    6557/10000 (65.57%), error:     39805.92578, best error:      9982.00195 on epoch:    24, epoch:   26/25, mu: 0.8887211084, learning_rate: 0.0002004361, weight_decay: 0.0000508374
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 58.1991920471s, input_fired_time: 1.1875189543, output_fired_time: 0.0000000000, propagate_forward_time: 55.6178131104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3938598633
   testing[          , genome  6299] predictions:    6557/  10000 (65.57%), best:    6557/10000 (65.57%), error:      9982.00195, best error:      9982.00195 on epoch:    24, epoch:   26/25, mu: 0.8887211084, learning_rate: 0.0002004361, weight_decay: 0.0000508374
backpropagation finished successfully!
02:50:28 (11472): called boinc_finish(0)

</stderr_txt>
]]>