Nameexact_genome_1542495604_172_6200_1
Workunit4096036
Created18 Nov 2018, 3:21:22 UTC
Sent18 Nov 2018, 3:40:35 UTC
Report deadline16 Dec 2018, 3:27:58 UTC
Received21 Nov 2018, 14:15:07 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID83973
Run time1 days 0 hours 15 min 45 sec
CPU time1 days 0 hours 9 min 7 sec
Validate stateValid
Credit6,997.81
Device peak FLOPS2.50 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size576.98 MB
Peak swap size596.92 MB
Peak disk usage13.12 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_172_6200.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_172_6200_1_r532918848_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542495604_172_6200.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.51434
read mu: 0.51434
read mu_delta: 0.935821
read initial_learning_rate: 1e-05
read learning_rate: 1e-05
read learning_rate_delta: 0.937184
read initial_weight_decay: 0.00022679
read weight_decay: 0.00022679
read weight_decay_delta: 0.941017
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0996711
read input_dropout_probability: 0.00129021
read hidden_dropout_probability: 0.0886596
read velocity_reset: 2090
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6200
read normal distribution: '1 0 0'
generator_str: '1829045323'
read generator: 1829045323
read generated_by_map:
1 enable_edge 1
reading 107 nodes.
reading 447 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1683820503
post shuffle 1: 741449248
epoch time: 3417.95190429688s, input_fired_time: 52.864372253418, output_fired_time: 29.8465366363525, propagate_forward_time: 1310.92590332031, propagate_backward_time: 1984.44287109375, weight_update_time: 0.812893390655518, other_time: 39.8724365234375
epoch time: 272.928100585938s, input_fired_time: 5.73167037963867, output_fired_time: 0, propagate_forward_time: 259.631622314453, propagate_backward_time: 0, weight_update_time: 0, other_time: 7.5648193359375
validation[          , genome  6200] predictions:    6465/  10000 (64.65%), best:    6465/10000 (64.65%), error:     10357.20996, best error:     10357.20996 on epoch:     0, epoch:    0/25, mu: 0.5143395662, learning_rate: 0.0000100000, weight_decay: 0.0002267899

epoch time: 3408.5351562500s, input_fired_time: 54.7151527405, output_fired_time: 27.5229778290, propagate_forward_time: 1304.0856933594, propagate_backward_time: 1982.0880126953, weight_update_time: 0.8239673972, other_time: 40.1234130859
epoch time: 275.5720214844s, input_fired_time: 6.7550668716, output_fired_time: 0.0000000000, propagate_forward_time: 261.2027893066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.6141662598
validation[          , genome  6200] predictions:    6493/  10000 (64.93%), best:    6465/10000 (64.65%), error:     10443.14746, best error:     10357.20996 on epoch:     0, epoch:    1/25, mu: 0.5448672175, learning_rate: 0.0000093718, weight_decay: 0.0002134131

epoch time: 3403.7775878906s, input_fired_time: 47.8448677063, output_fired_time: 26.5622844696, propagate_forward_time: 1309.2840576172, propagate_backward_time: 1979.3513183594, weight_update_time: 0.8073744178, other_time: 40.7349853516
epoch time: 269.2195739746s, input_fired_time: 4.7196383476, output_fired_time: 0.0000000000, propagate_forward_time: 256.9060974121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5938415527
validation[          , genome  6200] predictions:    6484/  10000 (64.84%), best:    6465/10000 (64.65%), error:     10633.46680, best error:     10357.20996 on epoch:     0, epoch:    2/25, mu: 0.5734356046, learning_rate: 0.0000087831, weight_decay: 0.0002008254

epoch time: 3405.4943847656s, input_fired_time: 48.6114044189, output_fired_time: 28.7151260376, propagate_forward_time: 1305.5135498047, propagate_backward_time: 1980.4855957031, weight_update_time: 0.8225042224, other_time: 42.1688232422
epoch time: 273.4475402832s, input_fired_time: 3.7595632076, output_fired_time: 0.0000000000, propagate_forward_time: 262.0675354004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.6204528809
validation[          , genome  6200] predictions:    6485/  10000 (64.85%), best:    6465/10000 (64.65%), error:     10791.87402, best error:     10357.20996 on epoch:     0, epoch:    3/25, mu: 0.6001704931, learning_rate: 0.0000082314, weight_decay: 0.0001889800

epoch time: 3408.8012695313s, input_fired_time: 53.0592231750, output_fired_time: 26.6138896942, propagate_forward_time: 1313.4055175781, propagate_backward_time: 1976.8607177734, weight_update_time: 0.8146086931, other_time: 38.8619384766
epoch time: 272.9746704102s, input_fired_time: 3.7728495598, output_fired_time: 0.0000000000, propagate_forward_time: 262.5472717285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6545410156
validation[          , genome  6200] predictions:    6487/  10000 (64.87%), best:    6465/10000 (64.65%), error:     11002.90332, best error:     10357.20996 on epoch:     0, epoch:    4/25, mu: 0.6251895428, learning_rate: 0.0000077144, weight_decay: 0.0001778334

epoch time: 3403.2409667969s, input_fired_time: 50.6388168335, output_fired_time: 30.5191326141, propagate_forward_time: 1298.5358886719, propagate_backward_time: 1982.8316650391, weight_update_time: 0.8169574142, other_time: 40.7154541016
epoch time: 276.5135498047s, input_fired_time: 3.8150818348, output_fired_time: 0.0000000000, propagate_forward_time: 264.1921386719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5063171387
validation[          , genome  6200] predictions:    6445/  10000 (64.45%), best:    6465/10000 (64.65%), error:     11227.92090, best error:     10357.20996 on epoch:     0, epoch:    5/25, mu: 0.6486029029, learning_rate: 0.0000072298, weight_decay: 0.0001673442

epoch time: 3402.5275878906s, input_fired_time: 47.6725425720, output_fired_time: 28.8569526672, propagate_forward_time: 1306.5363769531, propagate_backward_time: 1981.0562744141, weight_update_time: 0.8308244944, other_time: 38.4053955078
epoch time: 275.0603027344s, input_fired_time: 3.7990796566, output_fired_time: 0.0000000000, propagate_forward_time: 264.6188659668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6423645020
validation[          , genome  6200] predictions:    6424/  10000 (64.24%), best:    6465/10000 (64.65%), error:     11412.62109, best error:     10357.20996 on epoch:     0, epoch:    6/25, mu: 0.6705135703, learning_rate: 0.0000067756, weight_decay: 0.0001574737

epoch time: 3400.3566894531s, input_fired_time: 51.5223541260, output_fired_time: 30.5065155029, propagate_forward_time: 1300.5557861328, propagate_backward_time: 1976.8023681641, weight_update_time: 0.8191540837, other_time: 40.9694824219
epoch time: 273.6755065918s, input_fired_time: 3.7670722008, output_fired_time: 0.0000000000, propagate_forward_time: 263.2377624512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6706848145
validation[          , genome  6200] predictions:    6417/  10000 (64.17%), best:    6465/10000 (64.65%), error:     11579.97266, best error:     10357.20996 on epoch:     0, epoch:    7/25, mu: 0.6910180449, learning_rate: 0.0000063500, weight_decay: 0.0001481854

epoch time: 3398.6879882813s, input_fired_time: 49.8571243286, output_fired_time: 28.5710887909, propagate_forward_time: 1306.2209472656, propagate_backward_time: 1973.0107421875, weight_update_time: 0.8086473346, other_time: 41.0280761719
epoch time: 276.1534729004s, input_fired_time: 3.7727923393, output_fired_time: 0.0000000000, propagate_forward_time: 264.8211669922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5595092773
validation[          , genome  6200] predictions:    6388/  10000 (63.88%), best:    6465/10000 (64.65%), error:     11740.21777, best error:     10357.20996 on epoch:     0, epoch:    8/25, mu: 0.7102065682, learning_rate: 0.0000059511, weight_decay: 0.0001394450

epoch time: 3402.8359375000s, input_fired_time: 49.9629173279, output_fired_time: 27.5705356598, propagate_forward_time: 1310.4910888672, propagate_backward_time: 1976.7291259766, weight_update_time: 0.8101116419, other_time: 38.0822753906
epoch time: 273.4312133789s, input_fired_time: 3.7779188156, output_fired_time: 0.0000000000, propagate_forward_time: 262.7736816406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.8796081543
validation[          , genome  6200] predictions:    6351/  10000 (63.51%), best:    6465/10000 (64.65%), error:     11896.93945, best error:     10357.20996 on epoch:     0, epoch:    9/25, mu: 0.7281635404, learning_rate: 0.0000055773, weight_decay: 0.0001312201

epoch time: 3388.8271484375s, input_fired_time: 48.5936851501, output_fired_time: 32.5217094421, propagate_forward_time: 1301.6318359375, propagate_backward_time: 1965.9871826172, weight_update_time: 0.8197406530, other_time: 40.0926513672
epoch time: 275.5421447754s, input_fired_time: 3.7839052677, output_fired_time: 0.0000000000, propagate_forward_time: 264.1848754883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5733642578
validation[          , genome  6200] predictions:    6313/  10000 (63.13%), best:    6465/10000 (64.65%), error:     12032.67383, best error:     10357.20996 on epoch:     0, epoch:   10/25, mu: 0.7449680567, learning_rate: 0.0000052270, weight_decay: 0.0001234803

epoch time: 3409.6923828125s, input_fired_time: 50.8081169128, output_fired_time: 27.5407848358, propagate_forward_time: 1311.7126464844, propagate_backward_time: 1979.7233886719, weight_update_time: 0.8221577406, other_time: 39.9074707031
epoch time: 270.5340270996s, input_fired_time: 3.6788301468, output_fired_time: 0.0000000000, propagate_forward_time: 260.3801574707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4750366211
validation[          , genome  6200] predictions:    6280/  10000 (62.80%), best:    6465/10000 (64.65%), error:     12127.51172, best error:     10357.20996 on epoch:     0, epoch:   11/25, mu: 0.7606940866, learning_rate: 0.0000048986, weight_decay: 0.0001161971

epoch time: 3412.7480468750s, input_fired_time: 50.9604759216, output_fired_time: 26.6260967255, propagate_forward_time: 1310.7668457031, propagate_backward_time: 1983.2517089844, weight_update_time: 0.8271242380, other_time: 41.1430664063
epoch time: 276.3284301758s, input_fired_time: 5.8821578026, output_fired_time: 0.0000000000, propagate_forward_time: 263.9088745117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5373840332
validation[          , genome  6200] predictions:    6239/  10000 (62.39%), best:    6465/10000 (64.65%), error:     12246.96582, best error:     10357.20996 on epoch:     0, epoch:   12/25, mu: 0.7754108310, learning_rate: 0.0000045909, weight_decay: 0.0001093434

epoch time: 3393.9707031250s, input_fired_time: 52.0954475403, output_fired_time: 26.6803531647, propagate_forward_time: 1305.6461181641, propagate_backward_time: 1968.8571777344, weight_update_time: 0.8274960518, other_time: 40.6915283203
epoch time: 265.9724731445s, input_fired_time: 3.6133935452, output_fired_time: 0.0000000000, propagate_forward_time: 254.2491607666, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.1099090576
validation[          , genome  6200] predictions:    6218/  10000 (62.18%), best:    6465/10000 (64.65%), error:     12320.42090, best error:     10357.20996 on epoch:     0, epoch:   13/25, mu: 0.7891830802, learning_rate: 0.0000043025, weight_decay: 0.0001028940

epoch time: 3382.7224121094s, input_fired_time: 45.8210296631, output_fired_time: 26.3883686066, propagate_forward_time: 1308.0156250000, propagate_backward_time: 1961.9033203125, weight_update_time: 0.8167965412, other_time: 40.5939941406
epoch time: 271.5747680664s, input_fired_time: 5.6682419777, output_fired_time: 0.0000000000, propagate_forward_time: 257.5513916016, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.3551330566
validation[          , genome  6200] predictions:    6144/  10000 (61.44%), best:    6465/10000 (64.65%), error:     12416.34277, best error:     10357.20996 on epoch:     0, epoch:   14/25, mu: 0.8020713925, learning_rate: 0.0000040323, weight_decay: 0.0000968250

epoch time: 3373.3547363281s, input_fired_time: 45.9958343506, output_fired_time: 27.5614299774, propagate_forward_time: 1288.1618652344, propagate_backward_time: 1974.9102783203, weight_update_time: 0.7993941307, other_time: 36.7252197266
epoch time: 279.7129211426s, input_fired_time: 3.8249199390, output_fired_time: 0.0000000000, propagate_forward_time: 269.3140563965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5739440918
validation[          , genome  6200] predictions:    6158/  10000 (61.58%), best:    6465/10000 (64.65%), error:     12419.02832, best error:     10357.20996 on epoch:     0, epoch:   15/25, mu: 0.8141325712, learning_rate: 0.0000037790, weight_decay: 0.0000911139

epoch time: 3394.7729492188s, input_fired_time: 49.5326080322, output_fired_time: 28.3552684784, propagate_forward_time: 1311.9979248047, propagate_backward_time: 1962.8583984375, weight_update_time: 0.8061364889, other_time: 42.0286865234
epoch time: 272.8193664551s, input_fired_time: 4.7218871117, output_fired_time: 0.0000000000, propagate_forward_time: 260.3905334473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.7069396973
validation[          , genome  6200] predictions:    6161/  10000 (61.61%), best:    6465/10000 (64.65%), error:     12508.58594, best error:     10357.20996 on epoch:     0, epoch:   16/25, mu: 0.8254196644, learning_rate: 0.0000035416, weight_decay: 0.0000857397

epoch time: 3375.8422851563s, input_fired_time: 51.2798843384, output_fired_time: 30.3058204651, propagate_forward_time: 1292.6572265625, propagate_backward_time: 1962.8803710938, weight_update_time: 0.7929803133, other_time: 38.7189941406
epoch time: 280.5616760254s, input_fired_time: 5.8744282722, output_fired_time: 0.0000000000, propagate_forward_time: 268.2087707520, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4784851074
validation[          , genome  6200] predictions:    6102/  10000 (61.02%), best:    6465/10000 (64.65%), error:     12549.24219, best error:     10357.20996 on epoch:     0, epoch:   17/25, mu: 0.8359823227, learning_rate: 0.0000033191, weight_decay: 0.0000806825

epoch time: 3375.6708984375s, input_fired_time: 49.1716194153, output_fired_time: 30.5690917969, propagate_forward_time: 1292.8714599609, propagate_backward_time: 1963.3349609375, weight_update_time: 0.7999654412, other_time: 39.7237548828
epoch time: 273.0812377930s, input_fired_time: 3.7523512840, output_fired_time: 0.0000000000, propagate_forward_time: 261.7576293945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5712585449
validation[          , genome  6200] predictions:    6095/  10000 (60.95%), best:    6465/10000 (64.65%), error:     12615.11621, best error:     10357.20996 on epoch:     0, epoch:   18/25, mu: 0.8458670974, learning_rate: 0.0000031106, weight_decay: 0.0000759236

epoch time: 3407.7583007813s, input_fired_time: 53.8787078857, output_fired_time: 26.8218326569, propagate_forward_time: 1297.9847412109, propagate_backward_time: 1989.9428710938, weight_update_time: 0.8034821153, other_time: 39.1302490234
epoch time: 276.2538452148s, input_fired_time: 3.7798006535, output_fired_time: 0.0000000000, propagate_forward_time: 265.8223266602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6517028809
validation[          , genome  6200] predictions:    6027/  10000 (60.27%), best:    6465/10000 (64.65%), error:     12814.95020, best error:     10357.20996 on epoch:     0, epoch:   19/25, mu: 0.8551174998, learning_rate: 0.0000029152, weight_decay: 0.0000714454

epoch time: 3362.4499511719s, input_fired_time: 45.9410858154, output_fired_time: 29.3625011444, propagate_forward_time: 1292.9393310547, propagate_backward_time: 1955.6202392578, weight_update_time: 0.8251972198, other_time: 38.5866699219
epoch time: 269.2078552246s, input_fired_time: 4.7338676453, output_fired_time: 0.0000000000, propagate_forward_time: 256.2661437988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.2078552246
validation[          , genome  6200] predictions:    6058/  10000 (60.58%), best:    6465/10000 (64.65%), error:     12715.46094, best error:     10357.20996 on epoch:     0, epoch:   20/25, mu: 0.8637741804, learning_rate: 0.0000027321, weight_decay: 0.0000672313

epoch time: 3384.7700195313s, input_fired_time: 49.3268432617, output_fired_time: 26.4783515930, propagate_forward_time: 1303.1018066406, propagate_backward_time: 1967.6623535156, weight_update_time: 0.7870873809, other_time: 38.2006835938
epoch time: 272.9091491699s, input_fired_time: 4.7689914703, output_fired_time: 0.0000000000, propagate_forward_time: 262.0254821777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1146850586
validation[          , genome  6200] predictions:    6050/  10000 (60.50%), best:    6465/10000 (64.65%), error:     12726.62500, best error:     10357.20996 on epoch:     0, epoch:   21/25, mu: 0.8718752861, learning_rate: 0.0000025605, weight_decay: 0.0000632658

epoch time: 3351.0834960938s, input_fired_time: 50.8700027466, output_fired_time: 29.2414741516, propagate_forward_time: 1276.3693847656, propagate_backward_time: 1956.1064453125, weight_update_time: 0.8227344155, other_time: 38.4960937500
epoch time: 270.5787353516s, input_fired_time: 3.6487214565, output_fired_time: 0.0000000000, propagate_forward_time: 259.6627502441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2672729492
validation[          , genome  6200] predictions:    6071/  10000 (60.71%), best:    6465/10000 (64.65%), error:     12699.89258, best error:     10357.20996 on epoch:     0, epoch:   22/25, mu: 0.8794564605, learning_rate: 0.0000023997, weight_decay: 0.0000595342

epoch time: 3365.2053222656s, input_fired_time: 51.3735160828, output_fired_time: 26.7041473389, propagate_forward_time: 1289.3776855469, propagate_backward_time: 1959.4786376953, weight_update_time: 0.7972880602, other_time: 38.2713623047
epoch time: 275.1901550293s, input_fired_time: 3.7112395763, output_fired_time: 0.0000000000, propagate_forward_time: 261.8679504395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.6109619141
validation[          , genome  6200] predictions:    6016/  10000 (60.16%), best:    6465/10000 (64.65%), error:     12801.71191, best error:     10357.20996 on epoch:     0, epoch:   23/25, mu: 0.8865510821, learning_rate: 0.0000022489, weight_decay: 0.0000560227

epoch time: 3369.6914062500s, input_fired_time: 45.0613365173, output_fired_time: 27.2000617981, propagate_forward_time: 1293.8846435547, propagate_backward_time: 1960.3284912109, weight_update_time: 0.8029084802, other_time: 43.2170410156
epoch time: 270.9475708008s, input_fired_time: 3.6499080658, output_fired_time: 0.0000000000, propagate_forward_time: 260.8834533691, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4142150879
validation[          , genome  6200] predictions:    6037/  10000 (60.37%), best:    6465/10000 (64.65%), error:     12780.31250, best error:     10357.20996 on epoch:     0, epoch:   24/25, mu: 0.8931903839, learning_rate: 0.0000021076, weight_decay: 0.0000527183

epoch time: 3355.2885742188s, input_fired_time: 51.4779052734, output_fired_time: 25.3840103149, propagate_forward_time: 1269.6108398438, propagate_backward_time: 1972.0124511719, weight_update_time: 0.7992256284, other_time: 36.8032226563
epoch time: 275.7080078125s, input_fired_time: 3.7224388123, output_fired_time: 0.0000000000, propagate_forward_time: 265.4054260254, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5801391602
validation[          , genome  6200] predictions:    5943/  10000 (59.43%), best:    6465/10000 (64.65%), error:     12899.84375, best error:     10357.20996 on epoch:     0, epoch:   25/25, mu: 0.8994035721, learning_rate: 0.0000019753, weight_decay: 0.0000496088

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1359.0460205078s, input_fired_time: 21.4617366791, output_fired_time: 0.0000000000, propagate_forward_time: 1302.7764892578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 34.8077392578
best training[          , genome  6200] predictions:   35642/  50000 (71.28%), best:    6465/10000 (64.65%), error:     43982.53906, best error:     10357.20996 on epoch:     0, epoch:   26/25, mu: 0.9052180052, learning_rate: 0.0000018512, weight_decay: 0.0000466827
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 267.4810791016s, input_fired_time: 3.6242599487, output_fired_time: 0.0000000000, propagate_forward_time: 256.6356201172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2211914063
   testing[          , genome  6200] predictions:    6465/  10000 (64.65%), best:    6465/10000 (64.65%), error:     10357.20996, best error:     10357.20996 on epoch:     0, epoch:   26/25, mu: 0.9052180052, learning_rate: 0.0000018512, weight_decay: 0.0000466827
backpropagation finished successfully!
08:14:45 (4216): called boinc_finish(0)

</stderr_txt>
]]>