Nameexact_genome_1540823703_187_5439_1
Workunit4077939
Created29 Oct 2018, 18:02:41 UTC
Sent29 Oct 2018, 18:56:29 UTC
Report deadline23 Jan 2019, 7:36:35 UTC
Received10 Dec 2018, 11:09:22 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time1 days 9 hours 51 min 55 sec
CPU time1 days 9 hours 50 min 59 sec
Validate stateValid
Credit21,381.96
Device peak FLOPS3.80 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size543.73 MB
Peak swap size563.29 MB
Peak disk usage10.53 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
1796264648s, input_fired_time: 14.4548244476, output_fired_time: 5.3465261459, propagate_forward_time: 325.5318908691, propagate_backward_time: 536.4024047852, weight_update_time: 0.2824627161, other_time: 10.4440307617
epoch time: 77.9230880737s, input_fired_time: 0.9557699561, output_fired_time: 0.0000000000, propagate_forward_time: 75.1340255737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8332901001
validation[          , genome  5439] predictions:    6080/  10000 (60.80%), best:    6080/10000 (60.80%), error:     11235.48242, best error:     11235.48242 on epoch:    22, epoch:   22/100, mu: 0.8803203106, learning_rate: 0.0009720564, weight_decay: 0.0002521547

epoch time: 992.2596435547s, input_fired_time: 14.8862714767, output_fired_time: 5.8302588463, propagate_forward_time: 366.0525512695, propagate_backward_time: 594.4868164063, weight_update_time: 0.3058517277, other_time: 11.0037231445
epoch time: 103.2865371704s, input_fired_time: 1.1973787546, output_fired_time: 0.0000000000, propagate_forward_time: 99.8845214844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2046356201
validation[          , genome  5439] predictions:    5985/  10000 (59.85%), best:    6080/10000 (60.80%), error:     11528.25195, best error:     11235.48242 on epoch:    22, epoch:   23/100, mu: 0.8877066970, learning_rate: 0.0009122671, weight_decay: 0.0002413277

epoch time: 967.7382202148s, input_fired_time: 14.7574539185, output_fired_time: 5.6728858948, propagate_forward_time: 357.2473144531, propagate_backward_time: 579.3114013672, weight_update_time: 0.2993054688, other_time: 10.7491455078
epoch time: 106.1421585083s, input_fired_time: 1.2111178637, output_fired_time: 0.0000000000, propagate_forward_time: 102.7490921021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1819458008
validation[          , genome  5439] predictions:    5826/  10000 (58.26%), best:    6080/10000 (60.80%), error:     12113.32227, best error:     11235.48242 on epoch:    22, epoch:   24/100, mu: 0.8945956826, learning_rate: 0.0008561554, weight_decay: 0.0002309655

epoch time: 919.9998779297s, input_fired_time: 14.5567293167, output_fired_time: 5.4347734451, propagate_forward_time: 337.1401977539, propagate_backward_time: 552.3662109375, weight_update_time: 0.2879578769, other_time: 10.5020141602
epoch time: 93.7913589478s, input_fired_time: 1.0995026827, output_fired_time: 0.0000000000, propagate_forward_time: 90.6567993164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0350570679
validation[          , genome  5439] predictions:    6015/  10000 (60.15%), best:    6080/10000 (60.80%), error:     11284.47754, best error:     11235.48242 on epoch:    22, epoch:   25/100, mu: 0.9010207057, learning_rate: 0.0008034950, weight_decay: 0.0002210483

epoch time: 955.5560302734s, input_fired_time: 14.7014665604, output_fired_time: 5.5997614861, propagate_forward_time: 351.5042724609, propagate_backward_time: 573.0584716797, weight_update_time: 0.2970040739, other_time: 10.6920776367
epoch time: 67.3478927612s, input_fired_time: 0.8743480444, output_fired_time: 0.0000000000, propagate_forward_time: 64.7518234253, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7217178345
validation[          , genome  5439] predictions:    6058/  10000 (60.58%), best:    6080/10000 (60.80%), error:     11338.71680, best error:     11235.48242 on epoch:    22, epoch:   26/100, mu: 0.9070130587, learning_rate: 0.0007540736, weight_decay: 0.0002115569

epoch time: 993.5704956055s, input_fired_time: 14.8739271164, output_fired_time: 5.8048815727, propagate_forward_time: 367.2850341797, propagate_backward_time: 594.7189941406, weight_update_time: 0.3052739799, other_time: 10.8876953125
epoch time: 79.8778915405s, input_fired_time: 0.9831029773, output_fired_time: 0.0000000000, propagate_forward_time: 77.0231170654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8716735840
validation[          , genome  5439] predictions:    6059/  10000 (60.59%), best:    6080/10000 (60.80%), error:     11420.36621, best error:     11235.48242 on epoch:    22, epoch:   27/100, mu: 0.9126018286, learning_rate: 0.0007076921, weight_decay: 0.0002024731

epoch time: 1209.8173828125s, input_fired_time: 15.7707986832, output_fired_time: 6.8517484665, propagate_forward_time: 456.6821289063, propagate_backward_time: 718.5187377930, weight_update_time: 0.3555930257, other_time: 11.9939575195
epoch time: 102.4035797119s, input_fired_time: 1.1978123188, output_fired_time: 0.0000000000, propagate_forward_time: 99.0100250244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1957397461
validation[          , genome  5439] predictions:    6157/  10000 (61.57%), best:    6157/10000 (61.57%), error:     10963.66992, best error:     10963.66992 on epoch:    28, epoch:   28/100, mu: 0.9178141952, learning_rate: 0.0006641633, weight_decay: 0.0001937793

epoch time: 1143.9212646484s, input_fired_time: 15.5229864120, output_fired_time: 6.5479860306, propagate_forward_time: 429.0223693848, propagate_backward_time: 681.1583862305, weight_update_time: 0.3414691389, other_time: 11.6696166992
epoch time: 86.2587890625s, input_fired_time: 1.0414139032, output_fired_time: 0.0000000000, propagate_forward_time: 83.2714767456, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9458999634
validation[          , genome  5439] predictions:    6065/  10000 (60.65%), best:    6157/10000 (61.57%), error:     11168.85352, best error:     10963.66992 on epoch:    28, epoch:   29/100, mu: 0.9226755500, learning_rate: 0.0006233120, weight_decay: 0.0001854587

epoch time: 1220.8393554688s, input_fired_time: 15.8123273849, output_fired_time: 6.8732357025, propagate_forward_time: 461.6086730957, propagate_backward_time: 724.5682373047, weight_update_time: 0.3571562171, other_time: 11.9768066406
epoch time: 85.2990493774s, input_fired_time: 1.0453708172, output_fired_time: 0.0000000000, propagate_forward_time: 82.2936477661, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9600296021
validation[          , genome  5439] predictions:    6135/  10000 (61.35%), best:    6157/10000 (61.57%), error:     11119.25586, best error:     10963.66992 on epoch:    28, epoch:   30/100, mu: 0.9272095561, learning_rate: 0.0005849733, weight_decay: 0.0001774955

epoch time: 1066.8492431641s, input_fired_time: 15.2219743729, output_fired_time: 6.1824026108, propagate_forward_time: 396.8060302734, propagate_backward_time: 637.3696899414, weight_update_time: 0.3223280311, other_time: 11.2692260742
epoch time: 104.8927307129s, input_fired_time: 1.2222335339, output_fired_time: 0.0000000000, propagate_forward_time: 101.4728088379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1976852417
validation[          , genome  5439] predictions:    6251/  10000 (62.51%), best:    6251/10000 (62.51%), error:     10727.48242, best error:     10727.48242 on epoch:    31, epoch:   31/100, mu: 0.9314382076, learning_rate: 0.0005489928, weight_decay: 0.0001698742

epoch time: 1132.9208984375s, input_fired_time: 15.5240116119, output_fired_time: 6.5167675018, propagate_forward_time: 424.5508422852, propagate_backward_time: 674.7021484375, weight_update_time: 0.3370324075, other_time: 11.6271362305
epoch time: 99.9630432129s, input_fired_time: 1.1638348103, output_fired_time: 0.0000000000, propagate_forward_time: 96.7091827393, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0900268555
validation[          , genome  5439] predictions:    6156/  10000 (61.56%), best:    6251/10000 (62.51%), error:     11096.68359, best error:     10727.48242 on epoch:    31, epoch:   32/100, mu: 0.9353820682, learning_rate: 0.0005152253, weight_decay: 0.0001625801

epoch time: 1199.1481933594s, input_fired_time: 15.7610473633, output_fired_time: 6.8161268234, propagate_forward_time: 451.7595214844, propagate_backward_time: 712.8513183594, weight_update_time: 0.3534663618, other_time: 11.9602050781
epoch time: 112.4242706299s, input_fired_time: 1.2943309546, output_fired_time: 0.0000000000, propagate_forward_time: 108.8034362793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3264999390
validation[          , genome  5439] predictions:    6248/  10000 (62.48%), best:    6251/10000 (62.51%), error:     10848.49414, best error:     10727.48242 on epoch:    31, epoch:   33/100, mu: 0.9390603304, learning_rate: 0.0004835349, weight_decay: 0.0001555992

epoch time: 1260.4097900391s, input_fired_time: 15.9827766418, output_fired_time: 7.0483388901, propagate_forward_time: 477.3082580566, propagate_backward_time: 747.9212036133, weight_update_time: 0.3663463593, other_time: 12.1492309570
epoch time: 92.1199645996s, input_fired_time: 1.0955625772, output_fired_time: 0.0000000000, propagate_forward_time: 89.0213928223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0030059814
validation[          , genome  5439] predictions:    6183/  10000 (61.83%), best:    6251/10000 (62.51%), error:     10878.74316, best error:     10727.48242 on epoch:    31, epoch:   34/100, mu: 0.9424908757, learning_rate: 0.0004537936, weight_decay: 0.0001489181

epoch time: 1209.0136718750s, input_fired_time: 15.7959260941, output_fired_time: 6.8448014259, propagate_forward_time: 456.2550048828, propagate_backward_time: 718.1803588867, weight_update_time: 0.3553548753, other_time: 11.9375610352
epoch time: 106.2271804810s, input_fired_time: 1.2174204588, output_fired_time: 0.0000000000, propagate_forward_time: 102.8565826416, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1531753540
validation[          , genome  5439] predictions:    6164/  10000 (61.64%), best:    6251/10000 (62.51%), error:     10952.00586, best error:     10727.48242 on epoch:    31, epoch:   35/100, mu: 0.9456903934, learning_rate: 0.0004258816, weight_decay: 0.0001425238

epoch time: 1274.4176025391s, input_fired_time: 16.0365676880, output_fired_time: 7.1250715256, propagate_forward_time: 481.7107238770, propagate_backward_time: 757.3580322266, weight_update_time: 0.3684544861, other_time: 12.1871337891
epoch time: 95.0081710815s, input_fired_time: 1.1047254801, output_fired_time: 0.0000000000, propagate_forward_time: 91.9244232178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9790191650
validation[          , genome  5439] predictions:    6234/  10000 (62.34%), best:    6251/10000 (62.51%), error:     10965.03906, best error:     10727.48242 on epoch:    31, epoch:   36/100, mu: 0.9486744404, learning_rate: 0.0003996865, weight_decay: 0.0001364041

epoch time: 1247.4509277344s, input_fired_time: 15.9045610428, output_fired_time: 6.9089937210, propagate_forward_time: 471.6083679199, propagate_backward_time: 741.0050048828, weight_update_time: 0.3660240173, other_time: 12.0240478516
epoch time: 111.9235687256s, input_fired_time: 1.2680928707, output_fired_time: 0.0000000000, propagate_forward_time: 108.4271774292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2283020020
validation[          , genome  5439] predictions:    6148/  10000 (61.48%), best:    6251/10000 (62.51%), error:     11122.44727, best error:     10727.48242 on epoch:    31, epoch:   37/100, mu: 0.9514575005, learning_rate: 0.0003751026, weight_decay: 0.0001305472

epoch time: 1284.3229980469s, input_fired_time: 16.0828304291, output_fired_time: 7.1141347885, propagate_forward_time: 487.6799926758, propagate_backward_time: 761.2716674805, weight_update_time: 0.3702712655, other_time: 12.1743164063
epoch time: 87.4854507446s, input_fired_time: 1.0553277731, output_fired_time: 0.0000000000, propagate_forward_time: 84.4728240967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9572982788
validation[          , genome  5439] predictions:    6201/  10000 (62.01%), best:    6251/10000 (62.51%), error:     10916.50781, best error:     10727.48242 on epoch:    31, epoch:   38/100, mu: 0.9540531635, learning_rate: 0.0003520308, weight_decay: 0.0001249417

epoch time: 1128.0023193359s, input_fired_time: 15.4864835739, output_fired_time: 6.4629635811, propagate_forward_time: 421.8282470703, propagate_backward_time: 672.6722412109, weight_update_time: 0.3361787200, other_time: 11.5523681641
epoch time: 102.4866333008s, input_fired_time: 1.1829046011, output_fired_time: 0.0000000000, propagate_forward_time: 99.2133331299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0903930664
validation[          , genome  5439] predictions:    6149/  10000 (61.49%), best:    6251/10000 (62.51%), error:     11127.51563, best error:     10727.48242 on epoch:    31, epoch:   39/100, mu: 0.9564740062, learning_rate: 0.0003303781, weight_decay: 0.0001195770

epoch time: 1207.1021728516s, input_fired_time: 15.7876129150, output_fired_time: 6.7129893303, propagate_forward_time: 458.6608581543, propagate_backward_time: 714.0667114258, weight_update_time: 0.3553359210, other_time: 11.8739624023
epoch time: 88.3609619141s, input_fired_time: 1.0624966621, output_fired_time: 0.0000000000, propagate_forward_time: 85.3571166992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9413452148
validation[          , genome  5439] predictions:    6362/  10000 (63.62%), best:    6362/10000 (63.62%), error:     10576.07324, best error:     10576.07324 on epoch:    40, epoch:   40/100, mu: 0.9587318301, learning_rate: 0.0003100572, weight_decay: 0.0001144426

epoch time: 1218.4675292969s, input_fired_time: 15.8550004959, output_fired_time: 6.8327136040, propagate_forward_time: 461.4486083984, propagate_backward_time: 722.4038085938, weight_update_time: 0.3563483655, other_time: 11.9273681641
epoch time: 92.5245590210s, input_fired_time: 1.1072773933, output_fired_time: 0.0000000000, propagate_forward_time: 89.4334335327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9838485718
validation[          , genome  5439] predictions:    6269/  10000 (62.69%), best:    6362/10000 (63.62%), error:     10715.39648, best error:     10576.07324 on epoch:    40, epoch:   41/100, mu: 0.9608376026, learning_rate: 0.0002909862, weight_decay: 0.0001095286

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540823703_187_5439.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540823703_187_5439_1_r1196231479_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.48153
read mu: 0.962802
read mu_delta: 0.932655
read initial_learning_rate: 0.00392843
read learning_rate: 0.000273088
read learning_rate_delta: 0.938492
read initial_weight_decay: 0.000662196
read weight_decay: 0.000104826
read weight_decay_delta: 0.957062
read batch_size: 93
read epsilon: 1e-07
read alpha: 0.0967029
read input_dropout_probability: 0.0011532
read hidden_dropout_probability: 0.0845031
read velocity_reset: 1421
read epoch: 42
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 40
read number_validation_images: 10000
read best_validation_predictions: 6362
read best_validation_error: 10576.1
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5439
read normal distribution: '0 -2.52441072463989 -0.00810799095779657'
generator_str: '824482708'
read generator: 824482708
read generated_by_map:
1 enable_node 1
reading 79 nodes.
reading 327 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1453.85168457031s, input_fired_time: 26.7110023498535, output_fired_time: 14.9519205093384, propagate_forward_time: 526.322937011719, propagate_backward_time: 839.238098144531, weight_update_time: 1.10572981834412, other_time: 46.627685546875
epoch time: 121.519119262695s, input_fired_time: 2.81624388694763, output_fired_time: 0, propagate_forward_time: 109.440803527832, propagate_backward_time: 0, weight_update_time: 0, other_time: 9.26206970214844
validation[          , genome  5439] predictions:    6172/  10000 (61.72%), best:    6362/10000 (63.62%), error:     10871.66797, best error:     10576.07324 on epoch:    40, epoch:   42/100, mu: 0.9628015757, learning_rate: 0.0002730882, weight_decay: 0.0001048257

epoch time: 1426.4561767578s, input_fired_time: 25.9464206696, output_fired_time: 14.3858041763, propagate_forward_time: 509.0231628418, propagate_backward_time: 832.2183837891, weight_update_time: 1.0902215242, other_time: 44.8823242188
epoch time: 110.9898376465s, input_fired_time: 2.6403853893, output_fired_time: 0.0000000000, propagate_forward_time: 100.6237258911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.7257232666
validation[          , genome  5439] predictions:    6255/  10000 (62.55%), best:    6362/10000 (63.62%), error:     10827.52637, best error:     10576.07324 on epoch:    40, epoch:   43/100, mu: 0.9646332860, learning_rate: 0.0002562911, weight_decay: 0.0001003246

epoch time: 1464.2388916016s, input_fired_time: 27.0797691345, output_fired_time: 15.4807376862, propagate_forward_time: 527.6347045898, propagate_backward_time: 845.6314697266, weight_update_time: 1.1567817926, other_time: 48.4122924805
epoch time: 112.1539077759s, input_fired_time: 2.4493868351, output_fired_time: 0.0000000000, propagate_forward_time: 102.5990982056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1054229736
validation[          , genome  5439] predictions:    6235/  10000 (62.35%), best:    6362/10000 (63.62%), error:     10909.81055, best error:     10576.07324 on epoch:    40, epoch:   44/100, mu: 0.9663416147, learning_rate: 0.0002405272, weight_decay: 0.0000960169

epoch time: 1396.5900878906s, input_fired_time: 26.2932300568, output_fired_time: 14.6920499802, propagate_forward_time: 501.7340087891, propagate_backward_time: 810.7366943359, weight_update_time: 1.0805648565, other_time: 43.1341552734
epoch time: 114.8017807007s, input_fired_time: 2.7683007717, output_fired_time: 0.0000000000, propagate_forward_time: 103.5163726807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5171051025
validation[          , genome  5439] predictions:    6305/  10000 (63.05%), best:    6362/10000 (63.62%), error:     10674.63770, best error:     10576.07324 on epoch:    40, epoch:   45/100, mu: 0.9679349065, learning_rate: 0.0002257328, weight_decay: 0.0000918941

epoch time: 1407.3212890625s, input_fired_time: 26.2450351715, output_fired_time: 14.5750951767, propagate_forward_time: 507.9265441895, propagate_backward_time: 812.0677490234, weight_update_time: 1.1418575048, other_time: 46.5069580078
epoch time: 112.1316070557s, input_fired_time: 2.7399027348, output_fired_time: 0.0000000000, propagate_forward_time: 100.7816772461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.6100234985
validation[          , genome  5439] predictions:    6264/  10000 (62.64%), best:    6362/10000 (63.62%), error:     10761.52734, best error:     10576.07324 on epoch:    40, epoch:   46/100, mu: 0.9694209099, learning_rate: 0.0002118484, weight_decay: 0.0000879483

epoch time: 1349.8881835938s, input_fired_time: 26.0984096527, output_fired_time: 14.3664617538, propagate_forward_time: 483.0487365723, propagate_backward_time: 781.8466796875, weight_update_time: 1.1064773798, other_time: 44.5279541016
epoch time: 100.0385513306s, input_fired_time: 2.5187761784, output_fired_time: 0.0000000000, propagate_forward_time: 90.7373046875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.7824707031
validation[          , genome  5439] predictions:    6321/  10000 (63.21%), best:    6362/10000 (63.62%), error:     10691.10156, best error:     10576.07324 on epoch:    40, epoch:   47/100, mu: 0.9708068371, learning_rate: 0.0001988181, weight_decay: 0.0000841720

epoch time: 1299.6373291016s, input_fired_time: 25.6935234070, output_fired_time: 14.0679759979, propagate_forward_time: 467.1228637695, propagate_backward_time: 751.7354125977, weight_update_time: 1.0680624247, other_time: 41.0175781250
epoch time: 103.2882766724s, input_fired_time: 2.4671192169, output_fired_time: 0.0000000000, propagate_forward_time: 93.6280212402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.1931381226
validation[          , genome  5439] predictions:    6411/  10000 (64.11%), best:    6411/10000 (64.11%), error:     10447.31836, best error:     10447.31836 on epoch:    48, epoch:   48/100, mu: 0.9720994234, learning_rate: 0.0001865892, weight_decay: 0.0000805578

epoch time: 1246.8110351563s, input_fired_time: 25.3196372986, output_fired_time: 14.1112556458, propagate_forward_time: 445.6270446777, propagate_backward_time: 722.6231689453, weight_update_time: 1.0349161625, other_time: 39.1300048828
epoch time: 102.2112274170s, input_fired_time: 2.6001796722, output_fired_time: 0.0000000000, propagate_forward_time: 92.3191452026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.2919006348
validation[          , genome  5439] predictions:    6245/  10000 (62.45%), best:    6411/10000 (64.11%), error:     10755.26563, best error:     10447.31836 on epoch:    48, epoch:   49/100, mu: 0.9733049273, learning_rate: 0.0001751124, weight_decay: 0.0000770988

epoch time: 1318.9998779297s, input_fired_time: 27.3073387146, output_fired_time: 15.3377895355, propagate_forward_time: 473.2574768066, propagate_backward_time: 759.1021118164, weight_update_time: 1.1316145658, other_time: 43.9951782227
epoch time: 108.0147552490s, input_fired_time: 2.5918021202, output_fired_time: 0.0000000000, propagate_forward_time: 97.8851394653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5378112793
validation[          , genome  5439] predictions:    6319/  10000 (63.19%), best:    6411/10000 (64.11%), error:     10525.24805, best error:     10447.31836 on epoch:    48, epoch:   50/100, mu: 0.9744292498, learning_rate: 0.0001643416, weight_decay: 0.0000737883

epoch time: 1294.6850585938s, input_fired_time: 25.6233196259, output_fired_time: 14.2599945068, propagate_forward_time: 464.6477661133, propagate_backward_time: 749.7369995117, weight_update_time: 1.0527001619, other_time: 40.4169921875
epoch time: 109.4426803589s, input_fired_time: 2.7043142319, output_fired_time: 0.0000000000, propagate_forward_time: 98.1866073608, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5517578125
validation[          , genome  5439] predictions:    6407/  10000 (64.07%), best:    6407/10000 (64.07%), error:     10405.31250, best error:     10405.31250 on epoch:    51, epoch:   51/100, mu: 0.9754778743, learning_rate: 0.0001542333, weight_decay: 0.0000706200

epoch time: 1327.2082519531s, input_fired_time: 26.7244377136, output_fired_time: 14.7400131226, propagate_forward_time: 476.2098999023, propagate_backward_time: 766.0778808594, weight_update_time: 1.0926140547, other_time: 43.4559936523
epoch time: 104.9421081543s, input_fired_time: 3.0281276703, output_fired_time: 0.0000000000, propagate_forward_time: 93.9023666382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.0116119385
validation[          , genome  5439] predictions:    6385/  10000 (63.85%), best:    6407/10000 (64.07%), error:     10458.43457, best error:     10405.31250 on epoch:    51, epoch:   52/100, mu: 0.9764558673, learning_rate: 0.0001447467, weight_decay: 0.0000675877

epoch time: 1300.9880371094s, input_fired_time: 26.1389636993, output_fired_time: 14.6720523834, propagate_forward_time: 466.7128295898, propagate_backward_time: 751.9972534180, weight_update_time: 1.0981496572, other_time: 41.4670410156
epoch time: 111.4331588745s, input_fired_time: 3.0354645252, output_fired_time: 0.0000000000, propagate_forward_time: 99.4127197266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.9849777222
validation[          , genome  5439] predictions:    6325/  10000 (63.25%), best:    6407/10000 (64.07%), error:     10668.11523, best error:     10405.31250 on epoch:    51, epoch:   53/100, mu: 0.9773679972, learning_rate: 0.0001358436, weight_decay: 0.0000646856

epoch time: 1349.5648193359s, input_fired_time: 27.1447067261, output_fired_time: 14.9877948761, propagate_forward_time: 484.0032653809, propagate_backward_time: 779.9186401367, weight_update_time: 1.1104940176, other_time: 43.5104370117
epoch time: 110.8664932251s, input_fired_time: 2.8103437424, output_fired_time: 0.0000000000, propagate_forward_time: 99.3801879883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.6759643555
validation[          , genome  5439] predictions:    6400/  10000 (64.00%), best:    6407/10000 (64.07%), error:     10436.55859, best error:     10405.31250 on epoch:    51, epoch:   54/100, mu: 0.9782186747, learning_rate: 0.0001274882, weight_decay: 0.0000619081

epoch time: 1433.9604492188s, input_fired_time: 27.3850326538, output_fired_time: 15.1972227097, propagate_forward_time: 517.5759277344, propagate_backward_time: 828.1359252930, weight_update_time: 1.1317623854, other_time: 45.6663208008
epoch time: 114.2650146484s, input_fired_time: 2.8078739643, output_fired_time: 0.0000000000, propagate_forward_time: 102.9874038696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.4697341919
validation[          , genome  5439] predictions:    6479/  10000 (64.79%), best:    6479/10000 (64.79%), error:     10326.73828, best error:     10326.73828 on epoch:    55, epoch:   55/100, mu: 0.9790120721, learning_rate: 0.0001196466, weight_decay: 0.0000592499

epoch time: 1427.0220947266s, input_fired_time: 27.5325832367, output_fired_time: 15.5231952667, propagate_forward_time: 505.8465576172, propagate_backward_time: 830.2070312500, weight_update_time: 1.1879179478, other_time: 47.9127197266
epoch time: 110.7823333740s, input_fired_time: 2.6468546391, output_fired_time: 0.0000000000, propagate_forward_time: 100.3763732910, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.7591018677
validation[          , genome  5439] predictions:    6387/  10000 (63.87%), best:    6479/10000 (64.79%), error:     10370.00586, best error:     10326.73828 on epoch:    55, epoch:   56/100, mu: 0.9797520638, learning_rate: 0.0001122874, weight_decay: 0.0000567058

epoch time: 1449.0207519531s, input_fired_time: 27.6129150391, output_fired_time: 15.3789577484, propagate_forward_time: 520.9534301758, propagate_backward_time: 838.7998657227, weight_update_time: 1.1343919039, other_time: 46.2756347656
epoch time: 122.8204498291s, input_fired_time: 3.0515606403, output_fired_time: 0.0000000000, propagate_forward_time: 110.7410736084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.0278167725
validation[          , genome  5439] predictions:    6392/  10000 (63.92%), best:    6479/10000 (64.79%), error:     10358.02539, best error:     10326.73828 on epoch:    55, epoch:   57/100, mu: 0.9804422259, learning_rate: 0.0001053808, weight_decay: 0.0000542710

epoch time: 1416.1531982422s, input_fired_time: 24.3017730713, output_fired_time: 12.6865272522, propagate_forward_time: 517.5364379883, propagate_backward_time: 823.7097167969, weight_update_time: 0.9306513071, other_time: 37.9187622070
epoch time: 108.0939025879s, input_fired_time: 2.1339633465, output_fired_time: 0.0000000000, propagate_forward_time: 99.8235626221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1363754272
validation[          , genome  5439] predictions:    6416/  10000 (64.16%), best:    6479/10000 (64.79%), error:     10387.03711, best error:     10326.73828 on epoch:    55, epoch:   58/100, mu: 0.9810858965, learning_rate: 0.0000988991, weight_decay: 0.0000519407

epoch time: 1409.8620605469s, input_fired_time: 23.4237804413, output_fired_time: 11.9763669968, propagate_forward_time: 515.6790771484, propagate_backward_time: 821.0895385742, weight_update_time: 0.9068099856, other_time: 37.6932983398
epoch time: 118.9448318481s, input_fired_time: 2.2691941261, output_fired_time: 0.0000000000, propagate_forward_time: 110.0390472412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6365890503
validation[          , genome  5439] predictions:    6475/  10000 (64.75%), best:    6475/10000 (64.75%), error:     10256.09277, best error:     10256.09277 on epoch:    59, epoch:   59/100, mu: 0.9816862345, learning_rate: 0.0000928160, weight_decay: 0.0000497105

epoch time: 1413.9390869141s, input_fired_time: 22.8519306183, output_fired_time: 11.5879840851, propagate_forward_time: 516.9774169922, propagate_backward_time: 828.4425048828, weight_update_time: 0.8332997561, other_time: 34.0792236328
epoch time: 109.4922866821s, input_fired_time: 1.9444686174, output_fired_time: 0.0000000000, propagate_forward_time: 101.9325332642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6152877808
validation[          , genome  5439] predictions:    6402/  10000 (64.02%), best:    6475/10000 (64.75%), error:     10290.92969, best error:     10256.09277 on epoch:    59, epoch:   60/100, mu: 0.9822461009, learning_rate: 0.0000871070, weight_decay: 0.0000475760

epoch time: 1402.2598876953s, input_fired_time: 22.2345542908, output_fired_time: 11.1442070007, propagate_forward_time: 512.2927856445, propagate_backward_time: 823.6340942383, weight_update_time: 0.8016813993, other_time: 32.9543457031
epoch time: 102.5717697144s, input_fired_time: 1.4765101671, output_fired_time: 0.0000000000, propagate_forward_time: 97.5432662964, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5519943237
validation[          , genome  5439] predictions:    6361/  10000 (63.61%), best:    6475/10000 (64.75%), error:     10444.71582, best error:     10256.09277 on epoch:    59, epoch:   61/100, mu: 0.9827682972, learning_rate: 0.0000817493, weight_decay: 0.0000455332

epoch time: 1281.3436279297s, input_fired_time: 18.1310424805, output_fired_time: 7.9528803825, propagate_forward_time: 476.7229614258, propagate_backward_time: 759.3695068359, weight_update_time: 0.4969389141, other_time: 19.1672973633
epoch time: 85.8224563599s, input_fired_time: 1.2031012774, output_fired_time: 0.0000000000, propagate_forward_time: 81.6976928711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9216613770
validation[          , genome  5439] predictions:    6467/  10000 (64.67%), best:    6467/10000 (64.67%), error:     10245.11133, best error:     10245.11133 on epoch:    62, epoch:   62/100, mu: 0.9832553267, learning_rate: 0.0000767210, weight_decay: 0.0000435781

epoch time: 1375.7045898438s, input_fired_time: 18.6843051910, output_fired_time: 8.7791852951, propagate_forward_time: 513.0434570313, propagate_backward_time: 812.5161743164, weight_update_time: 0.5520631075, other_time: 22.6814575195
epoch time: 110.9664535522s, input_fired_time: 1.4096759558, output_fired_time: 0.0000000000, propagate_forward_time: 105.8908996582, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6658782959
validation[          , genome  5439] predictions:    6349/  10000 (63.49%), best:    6467/10000 (64.67%), error:     10507.52734, best error:     10245.11133 on epoch:    62, epoch:   63/100, mu: 0.9837095737, learning_rate: 0.0000720021, weight_decay: 0.0000417069

epoch time: 1244.4973144531s, input_fired_time: 17.8493003845, output_fired_time: 7.8020639420, propagate_forward_time: 461.1689453125, propagate_backward_time: 738.3603515625, weight_update_time: 0.4867691696, other_time: 19.3166503906
epoch time: 102.8176803589s, input_fired_time: 1.3234161139, output_fired_time: 0.0000000000, propagate_forward_time: 97.8336181641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6606445313
validation[          , genome  5439] predictions:    6471/  10000 (64.71%), best:    6471/10000 (64.71%), error:     10130.36328, best error:     10130.36328 on epoch:    64, epoch:   64/100, mu: 0.9841331840, learning_rate: 0.0000675734, weight_decay: 0.0000399161

epoch time: 945.1392211914s, input_fired_time: 15.0566539764, output_fired_time: 5.6705603600, propagate_forward_time: 346.6613464355, propagate_backward_time: 566.4580688477, weight_update_time: 0.3125594258, other_time: 11.2926635742
epoch time: 66.4918594360s, input_fired_time: 0.9177755713, output_fired_time: 0.0000000000, propagate_forward_time: 63.8522949219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7217864990
validation[          , genome  5439] predictions:    6503/  10000 (65.03%), best:    6471/10000 (64.71%), error:     10157.33691, best error:     10130.36328 on epoch:    64, epoch:   65/100, mu: 0.9845283031, learning_rate: 0.0000634171, weight_decay: 0.0000382022

epoch time: 823.3903198242s, input_fired_time: 14.4284667969, output_fired_time: 4.9972949028, propagate_forward_time: 297.1354980469, propagate_backward_time: 496.7546691895, weight_update_time: 0.2786052525, other_time: 10.0743713379
epoch time: 65.2092514038s, input_fired_time: 0.9085052013, output_fired_time: 0.0000000000, propagate_forward_time: 62.5834655762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7172775269
validation[          , genome  5439] predictions:    6510/  10000 (65.10%), best:    6510/10000 (65.10%), error:     10117.65332, best error:     10117.65332 on epoch:    66, epoch:   66/100, mu: 0.9848967791, learning_rate: 0.0000595164, weight_decay: 0.0000365618

epoch time: 873.0120849609s, input_fired_time: 14.6421909332, output_fired_time: 5.2312159538, propagate_forward_time: 317.5945129395, propagate_backward_time: 525.2305908203, weight_update_time: 0.2913901508, other_time: 10.3135986328
epoch time: 60.9919738770s, input_fired_time: 0.8702301979, output_fired_time: 0.0000000000, propagate_forward_time: 58.4726638794, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6490783691
validation[          , genome  5439] predictions:    6341/  10000 (63.41%), best:    6510/10000 (65.10%), error:     10409.65332, best error:     10117.65332 on epoch:    66, epoch:   67/100, mu: 0.9852404594, learning_rate: 0.0000558557, weight_decay: 0.0000349919

epoch time: 913.0344238281s, input_fired_time: 14.8094997406, output_fired_time: 5.4276828766, propagate_forward_time: 333.8226928711, propagate_backward_time: 548.4199218750, weight_update_time: 0.3015302122, other_time: 10.5546264648
epoch time: 83.4663391113s, input_fired_time: 1.0509388447, output_fired_time: 0.0000000000, propagate_forward_time: 80.5474929810, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8679046631
validation[          , genome  5439] predictions:    6441/  10000 (64.41%), best:    6510/10000 (65.10%), error:     10242.88379, best error:     10117.65332 on epoch:    66, epoch:   68/100, mu: 0.9855610132, learning_rate: 0.0000524201, weight_decay: 0.0000334895

epoch time: 894.8063964844s, input_fired_time: 14.7424011230, output_fired_time: 5.3448309898, propagate_forward_time: 327.1917114258, propagate_backward_time: 537.0776367188, weight_update_time: 0.2982494235, other_time: 10.4497680664
epoch time: 65.3650970459s, input_fired_time: 0.9038092494, output_fired_time: 0.0000000000, propagate_forward_time: 62.7685508728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6927375793
validation[          , genome  5439] predictions:    6444/  10000 (64.44%), best:    6510/10000 (65.10%), error:     10296.36328, best error:     10117.65332 on epoch:    66, epoch:   69/100, mu: 0.9858599305, learning_rate: 0.0000491958, weight_decay: 0.0000320515

epoch time: 883.6396484375s, input_fired_time: 14.6697158813, output_fired_time: 5.2597556114, propagate_forward_time: 321.9963073730, propagate_backward_time: 531.3790893555, weight_update_time: 0.2969543040, other_time: 10.3347778320
epoch time: 63.9586715698s, input_fired_time: 0.8992456794, output_fired_time: 0.0000000000, propagate_forward_time: 61.3835639954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6758613586
validation[          , genome  5439] predictions:    6445/  10000 (64.45%), best:    6510/10000 (65.10%), error:     10272.20215, best error:     10117.65332 on epoch:    66, epoch:   70/100, mu: 0.9861387610, learning_rate: 0.0000461699, weight_decay: 0.0000306753

epoch time: 836.2605590820s, input_fired_time: 14.5100917816, output_fired_time: 5.0475811958, propagate_forward_time: 302.4773254395, propagate_backward_time: 504.0556030273, weight_update_time: 0.2873607278, other_time: 10.1699829102
epoch time: 63.5430946350s, input_fired_time: 0.8948862553, output_fired_time: 0.0000000000, propagate_forward_time: 60.9555168152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6926918030
validation[          , genome  5439] predictions:    6432/  10000 (64.32%), best:    6510/10000 (65.10%), error:     10218.13477, best error:     10117.65332 on epoch:    66, epoch:   71/100, mu: 0.9863988161, learning_rate: 0.0000433301, weight_decay: 0.0000293581

epoch time: 857.3051757813s, input_fired_time: 14.5900335312, output_fired_time: 5.1415019035, propagate_forward_time: 311.5504455566, propagate_backward_time: 515.7927246094, weight_update_time: 0.2933903039, other_time: 10.2304687500
epoch time: 82.1765060425s, input_fired_time: 1.0423835516, output_fired_time: 0.0000000000, propagate_forward_time: 79.2780456543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8560791016
validation[          , genome  5439] predictions:    6486/  10000 (64.86%), best:    6510/10000 (65.10%), error:     10181.92676, best error:     10117.65332 on epoch:    66, epoch:   72/100, mu: 0.9866413474, learning_rate: 0.0000406649, weight_decay: 0.0000280975

epoch time: 877.2207031250s, input_fired_time: 14.6832532883, output_fired_time: 5.2370796204, propagate_forward_time: 318.9271545410, propagate_backward_time: 528.0003051758, weight_update_time: 0.3021583557, other_time: 10.3729858398
epoch time: 60.8106422424s, input_fired_time: 0.8769038320, output_fired_time: 0.0000000000, propagate_forward_time: 58.2886734009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6450653076
validation[          , genome  5439] predictions:    6505/  10000 (65.05%), best:    6505/10000 (65.05%), error:     10114.02930, best error:     10114.02930 on epoch:    73, epoch:   73/100, mu: 0.9868675470, learning_rate: 0.0000381637, weight_decay: 0.0000268911

epoch time: 826.5297241211s, input_fired_time: 14.4759416580, output_fired_time: 5.0072278976, propagate_forward_time: 298.4989013672, propagate_backward_time: 498.4533996582, weight_update_time: 0.2892130613, other_time: 10.0942687988
epoch time: 60.7310180664s, input_fired_time: 0.8723717332, output_fired_time: 0.0000000000, propagate_forward_time: 58.2161560059, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6424903870
validation[          , genome  5439] predictions:    6453/  10000 (64.53%), best:    6505/10000 (65.05%), error:     10191.45508, best error:     10114.02930 on epoch:    73, epoch:   74/100, mu: 0.9870784879, learning_rate: 0.0000358163, weight_decay: 0.0000257364

epoch time: 843.2916870117s, input_fired_time: 14.5501508713, output_fired_time: 5.0962677002, propagate_forward_time: 305.0660095215, propagate_backward_time: 508.3812255859, weight_update_time: 0.2945555747, other_time: 10.1979980469
epoch time: 62.2955436707s, input_fired_time: 0.8865250945, output_fired_time: 0.0000000000, propagate_forward_time: 59.7446861267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6643333435
validation[          , genome  5439] predictions:    6476/  10000 (64.76%), best:    6505/10000 (65.05%), error:     10118.27539, best error:     10114.02930 on epoch:    73, epoch:   75/100, mu: 0.9872752428, learning_rate: 0.0000336134, weight_decay: 0.0000246314

epoch time: 881.6803588867s, input_fired_time: 14.6975259781, output_fired_time: 5.2426056862, propagate_forward_time: 321.2571411133, propagate_backward_time: 530.1596679688, weight_update_time: 0.3035615087, other_time: 10.3234252930
epoch time: 77.4337844849s, input_fired_time: 1.0193806887, output_fired_time: 0.0000000000, propagate_forward_time: 74.5764694214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8379364014
validation[          , genome  5439] predictions:    6524/  10000 (65.24%), best:    6524/10000 (65.24%), error:     10037.64746, best error:     10037.64746 on epoch:    76, epoch:   76/100, mu: 0.9874587655, learning_rate: 0.0000315459, weight_decay: 0.0000235737

epoch time: 992.9287109375s, input_fired_time: 15.1495618820, output_fired_time: 5.7817974091, propagate_forward_time: 367.4431457520, propagate_backward_time: 593.6612548828, weight_update_time: 0.3307430446, other_time: 10.8929443359
epoch time: 68.2529983521s, input_fired_time: 0.9409443736, output_fired_time: 0.0000000000, propagate_forward_time: 65.5681152344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7439422607
validation[          , genome  5439] predictions:    6539/  10000 (65.39%), best:    6539/10000 (65.39%), error:     10008.24219, best error:     10008.24219 on epoch:    77, epoch:   77/100, mu: 0.9876298904, learning_rate: 0.0000296055, weight_decay: 0.0000225615

epoch time: 972.0179443359s, input_fired_time: 15.0738210678, output_fired_time: 5.6896595955, propagate_forward_time: 358.5650329590, propagate_backward_time: 581.8959960938, weight_update_time: 0.3300058544, other_time: 10.7934570313
epoch time: 116.6344604492s, input_fired_time: 1.3399876356, output_fired_time: 0.0000000000, propagate_forward_time: 113.0241165161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2703552246
validation[          , genome  5439] predictions:    6486/  10000 (64.86%), best:    6539/10000 (65.39%), error:     10124.26367, best error:     10008.24219 on epoch:    77, epoch:   78/100, mu: 0.9877895117, learning_rate: 0.0000277846, weight_decay: 0.0000215928

epoch time: 902.9417724609s, input_fired_time: 14.7849597931, output_fired_time: 5.3555464745, propagate_forward_time: 329.9928283691, propagate_backward_time: 542.3352661133, weight_update_time: 0.3146514297, other_time: 10.4732055664
epoch time: 63.9055366516s, input_fired_time: 0.9000330567, output_fired_time: 0.0000000000, propagate_forward_time: 61.3282012939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6773033142
validation[          , genome  5439] predictions:    6554/  10000 (65.54%), best:    6554/10000 (65.54%), error:      9999.99219, best error:      9999.99219 on epoch:    79, epoch:   79/100, mu: 0.9879384041, learning_rate: 0.0000260756, weight_decay: 0.0000206656

epoch time: 909.6302490234s, input_fired_time: 14.8172798157, output_fired_time: 5.4025683403, propagate_forward_time: 332.6754455566, propagate_backward_time: 546.2246093750, weight_update_time: 0.3166178167, other_time: 10.5103759766
epoch time: 99.4178390503s, input_fired_time: 1.2216311693, output_fired_time: 0.0000000000, propagate_forward_time: 96.0458831787, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1503219604
validation[          , genome  5439] predictions:    6550/  10000 (65.50%), best:    6550/10000 (65.50%), error:      9997.10742, best error:      9997.10742 on epoch:    80, epoch:   80/100, mu: 0.9880772233, learning_rate: 0.0000244717, weight_decay: 0.0000197783

epoch time: 869.6053466797s, input_fired_time: 14.6490182877, output_fired_time: 5.2034745216, propagate_forward_time: 316.3791503906, propagate_backward_time: 523.0890502930, weight_update_time: 0.3092191517, other_time: 10.2846069336
epoch time: 75.4872207642s, input_fired_time: 0.9964077473, output_fired_time: 0.0000000000, propagate_forward_time: 72.7054595947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7853546143
validation[          , genome  5439] predictions:    6520/  10000 (65.20%), best:    6550/10000 (65.50%), error:     10051.50781, best error:      9997.10742 on epoch:    80, epoch:   81/100, mu: 0.9882066846, learning_rate: 0.0000229665, weight_decay: 0.0000189290

epoch time: 886.8658447266s, input_fired_time: 14.7310810089, output_fired_time: 5.2916545868, propagate_forward_time: 323.5784301758, propagate_backward_time: 532.8635864258, weight_update_time: 0.3150234520, other_time: 10.4011230469
epoch time: 118.9306793213s, input_fired_time: 1.3427357674, output_fired_time: 0.0000000000, propagate_forward_time: 115.3887634277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1991806030
validation[          , genome  5439] predictions:    6520/  10000 (65.20%), best:    6550/10000 (65.50%), error:     10118.35352, best error:      9997.10742 on epoch:    80, epoch:   82/100, mu: 0.9883274436, learning_rate: 0.0000215539, weight_decay: 0.0000181163

epoch time: 986.7828369141s, input_fired_time: 15.1145715714, output_fired_time: 5.7357101440, propagate_forward_time: 365.0848388672, propagate_backward_time: 590.0355224609, weight_update_time: 0.3388390243, other_time: 10.8121948242
epoch time: 104.1939849854s, input_fired_time: 1.2238405943, output_fired_time: 0.0000000000, propagate_forward_time: 100.9133758545, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0567703247
validation[          , genome  5439] predictions:    6537/  10000 (65.37%), best:    6550/10000 (65.50%), error:     10008.90723, best error:      9997.10742 on epoch:    80, epoch:   83/100, mu: 0.9884400964, learning_rate: 0.0000202282, weight_decay: 0.0000173384

epoch time: 1054.8552246094s, input_fired_time: 15.4003248215, output_fired_time: 6.0696434975, propagate_forward_time: 392.9637756348, propagate_backward_time: 629.1768798828, weight_update_time: 0.3597613275, other_time: 11.2446289063
epoch time: 79.5605392456s, input_fired_time: 1.0300078392, output_fired_time: 0.0000000000, propagate_forward_time: 76.7233200073, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8072128296
validation[          , genome  5439] predictions:    6565/  10000 (65.65%), best:    6565/10000 (65.65%), error:      9982.16992, best error:      9982.16992 on epoch:    84, epoch:   84/100, mu: 0.9885451198, learning_rate: 0.0000189840, weight_decay: 0.0000165939

epoch time: 996.8616943359s, input_fired_time: 15.1464366913, output_fired_time: 5.7688574791, propagate_forward_time: 368.3121032715, propagate_backward_time: 596.7663574219, weight_update_time: 0.3469336927, other_time: 10.8679199219
epoch time: 81.9984359741s, input_fired_time: 1.0448535681, output_fired_time: 0.0000000000, propagate_forward_time: 79.1172866821, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8362960815
validation[          , genome  5439] predictions:    6539/  10000 (65.39%), best:    6539/10000 (65.39%), error:      9978.71582, best error:      9978.71582 on epoch:    85, epoch:   85/100, mu: 0.9886431098, learning_rate: 0.0000178163, weight_decay: 0.0000158814

epoch time: 968.2504272461s, input_fired_time: 15.0209054947, output_fired_time: 5.6243634224, propagate_forward_time: 357.2876892090, propagate_backward_time: 579.6113281250, weight_update_time: 0.3420232236, other_time: 10.7060546875
epoch time: 67.5626373291s, input_fired_time: 0.9327192903, output_fired_time: 0.0000000000, propagate_forward_time: 64.9339447021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6959762573
validation[          , genome  5439] predictions:    6572/  10000 (65.72%), best:    6572/10000 (65.72%), error:      9905.94434, best error:      9905.94434 on epoch:    86, epoch:   86/100, mu: 0.9887344837, learning_rate: 0.0000167205, weight_decay: 0.0000151995

epoch time: 918.8686523438s, input_fired_time: 14.8429040909, output_fired_time: 5.4044561386, propagate_forward_time: 336.6092224121, propagate_backward_time: 551.4868774414, weight_update_time: 0.3346017003, other_time: 10.5252075195
epoch time: 118.5500259399s, input_fired_time: 1.3696415424, output_fired_time: 0.0000000000, propagate_forward_time: 114.8950271606, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2853546143
validation[          , genome  5439] predictions:    6571/  10000 (65.71%), best:    6572/10000 (65.72%), error:      9970.22070, best error:      9905.94434 on epoch:    86, epoch:   87/100, mu: 0.9888197184, learning_rate: 0.0000156920, weight_decay: 0.0000145468

epoch time: 1129.1662597656s, input_fired_time: 15.7412490845, output_fired_time: 6.4762210846, propagate_forward_time: 422.3016052246, propagate_backward_time: 672.9688720703, weight_update_time: 0.3878090382, other_time: 11.6783447266
epoch time: 117.0901947021s, input_fired_time: 1.3280601501, output_fired_time: 0.0000000000, propagate_forward_time: 113.5985031128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1636276245
validation[          , genome  5439] predictions:    6578/  10000 (65.78%), best:    6572/10000 (65.72%), error:      9936.98047, best error:      9905.94434 on epoch:    86, epoch:   88/100, mu: 0.9888992310, learning_rate: 0.0000147268, weight_decay: 0.0000139222

epoch time: 1221.5091552734s, input_fired_time: 16.0042705536, output_fired_time: 6.7757635117, propagate_forward_time: 461.8734130859, propagate_backward_time: 724.9959106445, weight_update_time: 0.4095776975, other_time: 11.8598022461
epoch time: 83.9096527100s, input_fired_time: 1.0624054670, output_fired_time: 0.0000000000, propagate_forward_time: 81.0020141602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8452301025
validation[          , genome  5439] predictions:    6533/  10000 (65.33%), best:    6572/10000 (65.72%), error:     10023.35645, best error:      9905.94434 on epoch:    86, epoch:   89/100, mu: 0.9889733791, learning_rate: 0.0000138210, weight_decay: 0.0000133244

epoch time: 1223.9503173828s, input_fired_time: 16.0358848572, output_fired_time: 6.8116779327, propagate_forward_time: 463.6796569824, propagate_backward_time: 725.5717773438, weight_update_time: 0.4126503170, other_time: 11.8513183594
epoch time: 96.3636322021s, input_fired_time: 1.1751295328, output_fired_time: 0.0000000000, propagate_forward_time: 93.1771850586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0113143921
validation[          , genome  5439] predictions:    6539/  10000 (65.39%), best:    6572/10000 (65.72%), error:      9949.43848, best error:      9905.94434 on epoch:    86, epoch:   90/100, mu: 0.9890425205, learning_rate: 0.0000129709, weight_decay: 0.0000127523

epoch time: 1140.8524169922s, input_fired_time: 15.7094945908, output_fired_time: 6.4384708405, propagate_forward_time: 427.3191833496, propagate_backward_time: 679.8838500977, weight_update_time: 0.3991151750, other_time: 11.5014038086
epoch time: 79.2955703735s, input_fired_time: 1.0245010853, output_fired_time: 0.0000000000, propagate_forward_time: 76.4673843384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8036880493
validation[          , genome  5439] predictions:    6609/  10000 (66.09%), best:    6609/10000 (66.09%), error:      9889.99219, best error:      9889.99219 on epoch:    91, epoch:   91/100, mu: 0.9891070127, learning_rate: 0.0000121731, weight_decay: 0.0000122047

epoch time: 1065.9576416016s, input_fired_time: 15.4228143692, output_fired_time: 6.1026563644, propagate_forward_time: 396.8495483398, propagate_backward_time: 636.4285888672, weight_update_time: 0.3812217414, other_time: 11.1539916992
epoch time: 76.2615051270s, input_fired_time: 0.9966140985, output_fired_time: 0.0000000000, propagate_forward_time: 73.4896316528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7752609253
validation[          , genome  5439] predictions:    6595/  10000 (65.95%), best:    6609/10000 (66.09%), error:      9892.24609, best error:      9889.99219 on epoch:    91, epoch:   92/100, mu: 0.9891671538, learning_rate: 0.0000114244, weight_decay: 0.0000116807

epoch time: 1035.8258056641s, input_fired_time: 15.3385114670, output_fired_time: 5.9696912766, propagate_forward_time: 384.4204101563, propagate_backward_time: 618.9982299805, weight_update_time: 0.3778715134, other_time: 11.0989990234
epoch time: 96.6857681274s, input_fired_time: 1.1740649939, output_fired_time: 0.0000000000, propagate_forward_time: 93.5354385376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9762649536
validation[          , genome  5439] predictions:    6606/  10000 (66.06%), best:    6609/10000 (66.09%), error:      9911.19727, best error:      9889.99219 on epoch:    91, epoch:   93/100, mu: 0.9892232418, learning_rate: 0.0000107217, weight_decay: 0.0000111791

epoch time: 1034.8269042969s, input_fired_time: 15.3006238937, output_fired_time: 5.9155197144, propagate_forward_time: 384.7019653320, propagate_backward_time: 617.8863525391, weight_update_time: 0.3808138967, other_time: 11.0224609375
epoch time: 75.0709991455s, input_fired_time: 0.9967508912, output_fired_time: 0.0000000000, propagate_forward_time: 72.3099517822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7642974854
validation[          , genome  5439] predictions:    6606/  10000 (66.06%), best:    6609/10000 (66.09%), error:      9894.93848, best error:      9889.99219 on epoch:    91, epoch:   94/100, mu: 0.9892755747, learning_rate: 0.0000100622, weight_decay: 0.0000106991

epoch time: 1061.9069824219s, input_fired_time: 15.4252901077, output_fired_time: 6.0504436493, propagate_forward_time: 396.1321716309, propagate_backward_time: 633.0855712891, weight_update_time: 0.3910073340, other_time: 11.2135009766
epoch time: 78.6120529175s, input_fired_time: 1.0209404230, output_fired_time: 0.0000000000, propagate_forward_time: 75.7920074463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7991027832
validation[          , genome  5439] predictions:    6584/  10000 (65.84%), best:    6609/10000 (66.09%), error:      9926.46680, best error:      9889.99219 on epoch:    91, epoch:   95/100, mu: 0.9893243909, learning_rate: 0.0000094433, weight_decay: 0.0000102397

epoch time: 1191.3996582031s, input_fired_time: 15.8793907166, output_fired_time: 6.6260371208, propagate_forward_time: 447.7065429688, propagate_backward_time: 709.5020751953, weight_update_time: 0.4233626425, other_time: 11.6856689453
epoch time: 104.2302246094s, input_fired_time: 1.2393054962, output_fired_time: 0.0000000000, propagate_forward_time: 100.8927612305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0981597900
validation[          , genome  5439] predictions:    6576/  10000 (65.76%), best:    6609/10000 (66.09%), error:      9936.72656, best error:      9889.99219 on epoch:    91, epoch:   96/100, mu: 0.9893698692, learning_rate: 0.0000088625, weight_decay: 0.0000098001

epoch time: 1271.6254882813s, input_fired_time: 16.1935005188, output_fired_time: 7.0036420822, propagate_forward_time: 480.4545898438, propagate_backward_time: 755.8807983398, weight_update_time: 0.4477812350, other_time: 12.0929565430
epoch time: 85.5247039795s, input_fired_time: 1.0862604380, output_fired_time: 0.0000000000, propagate_forward_time: 82.5704956055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8679504395
validation[          , genome  5439] predictions:    6597/  10000 (65.97%), best:    6609/10000 (66.09%), error:      9895.63672, best error:      9889.99219 on epoch:    91, epoch:   97/100, mu: 0.9894123077, learning_rate: 0.0000083173, weight_decay: 0.0000093793

epoch time: 1251.1906738281s, input_fired_time: 16.1547050476, output_fired_time: 6.9240517616, propagate_forward_time: 474.2771911621, propagate_backward_time: 741.8364257813, weight_update_time: 0.4478948414, other_time: 11.9982910156
epoch time: 103.4955749512s, input_fired_time: 1.2324562073, output_fired_time: 0.0000000000, propagate_forward_time: 100.1907653809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0723571777
validation[          , genome  5439] predictions:    6610/  10000 (66.10%), best:    6609/10000 (66.09%), error:      9914.28711, best error:      9889.99219 on epoch:    91, epoch:   98/100, mu: 0.9894518852, learning_rate: 0.0000078058, weight_decay: 0.0000089765

epoch time: 1231.2100830078s, input_fired_time: 16.1152343750, output_fired_time: 6.8301849365, propagate_forward_time: 463.5460815430, propagate_backward_time: 732.6987304688, weight_update_time: 0.4486709833, other_time: 12.0198364258
epoch time: 91.9653854370s, input_fired_time: 1.1515040398, output_fired_time: 0.0000000000, propagate_forward_time: 88.8233032227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9905776978
validation[          , genome  5439] predictions:    6613/  10000 (66.13%), best:    6613/10000 (66.13%), error:      9889.91016, best error:      9889.91016 on epoch:    99, epoch:   99/100, mu: 0.9894887805, learning_rate: 0.0000073256, weight_decay: 0.0000085911

epoch time: 1275.6605224609s, input_fired_time: 16.2572231293, output_fired_time: 7.0127754211, propagate_forward_time: 482.0469970703, propagate_backward_time: 758.1310424805, weight_update_time: 0.4649997652, other_time: 12.2124633789
epoch time: 100.0777206421s, input_fired_time: 1.2000254393, output_fired_time: 0.0000000000, propagate_forward_time: 96.8849563599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9927368164
validation[          , genome  5439] predictions:    6611/  10000 (66.11%), best:    6611/10000 (66.11%), error:      9875.59961, best error:      9875.59961 on epoch:   100, epoch:  100/100, mu: 0.9895232320, learning_rate: 0.0000068751, weight_decay: 0.0000082222

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 527.2213745117s, input_fired_time: 6.2330851555, output_fired_time: 0.0000000000, propagate_forward_time: 510.5706481934, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.4176330566
best training[          , genome  5439] predictions:   36746/  50000 (73.49%), best:    6611/10000 (66.11%), error:     40782.26172, best error:      9875.59961 on epoch:   100, epoch:  101/100, mu: 0.9895553589, learning_rate: 0.0000064522, weight_decay: 0.0000078692
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 95.3525772095s, input_fired_time: 1.1696012020, output_fired_time: 0.0000000000, propagate_forward_time: 92.1915664673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9914093018
   testing[          , genome  5439] predictions:    6611/  10000 (66.11%), best:    6611/10000 (66.11%), error:      9875.59961, best error:      9875.59961 on epoch:   100, epoch:  101/100, mu: 0.9895553589, learning_rate: 0.0000064522, weight_decay: 0.0000078692
backpropagation finished successfully!
11:37:30 (46124): called boinc_finish(0)

</stderr_txt>
]]>