Nameexact_genome_1512735002_44_25028_1
Workunit2696476
Created20 Dec 2017, 4:56:36 UTC
Sent20 Dec 2017, 5:22:24 UTC
Report deadline18 Feb 2018, 20:00:32 UTC
Received21 Dec 2017, 13:54:42 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time1 days 2 hours 47 min 8 sec
CPU time1 days 2 hours 2 min 27 sec
Validate stateInitial
Credit0.00
Device peak FLOPS3.75 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size184.35 MB
Peak swap size187.31 MB
Peak disk usage7.21 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
11.6654052734
epoch time: 73.4398651123s, input_fired_time: 1.5452055931, output_fired_time: 0.0000000000, propagate_forward_time: 69.6775894165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2170715332
validation[          , genome 25028] predictions:    9820/  10000 (98.20%), best:    9846/10000 (98.46%), error:       544.08179, best error:       460.13495 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 909.0301513672s, input_fired_time: 12.8127470016, output_fired_time: 11.9677162170, propagate_forward_time: 339.0865478516, propagate_backward_time: 533.1795654297, weight_update_time: 0.7951713204, other_time: 11.9835815430
epoch time: 69.1940612793s, input_fired_time: 1.5347558260, output_fired_time: 0.0000000000, propagate_forward_time: 65.5428009033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1165008545
validation[          , genome 25028] predictions:    9853/  10000 (98.53%), best:    9846/10000 (98.46%), error:       474.88629, best error:       460.13495 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 896.8114013672s, input_fired_time: 12.6475496292, output_fired_time: 11.9485416412, propagate_forward_time: 334.3983154297, propagate_backward_time: 526.1374511719, weight_update_time: 0.7456411719, other_time: 11.6795654297
epoch time: 69.2996063232s, input_fired_time: 1.5365658998, output_fired_time: 0.0000000000, propagate_forward_time: 65.6569976807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1060409546
validation[          , genome 25028] predictions:    9802/  10000 (98.02%), best:    9846/10000 (98.46%), error:       565.63403, best error:       460.13495 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 897.5793457031s, input_fired_time: 12.5040721893, output_fired_time: 12.0371007919, propagate_forward_time: 334.2872009277, propagate_backward_time: 526.9608764648, weight_update_time: 0.7758187056, other_time: 11.7901000977
epoch time: 72.1750106812s, input_fired_time: 1.6681060791, output_fired_time: 0.0000000000, propagate_forward_time: 68.3308563232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1760482788
validation[          , genome 25028] predictions:    9849/  10000 (98.49%), best:    9849/10000 (98.49%), error:       455.08563, best error:       455.08563 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 893.7196044922s, input_fired_time: 12.4905691147, output_fired_time: 11.8949232101, propagate_forward_time: 333.4224548340, propagate_backward_time: 524.0720214844, weight_update_time: 0.7446555495, other_time: 11.8397216797
epoch time: 68.8736267090s, input_fired_time: 1.5364476442, output_fired_time: 0.0000000000, propagate_forward_time: 65.2182922363, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1188888550
validation[          , genome 25028] predictions:    9826/  10000 (98.26%), best:    9849/10000 (98.49%), error:       528.58636, best error:       455.08563 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 884.2754516602s, input_fired_time: 12.4290466309, output_fired_time: 11.7368736267, propagate_forward_time: 329.6333923340, propagate_backward_time: 518.8868408203, weight_update_time: 0.7477213144, other_time: 11.5893554688
epoch time: 70.0100936890s, input_fired_time: 1.5785912275, output_fired_time: 0.0000000000, propagate_forward_time: 66.2765274048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1549758911
validation[          , genome 25028] predictions:    9857/  10000 (98.57%), best:    9857/10000 (98.57%), error:       420.38138, best error:       420.38138 on epoch:    20, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 895.3906250000s, input_fired_time: 12.4587306976, output_fired_time: 11.9502592087, propagate_forward_time: 333.9550781250, propagate_backward_time: 525.1753540039, weight_update_time: 0.7765508294, other_time: 11.8511962891
epoch time: 71.4946212769s, input_fired_time: 1.5816000700, output_fired_time: 0.0000000000, propagate_forward_time: 67.7457351685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1672897339
validation[          , genome 25028] predictions:    9875/  10000 (98.75%), best:    9857/10000 (98.57%), error:       442.58810, best error:       420.38138 on epoch:    20, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 898.5921020508s, input_fired_time: 12.6758556366, output_fired_time: 12.2599744797, propagate_forward_time: 335.0710449219, propagate_backward_time: 526.6736450195, weight_update_time: 0.8104933500, other_time: 11.9116210938
epoch time: 72.4963989258s, input_fired_time: 1.5565884113, output_fired_time: 0.0000000000, propagate_forward_time: 68.7049560547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2348556519
validation[          , genome 25028] predictions:    9830/  10000 (98.30%), best:    9857/10000 (98.57%), error:       522.13165, best error:       420.38138 on epoch:    20, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 891.0635986328s, input_fired_time: 12.5576648712, output_fired_time: 11.8672504425, propagate_forward_time: 332.3722534180, propagate_backward_time: 522.6262207031, weight_update_time: 0.7491195798, other_time: 11.6401977539
epoch time: 69.6846160889s, input_fired_time: 1.5403639078, output_fired_time: 0.0000000000, propagate_forward_time: 65.9709625244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1732864380
validation[          , genome 25028] predictions:    9860/  10000 (98.60%), best:    9857/10000 (98.57%), error:       450.98969, best error:       420.38138 on epoch:    20, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 894.4575805664s, input_fired_time: 12.4983816147, output_fired_time: 11.8580150604, propagate_forward_time: 333.7098388672, propagate_backward_time: 524.6247558594, weight_update_time: 0.7474721074, other_time: 11.7666015625
epoch time: 69.0862274170s, input_fired_time: 1.5351308584, output_fired_time: 0.0000000000, propagate_forward_time: 65.4390716553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1120223999
validation[          , genome 25028] predictions:    9847/  10000 (98.47%), best:    9857/10000 (98.57%), error:       486.96011, best error:       420.38138 on epoch:    20, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 912.3093872070s, input_fired_time: 13.1168098450, output_fired_time: 12.1699638367, propagate_forward_time: 339.4811401367, propagate_backward_time: 535.6437988281, weight_update_time: 0.7454722524, other_time: 11.8976440430
epoch time: 77.4191360474s, input_fired_time: 1.7417051792, output_fired_time: 0.0000000000, propagate_forward_time: 73.3534088135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3240203857
validation[          , genome 25028] predictions:    9846/  10000 (98.46%), best:    9857/10000 (98.57%), error:       456.19031, best error:       420.38138 on epoch:    20, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 926.2983398438s, input_fired_time: 12.8815250397, output_fired_time: 12.4318943024, propagate_forward_time: 346.1346130371, propagate_backward_time: 542.6763305664, weight_update_time: 0.7769953609, other_time: 12.1740112305
epoch time: 77.7924499512s, input_fired_time: 1.7404752970, output_fired_time: 0.0000000000, propagate_forward_time: 73.7110824585, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3408889771
validation[          , genome 25028] predictions:    9873/  10000 (98.73%), best:    9873/10000 (98.73%), error:       415.05679, best error:       415.05679 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 925.9548950195s, input_fired_time: 12.6963634491, output_fired_time: 12.3801927567, propagate_forward_time: 345.8122253418, propagate_backward_time: 542.9704589844, weight_update_time: 0.7786427140, other_time: 12.0957031250
epoch time: 73.6354904175s, input_fired_time: 1.6142810583, output_fired_time: 0.0000000000, propagate_forward_time: 69.8081054688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2131042480
validation[          , genome 25028] predictions:    9840/  10000 (98.40%), best:    9873/10000 (98.73%), error:       511.23047, best error:       415.05679 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 936.1943359375s, input_fired_time: 13.2814226151, output_fired_time: 12.3039712906, propagate_forward_time: 349.1181030273, propagate_backward_time: 549.1871337891, weight_update_time: 0.8388981819, other_time: 12.3037109375
epoch time: 82.7905960083s, input_fired_time: 1.9642937183, output_fired_time: 0.0000000000, propagate_forward_time: 78.0338287354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7924728394
validation[          , genome 25028] predictions:    9866/  10000 (98.66%), best:    9873/10000 (98.73%), error:       432.90356, best error:       415.05679 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 903.4805908203s, input_fired_time: 12.6140432358, output_fired_time: 12.0068378448, propagate_forward_time: 337.1688537598, propagate_backward_time: 529.8493652344, weight_update_time: 0.7749014497, other_time: 11.8415527344
epoch time: 87.8717422485s, input_fired_time: 1.9946196079, output_fired_time: 0.0000000000, propagate_forward_time: 83.2765655518, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6005554199
validation[          , genome 25028] predictions:    9831/  10000 (98.31%), best:    9873/10000 (98.73%), error:       511.12924, best error:       415.05679 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 923.4768676758s, input_fired_time: 13.0757303238, output_fired_time: 12.5084629059, propagate_forward_time: 344.2732543945, propagate_backward_time: 541.4918823242, weight_update_time: 0.7589440942, other_time: 12.1275024414
epoch time: 74.3707046509s, input_fired_time: 1.6597635746, output_fired_time: 0.0000000000, propagate_forward_time: 70.2997360229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4112014771
validation[          , genome 25028] predictions:    9860/  10000 (98.60%), best:    9873/10000 (98.73%), error:       464.57047, best error:       415.05679 on epoch:    26, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1004.7739257813s, input_fired_time: 14.3454236984, output_fired_time: 13.2868680954, propagate_forward_time: 375.2151489258, propagate_backward_time: 588.6575927734, weight_update_time: 0.8545762300, other_time: 13.2689208984
epoch time: 79.9193496704s, input_fired_time: 1.7713158131, output_fired_time: 0.0000000000, propagate_forward_time: 75.6044998169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5435333252
validation[          , genome 25028] predictions:    9859/  10000 (98.59%), best:    9873/10000 (98.73%), error:       462.19327, best error:       415.05679 on epoch:    26, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 930.1021728516s, input_fired_time: 13.1568222046, output_fired_time: 12.4811706543, propagate_forward_time: 347.5981445313, propagate_backward_time: 544.6682128906, weight_update_time: 0.7758305669, other_time: 12.1978759766
epoch time: 81.6646652222s, input_fired_time: 1.8410236835, output_fired_time: 0.0000000000, propagate_forward_time: 77.3395385742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4841003418
validation[          , genome 25028] predictions:    9857/  10000 (98.57%), best:    9873/10000 (98.73%), error:       459.39587, best error:       415.05679 on epoch:    26, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 945.9807128906s, input_fired_time: 13.4148817062, output_fired_time: 12.8172569275, propagate_forward_time: 352.8067626953, propagate_backward_time: 554.6134033203, weight_update_time: 0.7455741167, other_time: 12.3284301758
epoch time: 70.3472366333s, input_fired_time: 1.5789477825, output_fired_time: 0.0000000000, propagate_forward_time: 66.6118850708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1564025879
validation[          , genome 25028] predictions:    9864/  10000 (98.64%), best:    9864/10000 (98.64%), error:       406.50369, best error:       406.50369 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 988.9041748047s, input_fired_time: 13.6525325775, output_fired_time: 13.3456144333, propagate_forward_time: 369.3770141602, propagate_backward_time: 579.7055053711, weight_update_time: 0.7932062745, other_time: 12.8234863281
epoch time: 77.2200622559s, input_fired_time: 1.6505875587, output_fired_time: 0.0000000000, propagate_forward_time: 73.1491699219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4203033447
validation[          , genome 25028] predictions:    9861/  10000 (98.61%), best:    9861/10000 (98.61%), error:       400.75735, best error:       400.75735 on epoch:    34, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 949.8244628906s, input_fired_time: 13.1556949615, output_fired_time: 12.6489906311, propagate_forward_time: 354.6918945313, propagate_backward_time: 556.6499633789, weight_update_time: 0.9010042548, other_time: 12.6779174805
epoch time: 75.5195007324s, input_fired_time: 1.7735028267, output_fired_time: 0.0000000000, propagate_forward_time: 71.4312515259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3147430420
validation[          , genome 25028] predictions:    9853/  10000 (98.53%), best:    9861/10000 (98.61%), error:       419.99454, best error:       400.75735 on epoch:    34, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 966.6535034180s, input_fired_time: 13.1543607712, output_fired_time: 12.5968589783, propagate_forward_time: 360.9974060059, propagate_backward_time: 567.2025146484, weight_update_time: 0.8684751987, other_time: 12.7023925781
epoch time: 82.7066268921s, input_fired_time: 2.0187344551, output_fired_time: 0.0000000000, propagate_forward_time: 78.1578598022, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5300292969
validation[          , genome 25028] predictions:    9888/  10000 (98.88%), best:    9888/10000 (98.88%), error:       373.70871, best error:       373.70871 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 913.6121215820s, input_fired_time: 12.6135931015, output_fired_time: 12.2463092804, propagate_forward_time: 340.3747253418, propagate_backward_time: 536.5426025391, weight_update_time: 0.7636086941, other_time: 11.8348388672
epoch time: 76.6668930054s, input_fired_time: 1.6735823154, output_fired_time: 0.0000000000, propagate_forward_time: 72.5849838257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4083251953
validation[          , genome 25028] predictions:    9870/  10000 (98.70%), best:    9888/10000 (98.88%), error:       385.37909, best error:       373.70871 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 990.5390625000s, input_fired_time: 13.9169969559, output_fired_time: 13.1401033401, propagate_forward_time: 370.2656555176, propagate_backward_time: 579.9283447266, weight_update_time: 0.8235738277, other_time: 13.2879638672
epoch time: 84.6087265015s, input_fired_time: 1.8417360783, output_fired_time: 0.0000000000, propagate_forward_time: 80.2785491943, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4884414673
validation[          , genome 25028] predictions:    9875/  10000 (98.75%), best:    9888/10000 (98.88%), error:       389.40302, best error:       373.70871 on epoch:    36, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 938.2378540039s, input_fired_time: 13.3471088409, output_fired_time: 12.4198350906, propagate_forward_time: 349.9518432617, propagate_backward_time: 550.3189697266, weight_update_time: 0.7768175006, other_time: 12.2000732422
epoch time: 93.5569229126s, input_fired_time: 2.2794661522, output_fired_time: 0.0000000000, propagate_forward_time: 88.3057327271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9717254639
validation[          , genome 25028] predictions:    9883/  10000 (98.83%), best:    9883/10000 (98.83%), error:       336.57977, best error:       336.57977 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 909.0319824219s, input_fired_time: 12.8943347931, output_fired_time: 12.1390905380, propagate_forward_time: 338.9596862793, propagate_backward_time: 533.1383056641, weight_update_time: 0.7446306944, other_time: 11.9005126953
epoch time: 69.8683090210s, input_fired_time: 1.5896446705, output_fired_time: 0.0000000000, propagate_forward_time: 66.1380767822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1405868530
validation[          , genome 25028] predictions:    9871/  10000 (98.71%), best:    9883/10000 (98.83%), error:       403.00644, best error:       336.57977 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 962.0014648438s, input_fired_time: 13.5360860825, output_fired_time: 12.9636316299, propagate_forward_time: 358.9453430176, propagate_backward_time: 563.8688964844, weight_update_time: 0.8845163584, other_time: 12.6875000000
epoch time: 70.8735809326s, input_fired_time: 1.5752153397, output_fired_time: 0.0000000000, propagate_forward_time: 67.0893325806, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2090301514
validation[          , genome 25028] predictions:    9881/  10000 (98.81%), best:    9883/10000 (98.83%), error:       363.13501, best error:       336.57977 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 915.0762939453s, input_fired_time: 12.9002227783, output_fired_time: 12.0911512375, propagate_forward_time: 341.4243774414, propagate_backward_time: 536.6707153320, weight_update_time: 0.7752710581, other_time: 11.9898681641
epoch time: 71.3199691772s, input_fired_time: 1.5459485054, output_fired_time: 0.0000000000, propagate_forward_time: 67.6335067749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1405105591
validation[          , genome 25028] predictions:    9892/  10000 (98.92%), best:    9883/10000 (98.83%), error:       337.55551, best error:       336.57977 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 892.8363037109s, input_fired_time: 12.4775781631, output_fired_time: 12.0154752731, propagate_forward_time: 332.7754211426, propagate_backward_time: 523.7321166992, weight_update_time: 0.7777903080, other_time: 11.8356323242
epoch time: 69.9322052002s, input_fired_time: 1.5483293533, output_fired_time: 0.0000000000, propagate_forward_time: 66.2282943726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1555786133
validation[          , genome 25028] predictions:    9893/  10000 (98.93%), best:    9883/10000 (98.83%), error:       338.00940, best error:       336.57977 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 900.1314697266s, input_fired_time: 12.8083868027, output_fired_time: 12.0113191605, propagate_forward_time: 336.0946655273, propagate_backward_time: 527.4645996094, weight_update_time: 0.7762381434, other_time: 11.7525024414
epoch time: 69.5419921875s, input_fired_time: 1.5980054140, output_fired_time: 0.0000000000, propagate_forward_time: 65.8437576294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1002273560
validation[          , genome 25028] predictions:    9886/  10000 (98.86%), best:    9883/10000 (98.83%), error:       354.22244, best error:       336.57977 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 892.3475952148s, input_fired_time: 12.6800127029, output_fired_time: 11.8225240707, propagate_forward_time: 332.5551147461, propagate_backward_time: 523.6360473633, weight_update_time: 0.7446897626, other_time: 11.6539306641
epoch time: 71.7214355469s, input_fired_time: 1.6099678278, output_fired_time: 0.0000000000, propagate_forward_time: 67.9430007935, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1684646606
validation[          , genome 25028] predictions:    9866/  10000 (98.66%), best:    9883/10000 (98.83%), error:       393.08194, best error:       336.57977 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 895.2152099609s, input_fired_time: 12.6341009140, output_fired_time: 11.8980865479, propagate_forward_time: 333.7284240723, propagate_backward_time: 525.2016601563, weight_update_time: 0.7757294178, other_time: 11.7529296875
epoch time: 69.9282989502s, input_fired_time: 1.5688880682, output_fired_time: 0.0000000000, propagate_forward_time: 66.2464752197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1129379272
validation[          , genome 25028] predictions:    9890/  10000 (98.90%), best:    9890/10000 (98.90%), error:       336.38626, best error:       336.38626 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 902.3541259766s, input_fired_time: 12.8004951477, output_fired_time: 11.9373073578, propagate_forward_time: 336.1861267090, propagate_backward_time: 529.6135864258, weight_update_time: 0.7774846554, other_time: 11.8165893555
epoch time: 74.9084396362s, input_fired_time: 1.7441319227, output_fired_time: 0.0000000000, propagate_forward_time: 70.8424835205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3218231201
validation[          , genome 25028] predictions:    9887/  10000 (98.87%), best:    9890/10000 (98.90%), error:       360.07336, best error:       336.38626 on epoch:    46, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 899.5079956055s, input_fired_time: 12.6431674957, output_fired_time: 11.9346303940, propagate_forward_time: 335.8402709961, propagate_backward_time: 527.3714599609, weight_update_time: 0.7447892427, other_time: 11.7184448242
epoch time: 70.0634994507s, input_fired_time: 1.5879790783, output_fired_time: 0.0000000000, propagate_forward_time: 66.3324203491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1430969238
validation[          , genome 25028] predictions:    9883/  10000 (98.83%), best:    9890/10000 (98.90%), error:       367.96957, best error:       336.38626 on epoch:    46, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 890.5419921875s, input_fired_time: 12.5421314240, output_fired_time: 11.7646198273, propagate_forward_time: 332.1930236816, propagate_backward_time: 522.4348754883, weight_update_time: 0.7607556581, other_time: 11.6073608398
epoch time: 69.4680633545s, input_fired_time: 1.5525679588, output_fired_time: 0.0000000000, propagate_forward_time: 65.8085403442, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1069564819
validation[          , genome 25028] predictions:    9890/  10000 (98.90%), best:    9890/10000 (98.90%), error:       339.40921, best error:       336.38626 on epoch:    46, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 892.3035888672s, input_fired_time: 12.5191316605, output_fired_time: 11.9575328827, propagate_forward_time: 332.8926696777, propagate_backward_time: 523.2723388672, weight_update_time: 0.7448174953, other_time: 11.6619873047
epoch time: 73.0366287231s, input_fired_time: 1.5854128599, output_fired_time: 0.0000000000, propagate_forward_time: 69.2048492432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2463684082
validation[          , genome 25028] predictions:    9891/  10000 (98.91%), best:    9891/10000 (98.91%), error:       329.30243, best error:       329.30243 on epoch:    50, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 888.8786010742s, input_fired_time: 12.5040178299, output_fired_time: 11.9175109863, propagate_forward_time: 331.2031250000, propagate_backward_time: 521.6236572266, weight_update_time: 0.7458069324, other_time: 11.6302490234
epoch time: 72.2904434204s, input_fired_time: 1.6535707712, output_fired_time: 0.0000000000, propagate_forward_time: 68.4861602783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1507110596
validation[          , genome 25028] predictions:    9888/  10000 (98.88%), best:    9891/10000 (98.91%), error:       359.05481, best error:       329.30243 on epoch:    50, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 903.9694824219s, input_fired_time: 12.7826976776, output_fired_time: 11.8643655777, propagate_forward_time: 336.9017639160, propagate_backward_time: 530.5547485352, weight_update_time: 0.7768350840, other_time: 11.8659057617
epoch time: 68.9391860962s, input_fired_time: 1.5530548096, output_fired_time: 0.0000000000, propagate_forward_time: 65.2559356689, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1301956177
validation[          , genome 25028] predictions:    9891/  10000 (98.91%), best:    9891/10000 (98.91%), error:       320.38266, best error:       320.38266 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 861.1299438477s, input_fired_time: 12.2310523987, output_fired_time: 11.4704780579, propagate_forward_time: 320.5286865234, propagate_backward_time: 505.5108032227, weight_update_time: 0.7356003523, other_time: 11.3889160156
epoch time: 67.6922454834s, input_fired_time: 1.5307537317, output_fired_time: 0.0000000000, propagate_forward_time: 64.0558319092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1056594849
validation[          , genome 25028] predictions:    9871/  10000 (98.71%), best:    9891/10000 (98.91%), error:       405.20593, best error:       320.38266 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 859.1966552734s, input_fired_time: 12.2205228806, output_fired_time: 11.4697723389, propagate_forward_time: 319.5647583008, propagate_backward_time: 504.5580444336, weight_update_time: 0.7347855568, other_time: 11.3835449219
epoch time: 67.5754013062s, input_fired_time: 1.5276570320, output_fired_time: 0.0000000000, propagate_forward_time: 63.9623794556, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0853652954
validation[          , genome 25028] predictions:    9880/  10000 (98.80%), best:    9891/10000 (98.91%), error:       356.45151, best error:       320.38266 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 860.0557861328s, input_fired_time: 12.2081947327, output_fired_time: 11.4505453110, propagate_forward_time: 319.8304443359, propagate_backward_time: 505.1843261719, weight_update_time: 0.7355051041, other_time: 11.3822631836
epoch time: 67.1920242310s, input_fired_time: 1.5238423347, output_fired_time: 0.0000000000, propagate_forward_time: 63.5755157471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0926666260
validation[          , genome 25028] predictions:    9857/  10000 (98.57%), best:    9891/10000 (98.91%), error:       440.20160, best error:       320.38266 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 857.6246948242s, input_fired_time: 12.2044830322, output_fired_time: 11.4282464981, propagate_forward_time: 319.2396850586, propagate_backward_time: 503.3691406250, weight_update_time: 0.7352756262, other_time: 11.3831787109
epoch time: 65.8791732788s, input_fired_time: 1.4981982708, output_fired_time: 0.0000000000, propagate_forward_time: 62.3397865295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0411872864
validation[          , genome 25028] predictions:    9879/  10000 (98.79%), best:    9891/10000 (98.91%), error:       360.40942, best error:       320.38266 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 841.2000732422s, input_fired_time: 12.0137434006, output_fired_time: 11.1954040527, propagate_forward_time: 311.6013793945, propagate_backward_time: 495.1089172363, weight_update_time: 0.7261155248, other_time: 11.2806701660
epoch time: 65.6551589966s, input_fired_time: 1.5017862320, output_fired_time: 0.0000000000, propagate_forward_time: 62.0991516113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0542221069
validation[          , genome 25028] predictions:    9892/  10000 (98.92%), best:    9891/10000 (98.91%), error:       332.77631, best error:       320.38266 on epoch:    52, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 837.2113647461s, input_fired_time: 11.9973802567, output_fired_time: 11.1781606674, propagate_forward_time: 310.0368957520, propagate_backward_time: 492.7801513672, weight_update_time: 0.7228485346, other_time: 11.2187805176
epoch time: 64.7001647949s, input_fired_time: 1.4795171022, output_fired_time: 0.0000000000, propagate_forward_time: 61.1813278198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0393180847
validation[          , genome 25028] predictions:    9885/  10000 (98.85%), best:    9891/10000 (98.91%), error:       361.07245, best error:       320.38266 on epoch:    52, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 860.5175170898s, input_fired_time: 12.2224655151, output_fired_time: 11.4350137711, propagate_forward_time: 320.1542053223, propagate_backward_time: 505.3493957520, weight_update_time: 0.7351077795, other_time: 11.3564147949
epoch time: 69.7242736816s, input_fired_time: 1.6045974493, output_fired_time: 0.0000000000, propagate_forward_time: 65.9565887451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1630859375
validation[          , genome 25028] predictions:    9893/  10000 (98.93%), best:    9891/10000 (98.91%), error:       323.51425, best error:       320.38266 on epoch:    52, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 890.8873901367s, input_fired_time: 12.6009454727, output_fired_time: 11.8159732819, propagate_forward_time: 332.1510925293, propagate_backward_time: 522.6199340820, weight_update_time: 0.7458946109, other_time: 11.6994018555
epoch time: 70.1039047241s, input_fired_time: 1.5533374548, output_fired_time: 0.0000000000, propagate_forward_time: 66.3377685547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2127990723
validation[          , genome 25028] predictions:    9892/  10000 (98.92%), best:    9891/10000 (98.91%), error:       328.83624, best error:       320.38266 on epoch:    52, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 900.8008422852s, input_fired_time: 12.7173728943, output_fired_time: 11.8249635696, propagate_forward_time: 335.6147460938, propagate_backward_time: 528.8359985352, weight_update_time: 0.7434301376, other_time: 11.8078002930
epoch time: 70.9098587036s, input_fired_time: 1.6083959341, output_fired_time: 0.0000000000, propagate_forward_time: 67.1510696411, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1503906250
validation[          , genome 25028] predictions:    9894/  10000 (98.94%), best:    9894/10000 (98.94%), error:       318.17090, best error:       318.17090 on epoch:    61, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 875.4434204102s, input_fired_time: 12.3815345764, output_fired_time: 11.6398220062, propagate_forward_time: 326.4685363770, propagate_backward_time: 513.5016479492, weight_update_time: 0.7445203662, other_time: 11.4518432617
epoch time: 68.8184509277s, input_fired_time: 1.5521566868, output_fired_time: 0.0000000000, propagate_forward_time: 65.1652679443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1010284424
validation[          , genome 25028] predictions:    9873/  10000 (98.73%), best:    9894/10000 (98.94%), error:       400.31479, best error:       318.17090 on epoch:    61, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 887.4630126953s, input_fired_time: 12.5088558197, output_fired_time: 11.8195028305, propagate_forward_time: 331.1233520508, propagate_backward_time: 520.3484497070, weight_update_time: 0.7448973060, other_time: 11.6628417969
epoch time: 69.7096099854s, input_fired_time: 1.6069376469, output_fired_time: 0.0000000000, propagate_forward_time: 65.9906997681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1119689941
validation[          , genome 25028] predictions:    9899/  10000 (98.99%), best:    9894/10000 (98.94%), error:       324.37860, best error:       318.17090 on epoch:    61, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 886.8905639648s, input_fired_time: 12.4928207397, output_fired_time: 11.7414140701, propagate_forward_time: 330.4652709961, propagate_backward_time: 520.5630493164, weight_update_time: 0.7459360361, other_time: 11.6280517578
epoch time: 73.1154479980s, input_fired_time: 1.6772600412, output_fired_time: 0.0000000000, propagate_forward_time: 69.2117233276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2264633179
validation[          , genome 25028] predictions:    9895/  10000 (98.95%), best:    9894/10000 (98.94%), error:       328.82721, best error:       318.17090 on epoch:    61, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 897.3853759766s, input_fired_time: 12.7070436478, output_fired_time: 11.7902669907, propagate_forward_time: 334.6701965332, propagate_backward_time: 526.5053710938, weight_update_time: 0.7446103096, other_time: 11.7125244141
epoch time: 75.6102142334s, input_fired_time: 1.6826539040, output_fired_time: 0.0000000000, propagate_forward_time: 71.6241149902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3034439087
validation[          , genome 25028] predictions:    9902/  10000 (99.02%), best:    9894/10000 (98.94%), error:       324.18301, best error:       318.17090 on epoch:    61, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 867.8187255859s, input_fired_time: 12.4053306580, output_fired_time: 11.5791501999, propagate_forward_time: 323.1618652344, propagate_backward_time: 509.2691040039, weight_update_time: 0.7667644620, other_time: 11.4032592773
epoch time: 66.5562057495s, input_fired_time: 1.5230871439, output_fired_time: 0.0000000000, propagate_forward_time: 62.9651870728, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0679321289
validation[          , genome 25028] predictions:    9882/  10000 (98.82%), best:    9894/10000 (98.94%), error:       348.11807, best error:       318.17090 on epoch:    61, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 858.0146484375s, input_fired_time: 12.2289800644, output_fired_time: 11.4399080276, propagate_forward_time: 319.0116577148, propagate_backward_time: 503.9812316895, weight_update_time: 0.7336146235, other_time: 11.3528747559
epoch time: 68.8720855713s, input_fired_time: 1.5573112965, output_fired_time: 0.0000000000, propagate_forward_time: 65.2094726563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1053009033
validation[          , genome 25028] predictions:    9893/  10000 (98.93%), best:    9894/10000 (98.94%), error:       339.42215, best error:       318.17090 on epoch:    61, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 866.3980102539s, input_fired_time: 12.3224115372, output_fired_time: 11.5100641251, propagate_forward_time: 322.8282775879, propagate_backward_time: 508.3050537109, weight_update_time: 0.7392646670, other_time: 11.4322509766
epoch time: 67.6223144531s, input_fired_time: 1.5356743336, output_fired_time: 0.0000000000, propagate_forward_time: 63.9983749390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0882644653
validation[          , genome 25028] predictions:    9902/  10000 (99.02%), best:    9902/10000 (99.02%), error:       311.64740, best error:       311.64740 on epoch:    68, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 868.7589111328s, input_fired_time: 12.3471107483, output_fired_time: 11.5376157761, propagate_forward_time: 323.9419555664, propagate_backward_time: 509.4773864746, weight_update_time: 0.7403358221, other_time: 11.4548645020
epoch time: 68.8179702759s, input_fired_time: 1.5581957102, output_fired_time: 0.0000000000, propagate_forward_time: 65.1569519043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1028213501
validation[          , genome 25028] predictions:    9894/  10000 (98.94%), best:    9902/10000 (99.02%), error:       329.88638, best error:       311.64740 on epoch:    68, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 857.8890380859s, input_fired_time: 12.2439813614, output_fired_time: 11.3912801743, propagate_forward_time: 318.9118957520, propagate_backward_time: 503.9044799805, weight_update_time: 0.7377937436, other_time: 11.4374389648
epoch time: 64.0512237549s, input_fired_time: 1.4759826660, output_fired_time: 0.0000000000, propagate_forward_time: 60.5367393494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0385017395
validation[          , genome 25028] predictions:    9901/  10000 (99.01%), best:    9902/10000 (99.02%), error:       315.83704, best error:       311.64740 on epoch:    68, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 810.3701782227s, input_fired_time: 11.8092899323, output_fired_time: 10.8343553543, propagate_forward_time: 299.3544006348, propagate_backward_time: 477.2788391113, weight_update_time: 0.7121689320, other_time: 11.0933227539
epoch time: 61.9725036621s, input_fired_time: 1.4398398399, output_fired_time: 0.0000000000, propagate_forward_time: 58.5307235718, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0019416809
validation[          , genome 25028] predictions:    9896/  10000 (98.96%), best:    9902/10000 (99.02%), error:       320.13583, best error:       311.64740 on epoch:    68, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 820.1534423828s, input_fired_time: 11.8929929733, output_fired_time: 10.9363126755, propagate_forward_time: 303.1444091797, propagate_backward_time: 483.1111450195, weight_update_time: 0.7092920542, other_time: 11.0685424805
epoch time: 64.2981872559s, input_fired_time: 1.4880949259, output_fired_time: 0.0000000000, propagate_forward_time: 60.7969322205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0131607056
validation[          , genome 25028] predictions:    9885/  10000 (98.85%), best:    9902/10000 (99.02%), error:       365.08008, best error:       311.64740 on epoch:    68, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 830.7642822266s, input_fired_time: 12.0036258698, output_fired_time: 11.0636024475, propagate_forward_time: 308.1351013184, propagate_backward_time: 488.3227539063, weight_update_time: 0.7229200602, other_time: 11.2392272949
epoch time: 63.5089492798s, input_fired_time: 1.4652608633, output_fired_time: 0.0000000000, propagate_forward_time: 60.0122184753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0314712524
validation[          , genome 25028] predictions:    9885/  10000 (98.85%), best:    9902/10000 (99.02%), error:       333.18936, best error:       311.64740 on epoch:    68, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 836.3057250977s, input_fired_time: 12.0195426941, output_fired_time: 11.1297569275, propagate_forward_time: 309.9451904297, propagate_backward_time: 491.9356384277, weight_update_time: 0.7267245650, other_time: 11.2756042480
epoch time: 66.4281005859s, input_fired_time: 1.5173110962, output_fired_time: 0.0000000000, propagate_forward_time: 62.8381309509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0726585388
validation[          , genome 25028] predictions:    9899/  10000 (98.99%), best:    9902/10000 (99.02%), error:       320.67200, best error:       311.64740 on epoch:    68, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 848.4191894531s, input_fired_time: 12.1578817368, output_fired_time: 11.2493600845, propagate_forward_time: 314.9912414551, propagate_backward_time: 498.7098693848, weight_update_time: 0.7302981615, other_time: 11.3107910156
epoch time: 67.0630493164s, input_fired_time: 1.5278044939, output_fired_time: 0.0000000000, propagate_forward_time: 63.4546966553, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0805511475
validation[          , genome 25028] predictions:    9900/  10000 (99.00%), best:    9900/10000 (99.00%), error:       305.00250, best error:       305.00250 on epoch:    75, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 857.5676879883s, input_fired_time: 12.2532672882, output_fired_time: 11.3529853821, propagate_forward_time: 319.2772521973, propagate_backward_time: 503.2876586914, weight_update_time: 0.7357338667, other_time: 11.3965454102
epoch time: 67.1891098022s, input_fired_time: 1.5311594009, output_fired_time: 0.0000000000, propagate_forward_time: 63.5807266235, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0772247314
validation[          , genome 25028] predictions:    9908/  10000 (99.08%), best:    9908/10000 (99.08%), error:       303.82169, best error:       303.82169 on epoch:    76, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 873.5040283203s, input_fired_time: 12.3841791153, output_fired_time: 11.6031970978, propagate_forward_time: 325.4762268066, propagate_backward_time: 512.5762329102, weight_update_time: 0.7397869229, other_time: 11.4641723633
epoch time: 68.8972473145s, input_fired_time: 1.5628349781, output_fired_time: 0.0000000000, propagate_forward_time: 65.2330322266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1013793945
validation[          , genome 25028] predictions:    9905/  10000 (99.05%), best:    9905/10000 (99.05%), error:       299.56836, best error:       299.56836 on epoch:    77, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 846.9541625977s, input_fired_time: 12.1572914124, output_fired_time: 11.2222881317, propagate_forward_time: 314.9435424805, propagate_backward_time: 497.3495483398, weight_update_time: 0.7278610468, other_time: 11.2814941406
epoch time: 63.3605308533s, input_fired_time: 1.4650710821, output_fired_time: 0.0000000000, propagate_forward_time: 59.8811340332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0143241882
validation[          , genome 25028] predictions:    9893/  10000 (98.93%), best:    9905/10000 (99.05%), error:       314.58124, best error:       299.56836 on epoch:    77, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 794.9791870117s, input_fired_time: 11.6703424454, output_fired_time: 10.5866069794, propagate_forward_time: 293.2848815918, propagate_backward_time: 468.4961547852, weight_update_time: 0.6980038285, other_time: 10.9411926270
epoch time: 62.3952255249s, input_fired_time: 1.4559148550, output_fired_time: 0.0000000000, propagate_forward_time: 58.9317665100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0075454712
validation[          , genome 25028] predictions:    9858/  10000 (98.58%), best:    9905/10000 (99.05%), error:       426.75287, best error:       299.56836 on epoch:    77, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 742.0567016602s, input_fired_time: 11.2100095749, output_fired_time: 9.9685678482, propagate_forward_time: 272.0956115723, propagate_backward_time: 438.2636413574, weight_update_time: 0.6650318503, other_time: 10.5188598633
epoch time: 54.9836082458s, input_fired_time: 1.3246042728, output_fired_time: 0.0000000000, propagate_forward_time: 51.7659416199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8930625916
validation[          , genome 25028] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       298.67075, best error:       298.67075 on epoch:    80, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 709.5809936523s, input_fired_time: 10.8743925095, output_fired_time: 9.5644273758, propagate_forward_time: 256.9859313965, propagate_backward_time: 421.8359069824, weight_update_time: 0.6500118971, other_time: 10.3203125000
epoch time: 53.2872467041s, input_fired_time: 1.2904733419, output_fired_time: 0.0000000000, propagate_forward_time: 50.1563911438, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8403816223
validation[          , genome 25028] predictions:    9898/  10000 (98.98%), best:    9906/10000 (99.06%), error:       305.39050, best error:       298.67075 on epoch:    80, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 734.2713623047s, input_fired_time: 11.1270456314, output_fired_time: 9.8478584290, propagate_forward_time: 267.9725952148, propagate_backward_time: 434.8515625000, weight_update_time: 0.6609501243, other_time: 10.4722900391
epoch time: 60.3597908020s, input_fired_time: 1.4214855433, output_fired_time: 0.0000000000, propagate_forward_time: 56.9603691101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9779357910
validation[          , genome 25028] predictions:    9902/  10000 (99.02%), best:    9906/10000 (99.06%), error:       307.62692, best error:       298.67075 on epoch:    80, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 826.0267333984s, input_fired_time: 11.9576978683, output_fired_time: 10.9833116531, propagate_forward_time: 305.4555053711, propagate_backward_time: 486.4449462891, weight_update_time: 0.7188957334, other_time: 11.1852416992
epoch time: 67.5855789185s, input_fired_time: 1.5536119938, output_fired_time: 0.0000000000, propagate_forward_time: 63.9490623474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0829048157
validation[          , genome 25028] predictions:    9893/  10000 (98.93%), best:    9906/10000 (99.06%), error:       342.84827, best error:       298.67075 on epoch:    80, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 886.6218261719s, input_fired_time: 12.7805070877, output_fired_time: 11.8069448471, propagate_forward_time: 330.5782165527, propagate_backward_time: 519.7896118164, weight_update_time: 0.7488232851, other_time: 11.6665649414
epoch time: 71.6808166504s, input_fired_time: 1.6578853130, output_fired_time: 0.0000000000, propagate_forward_time: 67.8182983398, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2046356201
validation[          , genome 25028] predictions:    9900/  10000 (99.00%), best:    9906/10000 (99.06%), error:       302.03116, best error:       298.67075 on epoch:    80, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 961.1938476563s, input_fired_time: 13.7526254654, output_fired_time: 12.6964521408, propagate_forward_time: 359.0395812988, propagate_backward_time: 563.1007080078, weight_update_time: 0.8978469372, other_time: 12.6044921875
epoch time: 71.1416931152s, input_fired_time: 1.6026158333, output_fired_time: 0.0000000000, propagate_forward_time: 67.3444747925, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1946029663
validation[          , genome 25028] predictions:    9903/  10000 (99.03%), best:    9906/10000 (99.06%), error:       305.28824, best error:       298.67075 on epoch:    80, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 900.8877563477s, input_fired_time: 12.8230152130, output_fired_time: 11.8482065201, propagate_forward_time: 336.0442504883, propagate_backward_time: 528.3531494141, weight_update_time: 0.7585275173, other_time: 11.8191528320
epoch time: 69.0343627930s, input_fired_time: 1.5708220005, output_fired_time: 0.0000000000, propagate_forward_time: 65.3409957886, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1225433350
validation[          , genome 25028] predictions:    9903/  10000 (99.03%), best:    9906/10000 (99.06%), error:       311.27267, best error:       298.67075 on epoch:    80, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 882.4575195313s, input_fired_time: 12.5248126984, output_fired_time: 11.6986522675, propagate_forward_time: 328.7060852051, propagate_backward_time: 517.8607177734, weight_update_time: 0.7728316784, other_time: 11.6672363281
epoch time: 69.7833023071s, input_fired_time: 1.5780001879, output_fired_time: 0.0000000000, propagate_forward_time: 66.0664215088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1388778687
validation[          , genome 25028] predictions:    9905/  10000 (99.05%), best:    9905/10000 (99.05%), error:       297.74091, best error:       297.74091 on epoch:    87, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 913.0180664063s, input_fired_time: 12.9694623947, output_fired_time: 11.9279947281, propagate_forward_time: 340.0148315430, propagate_backward_time: 536.2537841797, weight_update_time: 0.8219544291, other_time: 11.8519897461
epoch time: 76.9861831665s, input_fired_time: 1.7889863253, output_fired_time: 0.0000000000, propagate_forward_time: 72.8347320557, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3624649048
validation[          , genome 25028] predictions:    9890/  10000 (98.90%), best:    9905/10000 (99.05%), error:       334.23154, best error:       297.74091 on epoch:    87, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 943.5476074219s, input_fired_time: 13.2141685486, output_fired_time: 12.6146688461, propagate_forward_time: 351.7050781250, propagate_backward_time: 553.4865112305, weight_update_time: 0.7894197106, other_time: 12.5271606445
epoch time: 84.3129501343s, input_fired_time: 1.9860733747, output_fired_time: 0.0000000000, propagate_forward_time: 79.7609481812, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5659255981
validation[          , genome 25028] predictions:    9905/  10000 (99.05%), best:    9905/10000 (99.05%), error:       295.94870, best error:       295.94870 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1034.3781738281s, input_fired_time: 14.8217258453, output_fired_time: 13.4519758224, propagate_forward_time: 385.8230285645, propagate_backward_time: 606.8991088867, weight_update_time: 0.8985801339, other_time: 13.3823852539
epoch time: 79.2598648071s, input_fired_time: 1.7968565226, output_fired_time: 0.0000000000, propagate_forward_time: 75.0371246338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4258804321
validation[          , genome 25028] predictions:    9905/  10000 (99.05%), best:    9905/10000 (99.05%), error:       292.36667, best error:       292.36667 on epoch:    90, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 993.9005126953s, input_fired_time: 14.0662012100, output_fired_time: 13.0790929794, propagate_forward_time: 370.9294433594, propagate_backward_time: 582.9017333984, weight_update_time: 0.8827833533, other_time: 12.9240112305
epoch time: 73.4408187866s, input_fired_time: 1.6292085648, output_fired_time: 0.0000000000, propagate_forward_time: 69.5736312866, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2379760742
validation[          , genome 25028] predictions:    9904/  10000 (99.04%), best:    9905/10000 (99.05%), error:       303.31317, best error:       292.36667 on epoch:    90, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 846.8120727539s, input_fired_time: 12.2237815857, output_fired_time: 11.1866350174, propagate_forward_time: 314.5114746094, propagate_backward_time: 497.5430297852, weight_update_time: 0.7129985094, other_time: 11.3471679688
epoch time: 62.7659034729s, input_fired_time: 1.4617575407, output_fired_time: 0.0000000000, propagate_forward_time: 59.3154945374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9886512756
validation[          , genome 25028] predictions:    9900/  10000 (99.00%), best:    9905/10000 (99.05%), error:       301.91406, best error:       292.36667 on epoch:    90, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 769.8052978516s, input_fired_time: 11.4163637161, output_fired_time: 10.2822074890, propagate_forward_time: 281.6554565430, propagate_backward_time: 455.7002258301, weight_update_time: 0.6833018064, other_time: 10.7510070801
epoch time: 54.9959106445s, input_fired_time: 1.3244575262, output_fired_time: 0.0000000000, propagate_forward_time: 51.7970962524, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8743553162
validation[          , genome 25028] predictions:    9908/  10000 (99.08%), best:    9905/10000 (99.05%), error:       296.48996, best error:       292.36667 on epoch:    90, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 745.4264526367s, input_fired_time: 11.2073173523, output_fired_time: 9.9634962082, propagate_forward_time: 271.9643859863, propagate_backward_time: 441.7961120605, weight_update_time: 0.6627187133, other_time: 10.4951171875
epoch time: 60.4619445801s, input_fired_time: 1.4212696552, output_fired_time: 0.0000000000, propagate_forward_time: 57.0681800842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9724960327
validation[          , genome 25028] predictions:    9900/  10000 (99.00%), best:    9905/10000 (99.05%), error:       316.04065, best error:       292.36667 on epoch:    90, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 800.9416503906s, input_fired_time: 11.7434978485, output_fired_time: 10.6420812607, propagate_forward_time: 295.8592529297, propagate_backward_time: 471.7529296875, weight_update_time: 0.6986973882, other_time: 10.9439086914
epoch time: 64.3169250488s, input_fired_time: 1.4862284660, output_fired_time: 0.0000000000, propagate_forward_time: 60.7980194092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0326766968
validation[          , genome 25028] predictions:    9908/  10000 (99.08%), best:    9905/10000 (99.05%), error:       301.30582, best error:       292.36667 on epoch:    90, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 839.8322143555s, input_fired_time: 12.1026048660, output_fired_time: 11.0920200348, propagate_forward_time: 311.7651367188, propagate_backward_time: 493.5991516113, weight_update_time: 0.7257372737, other_time: 11.2732849121
epoch time: 66.2371826172s, input_fired_time: 1.5190039873, output_fired_time: 0.0000000000, propagate_forward_time: 62.6481285095, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0700492859
validation[          , genome 25028] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       289.98135, best error:       289.98135 on epoch:    96, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 844.6437377930s, input_fired_time: 12.1514539719, output_fired_time: 11.1639184952, propagate_forward_time: 313.6245117188, propagate_backward_time: 496.4279174805, weight_update_time: 0.7235069275, other_time: 11.2759399414
epoch time: 67.4506301880s, input_fired_time: 1.5462332964, output_fired_time: 0.0000000000, propagate_forward_time: 63.8197975159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0845985413
validation[          , genome 25028] predictions:    9909/  10000 (99.09%), best:    9906/10000 (99.06%), error:       296.49350, best error:       289.98135 on epoch:    96, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 827.0940551758s, input_fired_time: 12.0062055588, output_fired_time: 11.0059490204, propagate_forward_time: 306.8522949219, propagate_backward_time: 486.0604248047, weight_update_time: 0.7152701020, other_time: 11.1691894531
epoch time: 62.2992858887s, input_fired_time: 1.4557608366, output_fired_time: 0.0000000000, propagate_forward_time: 58.8558158875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9877090454
validation[          , genome 25028] predictions:    9902/  10000 (99.02%), best:    9906/10000 (99.06%), error:       290.33115, best error:       289.98135 on epoch:    96, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 750.2933959961s, input_fired_time: 11.2933282852, output_fired_time: 9.9760408401, propagate_forward_time: 274.9834899902, propagate_backward_time: 443.4818725586, weight_update_time: 0.6677269936, other_time: 10.5586853027
epoch time: 59.1473770142s, input_fired_time: 1.4023637772, output_fired_time: 0.0000000000, propagate_forward_time: 55.7872619629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9577522278
validation[          , genome 25028] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       290.97763, best error:       289.98135 on epoch:    96, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 771.4008789063s, input_fired_time: 11.4868898392, output_fired_time: 10.2894344330, propagate_forward_time: 283.6745605469, propagate_backward_time: 455.2037048340, weight_update_time: 0.6851261258, other_time: 10.7463073730
epoch time: 54.6808547974s, input_fired_time: 1.3241696358, output_fired_time: 0.0000000000, propagate_forward_time: 51.4873504639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8693351746
validation[          , genome 25028] predictions:    9907/  10000 (99.07%), best:    9907/10000 (99.07%), error:       286.44049, best error:       286.44049 on epoch:   100, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 279.7158203125s, input_fired_time: 6.7575573921, output_fired_time: 0.0000000000, propagate_forward_time: 263.4226074219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.5356445313
best training[          , genome 25028] predictions:   49999/  50000 (100.00%), best:    9907/10000 (99.07%), error:       107.57728, best error:       286.44049 on epoch:   100, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 57.3218955994s, input_fired_time: 1.3611959219, output_fired_time: 0.0000000000, propagate_forward_time: 54.0221023560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9385986328
   testing[          , genome 25028] predictions:    9913/  10000 (99.13%), best:    9907/10000 (99.07%), error:       243.73552, best error:       286.44049 on epoch:   100, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
14:37:54 (4376): called boinc_finish(0)

</stderr_txt>
]]>