Nameexact_genome_1542069603_184_5714_2
Workunit4084213
Created13 Nov 2018, 4:24:38 UTC
Sent13 Nov 2018, 4:34:33 UTC
Report deadline10 Mar 2019, 23:35:33 UTC
Received19 Nov 2018, 7:22:15 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID91253
Run time3 days 5 hours 55 min 44 sec
CPU time2 days 23 hours 12 min 45 sec
Validate stateValid
Credit29,448.09
Device peak FLOPS3.02 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size534.36 MB
Peak swap size553.56 MB
Peak disk usage11.39 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
0 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 2466.0249023438s, input_fired_time: 18.3240528107, output_fired_time: 18.1048393250, propagate_forward_time: 947.6283569336, propagate_backward_time: 1461.5668945313, weight_update_time: 1.8241328001, other_time: 20.4008789063
epoch time: 199.7520751953s, input_fired_time: 2.3132934570, output_fired_time: 0.0000000000, propagate_forward_time: 193.5857238770, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8530578613
validation[          , genome  5714] predictions:    5596/  10000 (55.96%), best:    5596/10000 (55.96%), error:     13591.58691, best error:     13591.58691 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 2466.2512207031s, input_fired_time: 18.3056812286, output_fired_time: 17.8858108521, propagate_forward_time: 946.1749877930, propagate_backward_time: 1463.5960693359, weight_update_time: 1.8778051138, other_time: 20.2886962891
epoch time: 205.6485290527s, input_fired_time: 2.3409497738, output_fired_time: 0.0000000000, propagate_forward_time: 199.4476776123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8599090576
validation[          , genome  5714] predictions:    5270/  10000 (52.70%), best:    5596/10000 (55.96%), error:     15072.82422, best error:     13591.58691 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 2567.2929687500s, input_fired_time: 19.2669925690, output_fired_time: 19.1749229431, propagate_forward_time: 997.4399414063, propagate_backward_time: 1509.4453125000, weight_update_time: 1.9395642281, other_time: 21.9658203125
epoch time: 203.4860839844s, input_fired_time: 2.3346755505, output_fired_time: 0.0000000000, propagate_forward_time: 197.3106536865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8407592773
validation[          , genome  5714] predictions:    5410/  10000 (54.10%), best:    5596/10000 (55.96%), error:     14540.05469, best error:     13591.58691 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 2648.7629394531s, input_fired_time: 19.6799507141, output_fired_time: 19.5570297241, propagate_forward_time: 1029.8972167969, propagate_backward_time: 1557.2540283203, weight_update_time: 1.9681087732, other_time: 22.3746337891
epoch time: 207.4158782959s, input_fired_time: 2.4315400124, output_fired_time: 0.0000000000, propagate_forward_time: 201.0220794678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9622650146
validation[          , genome  5714] predictions:    5490/  10000 (54.90%), best:    5596/10000 (55.96%), error:     14010.15234, best error:     13591.58691 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 2553.7548828125s, input_fired_time: 19.1329994202, output_fired_time: 19.1030158997, propagate_forward_time: 993.6855468750, propagate_backward_time: 1499.9189453125, weight_update_time: 1.9010231495, other_time: 21.9143066406
epoch time: 205.6662445068s, input_fired_time: 2.3136711121, output_fired_time: 0.0000000000, propagate_forward_time: 199.4477081299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9048614502
validation[          , genome  5714] predictions:    5519/  10000 (55.19%), best:    5596/10000 (55.96%), error:     13870.26270, best error:     13591.58691 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 2554.4641113281s, input_fired_time: 19.1674880981, output_fired_time: 18.9928512573, propagate_forward_time: 985.5445556641, propagate_backward_time: 1508.7263183594, weight_update_time: 1.9182126522, other_time: 22.0328369141
epoch time: 201.9592132568s, input_fired_time: 2.3495659828, output_fired_time: 0.0000000000, propagate_forward_time: 195.6711730957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9384765625
validation[          , genome  5714] predictions:    5532/  10000 (55.32%), best:    5596/10000 (55.96%), error:     13798.50098, best error:     13591.58691 on epoch:    16, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 2541.0456542969s, input_fired_time: 19.1235923767, output_fired_time: 19.0766601563, propagate_forward_time: 983.2359008789, propagate_backward_time: 1497.4741210938, weight_update_time: 1.9634912014, other_time: 22.1354980469
epoch time: 204.0947570801s, input_fired_time: 2.3128473759, output_fired_time: 0.0000000000, propagate_forward_time: 197.8572692871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9246368408
validation[          , genome  5714] predictions:    5769/  10000 (57.69%), best:    5769/10000 (57.69%), error:     12961.30566, best error:     12961.30566 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 2563.0668945313s, input_fired_time: 19.2060356140, output_fired_time: 19.1557903290, propagate_forward_time: 998.1582031250, propagate_backward_time: 1504.6413574219, weight_update_time: 1.9264293909, other_time: 21.9055175781
epoch time: 207.2613220215s, input_fired_time: 2.3896207809, output_fired_time: 0.0000000000, propagate_forward_time: 200.8740234375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9976806641
validation[          , genome  5714] predictions:    5605/  10000 (56.05%), best:    5769/10000 (57.69%), error:     13730.20020, best error:     12961.30566 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 12328.9902343750s, input_fired_time: 19.7802639008, output_fired_time: 19.6537475586, propagate_forward_time: 1022.6528320313, propagate_backward_time: 11240.6044921875, weight_update_time: 1.9704132080, other_time: 26.2998046875
epoch time: 214.3579711914s, input_fired_time: 2.5452330112, output_fired_time: 0.0000000000, propagate_forward_time: 206.6218414307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1909027100
validation[          , genome  5714] predictions:    5571/  10000 (55.71%), best:    5769/10000 (57.69%), error:     14274.26367, best error:     12961.30566 on epoch:    22, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 2574.7141113281s, input_fired_time: 19.3375034332, output_fired_time: 19.4527683258, propagate_forward_time: 1003.3967895508, propagate_backward_time: 1510.6241455078, weight_update_time: 1.9328434467, other_time: 21.9029541016
epoch time: 207.3131713867s, input_fired_time: 2.4201738834, output_fired_time: 0.0000000000, propagate_forward_time: 200.9919891357, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9010009766
validation[          , genome  5714] predictions:    5618/  10000 (56.18%), best:    5769/10000 (57.69%), error:     13389.07617, best error:     12961.30566 on epoch:    22, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 2670.3977050781s, input_fired_time: 20.0015220642, output_fired_time: 19.8562965393, propagate_forward_time: 1039.5729980469, propagate_backward_time: 1568.1560058594, weight_update_time: 2.0353059769, other_time: 22.8110351563
epoch time: 238.3390502930s, input_fired_time: 2.8020792007, output_fired_time: 0.0000000000, propagate_forward_time: 230.7584533691, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7785186768
validation[          , genome  5714] predictions:    5634/  10000 (56.34%), best:    5769/10000 (57.69%), error:     13720.62695, best error:     12961.30566 on epoch:    22, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 2590.8364257813s, input_fired_time: 19.2761249542, output_fired_time: 19.3691577911, propagate_forward_time: 1007.1134643555, propagate_backward_time: 1522.7762451172, weight_update_time: 1.9569857121, other_time: 22.3013916016
epoch time: 210.8166198730s, input_fired_time: 2.5300977230, output_fired_time: 0.0000000000, propagate_forward_time: 204.2617492676, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0247802734
validation[          , genome  5714] predictions:    5684/  10000 (56.84%), best:    5769/10000 (57.69%), error:     13433.25293, best error:     12961.30566 on epoch:    22, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 2586.7766113281s, input_fired_time: 19.5329513550, output_fired_time: 19.1851043701, propagate_forward_time: 1008.1089477539, propagate_backward_time: 1517.6762695313, weight_update_time: 1.9975463152, other_time: 22.2734375000
epoch time: 209.8330535889s, input_fired_time: 2.4830589294, output_fired_time: 0.0000000000, propagate_forward_time: 203.2452850342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1047058105
validation[          , genome  5714] predictions:    5841/  10000 (58.41%), best:    5841/10000 (58.41%), error:     12729.33008, best error:     12729.33008 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 2571.0598144531s, input_fired_time: 19.4315776825, output_fired_time: 19.2572555542, propagate_forward_time: 1001.4857788086, propagate_backward_time: 1508.6562500000, weight_update_time: 1.9292291403, other_time: 22.2287597656
epoch time: 214.5831146240s, input_fired_time: 2.5820422173, output_fired_time: 0.0000000000, propagate_forward_time: 207.9442749023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0567932129
validation[          , genome  5714] predictions:    5672/  10000 (56.72%), best:    5841/10000 (58.41%), error:     13305.93652, best error:     12729.33008 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 25020.3593750000s, input_fired_time: 19.8280887604, output_fired_time: 19.8436412811, propagate_forward_time: 1022.1145019531, propagate_backward_time: 23935.8535156250, weight_update_time: 2.0184531212, other_time: 22.7187500000
epoch time: 189.6562042236s, input_fired_time: 2.2853651047, output_fired_time: 0.0000000000, propagate_forward_time: 183.7189331055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6519012451
validation[          , genome  5714] predictions:    5833/  10000 (58.33%), best:    5841/10000 (58.41%), error:     12944.97949, best error:     12729.33008 on epoch:    28, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 2450.8083496094s, input_fired_time: 18.2326183319, output_fired_time: 18.0822620392, propagate_forward_time: 942.4312133789, propagate_backward_time: 1451.8920898438, weight_update_time: 1.8345495462, other_time: 20.1701660156
epoch time: 193.2358398438s, input_fired_time: 2.2630746365, output_fired_time: 0.0000000000, propagate_forward_time: 187.2361602783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7366027832
validation[          , genome  5714] predictions:    5764/  10000 (57.64%), best:    5841/10000 (58.41%), error:     13111.23438, best error:     12729.33008 on epoch:    28, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 2438.8352050781s, input_fired_time: 18.2410583496, output_fired_time: 17.8455619812, propagate_forward_time: 938.5306396484, propagate_backward_time: 1444.1086425781, weight_update_time: 1.8225439787, other_time: 20.1094970703
epoch time: 193.0613861084s, input_fired_time: 2.2330932617, output_fired_time: 0.0000000000, propagate_forward_time: 187.3145904541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5137023926
validation[          , genome  5714] predictions:    5862/  10000 (58.62%), best:    5841/10000 (58.41%), error:     12986.40234, best error:     12729.33008 on epoch:    28, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 2440.3020019531s, input_fired_time: 18.3833732605, output_fired_time: 17.9347438812, propagate_forward_time: 940.6519165039, propagate_backward_time: 1443.0280761719, weight_update_time: 1.8943063021, other_time: 20.3039550781
epoch time: 187.7347412109s, input_fired_time: 2.1963801384, output_fired_time: 0.0000000000, propagate_forward_time: 181.9432830811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5950775146
validation[          , genome  5714] predictions:    5738/  10000 (57.38%), best:    5841/10000 (58.41%), error:     13562.12012, best error:     12729.33008 on epoch:    28, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 2405.7541503906s, input_fired_time: 18.2804813385, output_fired_time: 17.8208808899, propagate_forward_time: 918.5779418945, propagate_backward_time: 1430.8791503906, weight_update_time: 1.8523862362, other_time: 20.1958007813
epoch time: 187.8985137939s, input_fired_time: 2.2740168571, output_fired_time: 0.0000000000, propagate_forward_time: 182.0908660889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5336303711
validation[          , genome  5714] predictions:    5604/  10000 (56.04%), best:    5841/10000 (58.41%), error:     13709.32422, best error:     12729.33008 on epoch:    28, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 2423.3151855469s, input_fired_time: 18.3780097961, output_fired_time: 17.9122505188, propagate_forward_time: 931.0220336914, propagate_backward_time: 1435.9582519531, weight_update_time: 1.8372561932, other_time: 20.0446777344
epoch time: 193.6248168945s, input_fired_time: 2.2930021286, output_fired_time: 0.0000000000, propagate_forward_time: 187.8116149902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5202026367
validation[          , genome  5714] predictions:    5646/  10000 (56.46%), best:    5841/10000 (58.41%), error:     13642.28418, best error:     12729.33008 on epoch:    28, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 38176.8359375000s, input_fired_time: 18.4717655182, output_fired_time: 17.9142436981, propagate_forward_time: 36672.7265625000, propagate_backward_time: 1447.1710205078, weight_update_time: 1.9116942883, other_time: 20.5516357422
epoch time: 187.3906555176s, input_fired_time: 2.2725179195, output_fired_time: 0.0000000000, propagate_forward_time: 181.6363372803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4817962646
validation[          , genome  5714] predictions:    5634/  10000 (56.34%), best:    5841/10000 (58.41%), error:     13620.30469, best error:     12729.33008 on epoch:    28, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 2487.5666503906s, input_fired_time: 18.6803398132, output_fired_time: 17.9719371796, propagate_forward_time: 944.3258666992, propagate_backward_time: 1486.0883789063, weight_update_time: 1.8834893703, other_time: 20.5000000000
epoch time: 189.2520599365s, input_fired_time: 2.2460560799, output_fired_time: 0.0000000000, propagate_forward_time: 183.4527893066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5532073975
validation[          , genome  5714] predictions:    5899/  10000 (58.99%), best:    5841/10000 (58.41%), error:     12882.49414, best error:     12729.33008 on epoch:    28, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 2463.1013183594s, input_fired_time: 18.5143260956, output_fired_time: 18.0109901428, propagate_forward_time: 943.5573120117, propagate_backward_time: 1462.6900634766, weight_update_time: 1.8147653341, other_time: 20.3284912109
epoch time: 195.6552429199s, input_fired_time: 2.4226188660, output_fired_time: 0.0000000000, propagate_forward_time: 189.7178955078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5147247314
validation[          , genome  5714] predictions:    5750/  10000 (57.50%), best:    5841/10000 (58.41%), error:     13215.28125, best error:     12729.33008 on epoch:    28, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 2623.3046875000s, input_fired_time: 19.4464817047, output_fired_time: 19.0690670013, propagate_forward_time: 1006.0679931641, propagate_backward_time: 1556.9517822266, weight_update_time: 1.9575777054, other_time: 21.7692871094
epoch time: 195.0235443115s, input_fired_time: 2.2826097012, output_fired_time: 0.0000000000, propagate_forward_time: 189.1492767334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5916595459
validation[          , genome  5714] predictions:    5861/  10000 (58.61%), best:    5841/10000 (58.41%), error:     12906.06250, best error:     12729.33008 on epoch:    28, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 2880.0437011719s, input_fired_time: 19.1142730713, output_fired_time: 18.5251064301, propagate_forward_time: 1334.6950683594, propagate_backward_time: 1486.8061523438, weight_update_time: 1.8876250982, other_time: 20.9030761719
epoch time: 211.8967742920s, input_fired_time: 2.4970338345, output_fired_time: 0.0000000000, propagate_forward_time: 205.3867187500, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0130157471
validation[          , genome  5714] predictions:    5966/  10000 (59.66%), best:    5966/10000 (59.66%), error:     12364.09277, best error:     12364.09277 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 2650.8933105469s, input_fired_time: 20.1522521973, output_fired_time: 19.9516735077, propagate_forward_time: 1018.9053955078, propagate_backward_time: 1570.1052246094, weight_update_time: 1.9396691322, other_time: 21.7786865234
epoch time: 211.1674194336s, input_fired_time: 2.4625656605, output_fired_time: 0.0000000000, propagate_forward_time: 205.1061096191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5987396240
validation[          , genome  5714] predictions:    5946/  10000 (59.46%), best:    5966/10000 (59.66%), error:     12383.26270, best error:     12364.09277 on epoch:    40, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 2617.1479492188s, input_fired_time: 19.5167694092, output_fired_time: 19.8360385895, propagate_forward_time: 1017.5476684570, propagate_backward_time: 1540.1495361328, weight_update_time: 1.9120831490, other_time: 20.0980224609
epoch time: 210.5889434814s, input_fired_time: 2.4699847698, output_fired_time: 0.0000000000, propagate_forward_time: 204.6313934326, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4875640869
validation[          , genome  5714] predictions:    5864/  10000 (58.64%), best:    5966/10000 (59.66%), error:     12715.41406, best error:     12364.09277 on epoch:    40, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 2625.3010253906s, input_fired_time: 19.6207904816, output_fired_time: 20.0443744659, propagate_forward_time: 1015.7920532227, propagate_backward_time: 1548.8372802734, weight_update_time: 1.9838758707, other_time: 21.0064697266
epoch time: 207.2359771729s, input_fired_time: 2.4377655983, output_fired_time: 0.0000000000, propagate_forward_time: 200.9764251709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8217926025
validation[          , genome  5714] predictions:    6040/  10000 (60.40%), best:    5966/10000 (59.66%), error:     12470.39551, best error:     12364.09277 on epoch:    40, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 2602.1435546875s, input_fired_time: 19.6770458221, output_fired_time: 19.5358829498, propagate_forward_time: 1004.5885009766, propagate_backward_time: 1536.5468750000, weight_update_time: 1.9848407507, other_time: 21.7952880859
epoch time: 204.8807983398s, input_fired_time: 2.4128267765, output_fired_time: 0.0000000000, propagate_forward_time: 198.7070007324, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7609710693
validation[          , genome  5714] predictions:    5973/  10000 (59.73%), best:    5973/10000 (59.73%), error:     12294.07520, best error:     12294.07520 on epoch:    44, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 2696.9614257813s, input_fired_time: 20.2650642395, output_fired_time: 20.5405178070, propagate_forward_time: 1048.4916992188, propagate_backward_time: 1587.1755371094, weight_update_time: 2.0226814747, other_time: 20.4885253906
epoch time: 205.6820983887s, input_fired_time: 2.3430161476, output_fired_time: 0.0000000000, propagate_forward_time: 199.8484039307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4906768799
validation[          , genome  5714] predictions:    5932/  10000 (59.32%), best:    5973/10000 (59.73%), error:     12665.45801, best error:     12294.07520 on epoch:    44, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 2574.7705078125s, input_fired_time: 19.2767372131, output_fired_time: 19.5648441315, propagate_forward_time: 1000.7434692383, propagate_backward_time: 1515.2938232422, weight_update_time: 1.9225643873, other_time: 19.8914794922
epoch time: 426.7628784180s, input_fired_time: 5.1807184219, output_fired_time: 0.0000000000, propagate_forward_time: 413.0737609863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5083923340
validation[          , genome  5714] predictions:    5873/  10000 (58.73%), best:    5973/10000 (59.73%), error:     12986.64746, best error:     12294.07520 on epoch:    44, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 3654.1828613281s, input_fired_time: 21.2185344696, output_fired_time: 21.6599807739, propagate_forward_time: 1058.7133789063, propagate_backward_time: 2530.6926269531, weight_update_time: 2.1373267174, other_time: 21.8984375000
epoch time: 205.6194458008s, input_fired_time: 2.3869190216, output_fired_time: 0.0000000000, propagate_forward_time: 199.7121276855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5204010010
validation[          , genome  5714] predictions:    5941/  10000 (59.41%), best:    5973/10000 (59.73%), error:     12857.01465, best error:     12294.07520 on epoch:    44, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 2566.9399414063s, input_fired_time: 19.2002620697, output_fired_time: 19.5437088013, propagate_forward_time: 997.4066162109, propagate_backward_time: 1510.9537353516, weight_update_time: 1.9905780554, other_time: 19.8356933594
epoch time: 205.7672424316s, input_fired_time: 2.3946094513, output_fired_time: 0.0000000000, propagate_forward_time: 199.8322143555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5404205322
validation[          , genome  5714] predictions:    6033/  10000 (60.33%), best:    5973/10000 (59.73%), error:     12412.41113, best error:     12294.07520 on epoch:    44, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 5772.9965820313s, input_fired_time: 22.0498790741, output_fired_time: 22.0624141693, propagate_forward_time: 4023.7861328125, propagate_backward_time: 1682.1251220703, weight_update_time: 2.0808701515, other_time: 22.9730224609
epoch time: 204.3538818359s, input_fired_time: 2.4223675728, output_fired_time: 0.0000000000, propagate_forward_time: 198.2934417725, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6380767822
validation[          , genome  5714] predictions:    5897/  10000 (58.97%), best:    5973/10000 (59.73%), error:     12693.13965, best error:     12294.07520 on epoch:    44, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 7412.2954101563s, input_fired_time: 19.4720554352, output_fired_time: 19.1581306458, propagate_forward_time: 5859.0068359375, propagate_backward_time: 1493.9333496094, weight_update_time: 1.9169018269, other_time: 20.7248535156
epoch time: 207.6552276611s, input_fired_time: 2.4292988777, output_fired_time: 0.0000000000, propagate_forward_time: 201.5464935303, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6794281006
validation[          , genome  5714] predictions:    5972/  10000 (59.72%), best:    5973/10000 (59.73%), error:     12426.71680, best error:     12294.07520 on epoch:    44, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 2697.8522949219s, input_fired_time: 20.5586490631, output_fired_time: 20.4588890076, propagate_forward_time: 1041.3701171875, propagate_backward_time: 1592.5687255859, weight_update_time: 2.0075101852, other_time: 22.8958740234
epoch time: 222.8071289063s, input_fired_time: 2.6116528511, output_fired_time: 0.0000000000, propagate_forward_time: 215.6801147461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5153656006
validation[          , genome  5714] predictions:    6059/  10000 (60.59%), best:    5973/10000 (59.73%), error:     12422.06836, best error:     12294.07520 on epoch:    44, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 2767.4787597656s, input_fired_time: 21.4000720978, output_fired_time: 21.2489318848, propagate_forward_time: 1064.6979980469, propagate_backward_time: 1635.4655761719, weight_update_time: 2.1176621914, other_time: 24.6660156250
epoch time: 210.7030792236s, input_fired_time: 2.4860196114, output_fired_time: 0.0000000000, propagate_forward_time: 204.1716003418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0454559326
validation[          , genome  5714] predictions:    6035/  10000 (60.35%), best:    5973/10000 (59.73%), error:     12544.11914, best error:     12294.07520 on epoch:    44, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 2773.0283203125s, input_fired_time: 21.6117229462, output_fired_time: 20.7267475128, propagate_forward_time: 1062.7722167969, propagate_backward_time: 1643.8964843750, weight_update_time: 2.1921875477, other_time: 24.0209960938
epoch time: 220.8396301270s, input_fired_time: 2.6307387352, output_fired_time: 0.0000000000, propagate_forward_time: 213.8245697021, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3843231201
validation[          , genome  5714] predictions:    6044/  10000 (60.44%), best:    5973/10000 (59.73%), error:     12329.37207, best error:     12294.07520 on epoch:    44, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 2736.6723632813s, input_fired_time: 21.1805114746, output_fired_time: 21.1237583160, propagate_forward_time: 1053.3861083984, propagate_backward_time: 1616.5197753906, weight_update_time: 2.0639553070, other_time: 24.4622802734
epoch time: 217.7414398193s, input_fired_time: 2.6345257759, output_fired_time: 0.0000000000, propagate_forward_time: 210.7833557129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3235626221
validation[          , genome  5714] predictions:    6036/  10000 (60.36%), best:    5973/10000 (59.73%), error:     12396.07031, best error:     12294.07520 on epoch:    44, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 2653.9455566406s, input_fired_time: 20.5942344666, output_fired_time: 20.1375045776, propagate_forward_time: 1016.7276611328, propagate_backward_time: 1573.2061767578, weight_update_time: 2.0375998020, other_time: 23.2800292969
epoch time: 206.8634948730s, input_fired_time: 2.4785404205, output_fired_time: 0.0000000000, propagate_forward_time: 200.2563476563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1286010742
validation[          , genome  5714] predictions:    6018/  10000 (60.18%), best:    5973/10000 (59.73%), error:     12408.24902, best error:     12294.07520 on epoch:    44, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 2530.9199218750s, input_fired_time: 19.6332225800, output_fired_time: 19.0621528625, propagate_forward_time: 967.3858642578, propagate_backward_time: 1502.9790039063, weight_update_time: 1.9258432388, other_time: 21.8594970703
epoch time: 199.0219573975s, input_fired_time: 2.4749917984, output_fired_time: 0.0000000000, propagate_forward_time: 192.6817169189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8652496338
validation[          , genome  5714] predictions:    6202/  10000 (62.02%), best:    6202/10000 (62.02%), error:     11869.49316, best error:     11869.49316 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 3029.9731445313s, input_fired_time: 22.9136829376, output_fired_time: 21.9749011993, propagate_forward_time: 1139.3978271484, propagate_backward_time: 1801.8339843750, weight_update_time: 2.2371959686, other_time: 43.8529052734
epoch time: 202.6669311523s, input_fired_time: 2.4306578636, output_fired_time: 0.0000000000, propagate_forward_time: 194.7941894531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4420776367
validation[          , genome  5714] predictions:    5950/  10000 (59.50%), best:    6202/10000 (62.02%), error:     12469.65234, best error:     11869.49316 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 43002.9023437500s, input_fired_time: 21.4634590149, output_fired_time: 19.9153079987, propagate_forward_time: 41331.8867187500, propagate_backward_time: 1601.4659423828, weight_update_time: 2.1043767929, other_time: 28.1707763672
epoch time: 207.1207427979s, input_fired_time: 2.5468468666, output_fired_time: 0.0000000000, propagate_forward_time: 200.5334014893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0404968262
validation[          , genome  5714] predictions:    5940/  10000 (59.40%), best:    6202/10000 (62.02%), error:     12623.63672, best error:     11869.49316 on epoch:    56, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 2775.0527343750s, input_fired_time: 21.6772918701, output_fired_time: 21.0987529755, propagate_forward_time: 1067.0434570313, propagate_backward_time: 1639.9000244141, weight_update_time: 2.1300842762, other_time: 25.3333740234
epoch time: 227.5017089844s, input_fired_time: 2.8254008293, output_fired_time: 0.0000000000, propagate_forward_time: 219.9869232178, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6893920898
validation[          , genome  5714] predictions:    6133/  10000 (61.33%), best:    6202/10000 (62.02%), error:     11986.50879, best error:     11869.49316 on epoch:    56, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 2723.4375000000s, input_fired_time: 21.3544349670, output_fired_time: 20.8395118713, propagate_forward_time: 1049.0898437500, propagate_backward_time: 1607.7976074219, weight_update_time: 2.1016786098, other_time: 24.3559570313
epoch time: 212.4912261963s, input_fired_time: 2.5891761780, output_fired_time: 0.0000000000, propagate_forward_time: 205.8341217041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0679321289
validation[          , genome  5714] predictions:    6136/  10000 (61.36%), best:    6202/10000 (62.02%), error:     12173.04004, best error:     11869.49316 on epoch:    56, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 2752.4409179688s, input_fired_time: 21.4340076447, output_fired_time: 21.0008583069, propagate_forward_time: 1058.2088623047, propagate_backward_time: 1627.3494873047, weight_update_time: 2.1805636883, other_time: 24.4475097656
epoch time: 222.9594726563s, input_fired_time: 2.6852636337, output_fired_time: 0.0000000000, propagate_forward_time: 215.6732330322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6009826660
validation[          , genome  5714] predictions:    6216/  10000 (62.16%), best:    6216/10000 (62.16%), error:     11844.16504, best error:     11844.16504 on epoch:    61, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 2962.3505859375s, input_fired_time: 23.1258678436, output_fired_time: 22.8592414856, propagate_forward_time: 1138.7661132813, propagate_backward_time: 1751.3072509766, weight_update_time: 2.3113820553, other_time: 26.2921142578
epoch time: 212.3236236572s, input_fired_time: 2.5427095890, output_fired_time: 0.0000000000, propagate_forward_time: 205.8051605225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9757537842
validation[          , genome  5714] predictions:    6174/  10000 (61.74%), best:    6216/10000 (62.16%), error:     12087.90234, best error:     11844.16504 on epoch:    61, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 2699.6296386719s, input_fired_time: 20.8920154572, output_fired_time: 20.5867443085, propagate_forward_time: 1043.9423828125, propagate_backward_time: 1591.5511474609, weight_update_time: 2.0998017788, other_time: 22.6573486328
epoch time: 211.9393463135s, input_fired_time: 2.5777785778, output_fired_time: 0.0000000000, propagate_forward_time: 205.5004882813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8610839844
validation[          , genome  5714] predictions:    6192/  10000 (61.92%), best:    6216/10000 (62.16%), error:     12040.31445, best error:     11844.16504 on epoch:    61, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 3667.3315429688s, input_fired_time: 22.9558181763, output_fired_time: 21.9949150085, propagate_forward_time: 1804.1179199219, propagate_backward_time: 1790.8128662109, weight_update_time: 2.2929751873, other_time: 27.4500732422
epoch time: 208.9450683594s, input_fired_time: 2.6484096050, output_fired_time: 0.0000000000, propagate_forward_time: 202.1826782227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1139831543
validation[          , genome  5714] predictions:    6132/  10000 (61.32%), best:    6216/10000 (62.16%), error:     11969.34473, best error:     11844.16504 on epoch:    61, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 2528.6569824219s, input_fired_time: 19.8497695923, output_fired_time: 19.3001556396, propagate_forward_time: 968.2782592773, propagate_backward_time: 1498.8267822266, weight_update_time: 1.9617953300, other_time: 22.4019775391
epoch time: 203.9452209473s, input_fired_time: 2.4681096077, output_fired_time: 0.0000000000, propagate_forward_time: 197.5580291748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9190826416
validation[          , genome  5714] predictions:    6194/  10000 (61.94%), best:    6216/10000 (62.16%), error:     11854.25195, best error:     11844.16504 on epoch:    61, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 2490.4982910156s, input_fired_time: 19.7001762390, output_fired_time: 18.6109199524, propagate_forward_time: 954.5220947266, propagate_backward_time: 1475.8914794922, weight_update_time: 1.8918298483, other_time: 21.7736816406
epoch time: 197.3686828613s, input_fired_time: 2.4333922863, output_fired_time: 0.0000000000, propagate_forward_time: 191.0207061768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9145812988
validation[          , genome  5714] predictions:    6221/  10000 (62.21%), best:    6221/10000 (62.21%), error:     11799.54785, best error:     11799.54785 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 2467.1401367188s, input_fired_time: 19.3288593292, output_fired_time: 18.8721637726, propagate_forward_time: 946.2395629883, propagate_backward_time: 1460.5445556641, weight_update_time: 1.9918366671, other_time: 22.1551513672
epoch time: 193.9220733643s, input_fired_time: 2.4090821743, output_fired_time: 0.0000000000, propagate_forward_time: 187.5977172852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9152679443
validation[          , genome  5714] predictions:    6197/  10000 (61.97%), best:    6221/10000 (62.21%), error:     11889.24609, best error:     11799.54785 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 2446.4362792969s, input_fired_time: 19.4885253906, output_fired_time: 18.5256404877, propagate_forward_time: 938.6527099609, propagate_backward_time: 1447.8338623047, weight_update_time: 2.0062673092, other_time: 21.9355468750
epoch time: 192.6804351807s, input_fired_time: 2.4111795425, output_fired_time: 0.0000000000, propagate_forward_time: 186.5108642578, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7583923340
validation[          , genome  5714] predictions:    6227/  10000 (62.27%), best:    6221/10000 (62.21%), error:     11918.80762, best error:     11799.54785 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 2502.5983886719s, input_fired_time: 19.7472515106, output_fired_time: 18.6236553192, propagate_forward_time: 960.9514160156, propagate_backward_time: 1481.1752929688, weight_update_time: 2.0216953754, other_time: 22.1008300781
epoch time: 194.4592285156s, input_fired_time: 2.4585814476, output_fired_time: 0.0000000000, propagate_forward_time: 188.0689544678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9316864014
validation[          , genome  5714] predictions:    6177/  10000 (61.77%), best:    6221/10000 (62.21%), error:     12023.96387, best error:     11799.54785 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 2447.6130371094s, input_fired_time: 19.2828254700, output_fired_time: 18.5051212311, propagate_forward_time: 938.7177734375, propagate_backward_time: 1449.5118408203, weight_update_time: 1.9312591553, other_time: 21.5955810547
epoch time: 195.5701751709s, input_fired_time: 2.3759093285, output_fired_time: 0.0000000000, propagate_forward_time: 189.3260498047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8682098389
validation[          , genome  5714] predictions:    6209/  10000 (62.09%), best:    6221/10000 (62.21%), error:     11969.64355, best error:     11799.54785 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 2530.4311523438s, input_fired_time: 20.2498149872, output_fired_time: 19.1126117706, propagate_forward_time: 969.1829223633, propagate_backward_time: 1499.4227294922, weight_update_time: 1.9227311611, other_time: 22.4632568359
epoch time: 199.8461456299s, input_fired_time: 2.4967095852, output_fired_time: 0.0000000000, propagate_forward_time: 193.3458709717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0035705566
validation[          , genome  5714] predictions:    6214/  10000 (62.14%), best:    6214/10000 (62.14%), error:     11735.07129, best error:     11735.07129 on epoch:    71, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 2499.6855468750s, input_fired_time: 19.7270183563, output_fired_time: 19.0829162598, propagate_forward_time: 962.7691650391, propagate_backward_time: 1476.8568115234, weight_update_time: 1.9322074652, other_time: 21.2495117188
epoch time: 204.3530883789s, input_fired_time: 2.5305860043, output_fired_time: 0.0000000000, propagate_forward_time: 198.0235137939, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7989959717
validation[          , genome  5714] predictions:    6200/  10000 (62.00%), best:    6214/10000 (62.14%), error:     12124.86035, best error:     11735.07129 on epoch:    71, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 2558.8381347656s, input_fired_time: 20.1313076019, output_fired_time: 19.3266887665, propagate_forward_time: 986.8446044922, propagate_backward_time: 1510.6856689453, weight_update_time: 1.9749666452, other_time: 21.8498535156
epoch time: 205.4146423340s, input_fired_time: 2.5581586361, output_fired_time: 0.0000000000, propagate_forward_time: 198.7981719971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0583190918
validation[          , genome  5714] predictions:    6182/  10000 (61.82%), best:    6214/10000 (62.14%), error:     12001.57813, best error:     11735.07129 on epoch:    71, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 2599.1909179688s, input_fired_time: 20.4050807953, output_fired_time: 19.6687335968, propagate_forward_time: 998.2506103516, propagate_backward_time: 1538.4681396484, weight_update_time: 1.9899207354, other_time: 22.3984375000
epoch time: 198.8549041748s, input_fired_time: 2.3954441547, output_fired_time: 0.0000000000, propagate_forward_time: 192.8563232422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6031341553
validation[          , genome  5714] predictions:    6191/  10000 (61.91%), best:    6214/10000 (62.14%), error:     11903.05566, best error:     11735.07129 on epoch:    71, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 2580.7324218750s, input_fired_time: 20.3291625977, output_fired_time: 19.7161369324, propagate_forward_time: 994.4017333984, propagate_backward_time: 1524.5939941406, weight_update_time: 1.9669889212, other_time: 21.6915283203
epoch time: 212.9040069580s, input_fired_time: 2.6166176796, output_fired_time: 0.0000000000, propagate_forward_time: 205.9645996094, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3227844238
validation[          , genome  5714] predictions:    6215/  10000 (62.15%), best:    6214/10000 (62.14%), error:     11900.66895, best error:     11735.07129 on epoch:    71, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 2696.2373046875s, input_fired_time: 21.4594783783, output_fired_time: 20.7753982544, propagate_forward_time: 1037.3747558594, propagate_backward_time: 1592.4396972656, weight_update_time: 2.0713653564, other_time: 24.1879882813
epoch time: 212.1795806885s, input_fired_time: 2.6412518024, output_fired_time: 0.0000000000, propagate_forward_time: 205.2142333984, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3240966797
validation[          , genome  5714] predictions:    6162/  10000 (61.62%), best:    6214/10000 (62.14%), error:     11999.49414, best error:     11735.07129 on epoch:    71, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 2664.4462890625s, input_fired_time: 21.0763301849, output_fired_time: 20.2226905823, propagate_forward_time: 1024.5808105469, propagate_backward_time: 1574.9760742188, weight_update_time: 2.1184642315, other_time: 23.5903320313
epoch time: 231.2645568848s, input_fired_time: 2.9019863605, output_fired_time: 0.0000000000, propagate_forward_time: 223.8071746826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5553894043
validation[          , genome  5714] predictions:    6190/  10000 (61.90%), best:    6214/10000 (62.14%), error:     12017.52539, best error:     11735.07129 on epoch:    71, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 2702.0998535156s, input_fired_time: 21.4160556793, output_fired_time: 20.1528663635, propagate_forward_time: 1057.8627929688, propagate_backward_time: 1579.5909423828, weight_update_time: 2.0488936901, other_time: 23.0772705078
epoch time: 236.4280090332s, input_fired_time: 2.9907467365, output_fired_time: 0.0000000000, propagate_forward_time: 228.8988800049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5383758545
validation[          , genome  5714] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     11693.64258, best error:     11693.64258 on epoch:    78, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 2683.8015136719s, input_fired_time: 20.9338989258, output_fired_time: 20.3399658203, propagate_forward_time: 1045.1601562500, propagate_backward_time: 1574.1357421875, weight_update_time: 2.0918507576, other_time: 23.2319335938
epoch time: 209.2764739990s, input_fired_time: 2.5098471642, output_fired_time: 0.0000000000, propagate_forward_time: 202.6608886719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1057434082
validation[          , genome  5714] predictions:    6208/  10000 (62.08%), best:    6274/10000 (62.74%), error:     11951.22461, best error:     11693.64258 on epoch:    78, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 2574.3205566406s, input_fired_time: 20.2756137848, output_fired_time: 19.3194751740, propagate_forward_time: 1005.7836914063, propagate_backward_time: 1506.7427978516, weight_update_time: 2.0049099922, other_time: 22.1988525391
epoch time: 207.0866699219s, input_fired_time: 2.5672307014, output_fired_time: 0.0000000000, propagate_forward_time: 200.6072540283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9121856689
validation[          , genome  5714] predictions:    6234/  10000 (62.34%), best:    6274/10000 (62.74%), error:     11890.40820, best error:     11693.64258 on epoch:    78, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 2592.6787109375s, input_fired_time: 20.2409725189, output_fired_time: 19.3662567139, propagate_forward_time: 1011.8773803711, propagate_backward_time: 1518.8696289063, weight_update_time: 2.0048296452, other_time: 22.3244628906
epoch time: 228.8755798340s, input_fired_time: 2.7851948738, output_fired_time: 0.0000000000, propagate_forward_time: 221.7293701172, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3610076904
validation[          , genome  5714] predictions:    6289/  10000 (62.89%), best:    6274/10000 (62.74%), error:     11774.61230, best error:     11693.64258 on epoch:    78, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 2572.5563964844s, input_fired_time: 20.0689716339, output_fired_time: 19.1797561646, propagate_forward_time: 1005.8499755859, propagate_backward_time: 1505.3560791016, weight_update_time: 1.9570630789, other_time: 22.1015625000
epoch time: 296.8687438965s, input_fired_time: 3.6944773197, output_fired_time: 0.0000000000, propagate_forward_time: 287.5358886719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6383666992
validation[          , genome  5714] predictions:    6121/  10000 (61.21%), best:    6274/10000 (62.74%), error:     12158.35352, best error:     11693.64258 on epoch:    78, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 2583.4089355469s, input_fired_time: 20.1266517639, output_fired_time: 19.3585433960, propagate_forward_time: 1008.1351928711, propagate_backward_time: 1513.4766845703, weight_update_time: 1.9134564400, other_time: 22.3116455078
epoch time: 205.7235412598s, input_fired_time: 2.4731807709, output_fired_time: 0.0000000000, propagate_forward_time: 199.3551483154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8952178955
validation[          , genome  5714] predictions:    6260/  10000 (62.60%), best:    6274/10000 (62.74%), error:     11855.29590, best error:     11693.64258 on epoch:    78, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 2563.2385253906s, input_fired_time: 20.0868797302, output_fired_time: 19.6156177521, propagate_forward_time: 1000.9606933594, propagate_backward_time: 1500.7303466797, weight_update_time: 1.9367051125, other_time: 21.8448486328
epoch time: 206.7013854980s, input_fired_time: 2.4520235062, output_fired_time: 0.0000000000, propagate_forward_time: 200.4227600098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8265991211
validation[          , genome  5714] predictions:    6265/  10000 (62.65%), best:    6274/10000 (62.74%), error:     11855.79785, best error:     11693.64258 on epoch:    78, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 2572.2392578125s, input_fired_time: 20.3826828003, output_fired_time: 19.3110046387, propagate_forward_time: 1006.1970214844, propagate_backward_time: 1504.0861816406, weight_update_time: 1.9866224527, other_time: 22.2624511719
epoch time: 205.6490631104s, input_fired_time: 2.5068712234, output_fired_time: 0.0000000000, propagate_forward_time: 199.2101593018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9320373535
validation[          , genome  5714] predictions:    6263/  10000 (62.63%), best:    6274/10000 (62.74%), error:     11980.94922, best error:     11693.64258 on epoch:    78, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 2554.3898925781s, input_fired_time: 19.7788925171, output_fired_time: 19.0149650574, propagate_forward_time: 995.5605468750, propagate_backward_time: 1498.3391113281, weight_update_time: 1.9124929905, other_time: 21.6965332031
epoch time: 210.5793304443s, input_fired_time: 2.6503703594, output_fired_time: 0.0000000000, propagate_forward_time: 203.9854431152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9435119629
validation[          , genome  5714] predictions:    6256/  10000 (62.56%), best:    6274/10000 (62.74%), error:     12022.65527, best error:     11693.64258 on epoch:    78, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 2559.2797851563s, input_fired_time: 19.8485336304, output_fired_time: 19.0219383240, propagate_forward_time: 996.7540283203, propagate_backward_time: 1502.7365722656, weight_update_time: 1.8660782576, other_time: 20.9185791016
epoch time: 207.5739898682s, input_fired_time: 2.4310915470, output_fired_time: 0.0000000000, propagate_forward_time: 201.4157562256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7271423340
validation[          , genome  5714] predictions:    6256/  10000 (62.56%), best:    6274/10000 (62.74%), error:     11938.55566, best error:     11693.64258 on epoch:    78, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 2583.6762695313s, input_fired_time: 19.9116535187, output_fired_time: 19.5254745483, propagate_forward_time: 1004.0851440430, propagate_backward_time: 1519.0876464844, weight_update_time: 1.9384963512, other_time: 21.0664062500
epoch time: 201.4561157227s, input_fired_time: 2.4860839844, output_fired_time: 0.0000000000, propagate_forward_time: 195.3225860596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6474456787
validation[          , genome  5714] predictions:    6223/  10000 (62.23%), best:    6274/10000 (62.74%), error:     11815.42188, best error:     11693.64258 on epoch:    78, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 2469.9189453125s, input_fired_time: 19.1037292480, output_fired_time: 18.2903385162, propagate_forward_time: 956.2427368164, propagate_backward_time: 1455.6043701172, weight_update_time: 1.8533080816, other_time: 20.6778564453
epoch time: 196.0467376709s, input_fired_time: 2.4393861294, output_fired_time: 0.0000000000, propagate_forward_time: 190.0333557129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5739898682
validation[          , genome  5714] predictions:    6246/  10000 (62.46%), best:    6274/10000 (62.74%), error:     11894.57031, best error:     11693.64258 on epoch:    78, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 2474.3127441406s, input_fired_time: 19.1313800812, output_fired_time: 18.1817417145, propagate_forward_time: 956.0330810547, propagate_backward_time: 1460.3505859375, weight_update_time: 1.8536055088, other_time: 20.6160888672
epoch time: 194.7555084229s, input_fired_time: 2.4019169807, output_fired_time: 0.0000000000, propagate_forward_time: 188.8090820313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5445098877
validation[          , genome  5714] predictions:    6180/  10000 (61.80%), best:    6274/10000 (62.74%), error:     12052.50195, best error:     11693.64258 on epoch:    78, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 2451.1157226563s, input_fired_time: 19.2639007568, output_fired_time: 18.1299839020, propagate_forward_time: 945.8239135742, propagate_backward_time: 1447.6392822266, weight_update_time: 1.8644092083, other_time: 20.2586669922
epoch time: 195.6211547852s, input_fired_time: 2.3982954025, output_fired_time: 0.0000000000, propagate_forward_time: 189.6945953369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5282592773
validation[          , genome  5714] predictions:    6254/  10000 (62.54%), best:    6274/10000 (62.74%), error:     11870.90234, best error:     11693.64258 on epoch:    78, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 2455.4460449219s, input_fired_time: 19.0388107300, output_fired_time: 18.0734710693, propagate_forward_time: 948.4187011719, propagate_backward_time: 1449.3909912109, weight_update_time: 1.9055111408, other_time: 20.5240478516
epoch time: 194.6742248535s, input_fired_time: 2.4293889999, output_fired_time: 0.0000000000, propagate_forward_time: 188.7074279785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5374145508
validation[          , genome  5714] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     11876.35742, best error:     11693.64258 on epoch:    78, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 2482.4248046875s, input_fired_time: 19.3775672913, output_fired_time: 18.3355560303, propagate_forward_time: 959.6336059570, propagate_backward_time: 1464.5083007813, weight_update_time: 1.8866847754, other_time: 20.5698242188
epoch time: 195.3881530762s, input_fired_time: 2.3937880993, output_fired_time: 0.0000000000, propagate_forward_time: 189.4116058350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5827636719
validation[          , genome  5714] predictions:    6226/  10000 (62.26%), best:    6274/10000 (62.74%), error:     12091.48242, best error:     11693.64258 on epoch:    78, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 2480.0800781250s, input_fired_time: 19.3455753326, output_fired_time: 18.5044364929, propagate_forward_time: 958.1278076172, propagate_backward_time: 1463.6507568359, weight_update_time: 1.8689892292, other_time: 20.4516601563
epoch time: 195.5662078857s, input_fired_time: 2.4237792492, output_fired_time: 0.0000000000, propagate_forward_time: 189.5207824707, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6216430664
validation[          , genome  5714] predictions:    6257/  10000 (62.57%), best:    6274/10000 (62.74%), error:     11934.13867, best error:     11693.64258 on epoch:    78, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 2453.6625976563s, input_fired_time: 19.1707878113, output_fired_time: 18.1131210327, propagate_forward_time: 947.4985351563, propagate_backward_time: 1448.6048583984, weight_update_time: 1.8489347696, other_time: 20.2752685547
epoch time: 194.0749816895s, input_fired_time: 2.3627099991, output_fired_time: 0.0000000000, propagate_forward_time: 188.1808929443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5313720703
validation[          , genome  5714] predictions:    6171/  10000 (61.71%), best:    6274/10000 (62.74%), error:     12091.37109, best error:     11693.64258 on epoch:    78, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 2474.1989746094s, input_fired_time: 19.5667362213, output_fired_time: 18.2856407166, propagate_forward_time: 956.2989501953, propagate_backward_time: 1459.5390625000, weight_update_time: 1.8984670639, other_time: 20.5086669922
epoch time: 194.6608428955s, input_fired_time: 2.4280633926, output_fired_time: 0.0000000000, propagate_forward_time: 188.6837615967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5490112305
validation[          , genome  5714] predictions:    6301/  10000 (63.01%), best:    6274/10000 (62.74%), error:     11803.59668, best error:     11693.64258 on epoch:    78, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 2459.1354980469s, input_fired_time: 19.1826896667, output_fired_time: 18.2077045441, propagate_forward_time: 949.5330200195, propagate_backward_time: 1451.9466552734, weight_update_time: 1.8566908836, other_time: 20.2655029297
epoch time: 194.5646514893s, input_fired_time: 2.4332492352, output_fired_time: 0.0000000000, propagate_forward_time: 188.5568084717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5746002197
validation[          , genome  5714] predictions:    6264/  10000 (62.64%), best:    6274/10000 (62.74%), error:     11989.26172, best error:     11693.64258 on epoch:    78, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 45795.0156250000s, input_fired_time: 18.3484458923, output_fired_time: 17.1470317841, propagate_forward_time: 44313.2109375000, propagate_backward_time: 1427.9963378906, weight_update_time: 1.8431537151, other_time: 18.3122558594
epoch time: 189.2499084473s, input_fired_time: 2.3534991741, output_fired_time: 0.0000000000, propagate_forward_time: 183.5835266113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3128814697
validation[          , genome  5714] predictions:    6265/  10000 (62.65%), best:    6274/10000 (62.74%), error:     11855.88086, best error:     11693.64258 on epoch:    78, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 2440.8188476563s, input_fired_time: 19.3102684021, output_fired_time: 17.4099578857, propagate_forward_time: 928.8834838867, propagate_backward_time: 1456.1478271484, weight_update_time: 1.7738715410, other_time: 19.0672607422
epoch time: 183.5832977295s, input_fired_time: 2.3164258003, output_fired_time: 0.0000000000, propagate_forward_time: 178.0593414307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2075347900
validation[          , genome  5714] predictions:    6262/  10000 (62.62%), best:    6274/10000 (62.74%), error:     11916.23438, best error:     11693.64258 on epoch:    78, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 2358.4333496094s, input_fired_time: 18.2025909424, output_fired_time: 16.8431949615, propagate_forward_time: 898.1336669922, propagate_backward_time: 1406.9252929688, weight_update_time: 1.7581593990, other_time: 18.3284912109
epoch time: 183.4126892090s, input_fired_time: 2.2621281147, output_fired_time: 0.0000000000, propagate_forward_time: 177.8994140625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2511444092
validation[          , genome  5714] predictions:    6263/  10000 (62.63%), best:    6274/10000 (62.74%), error:     12034.19434, best error:     11693.64258 on epoch:    78, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 938.7124023438s, input_fired_time: 11.6752443314, output_fired_time: 0.0000000000, propagate_forward_time: 910.5361328125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.5010375977
best training[          , genome  5714] predictions:   41586/  50000 (83.17%), best:    6274/10000 (62.74%), error:     25874.28125, best error:     11693.64258 on epoch:    78, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 188.5050048828s, input_fired_time: 2.4047884941, output_fired_time: 0.0000000000, propagate_forward_time: 181.3483581543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7518615723
   testing[          , genome  5714] predictions:    6274/  10000 (62.74%), best:    6274/10000 (62.74%), error:     11693.64258, best error:     11693.64258 on epoch:    78, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
05:50:34 (22104): called boinc_finish(0)

</stderr_txt>
]]>