Nameexact_genome_1542692703_183_6374_2
Workunit4100250
Created20 Nov 2018, 7:03:18 UTC
Sent20 Nov 2018, 7:18:48 UTC
Report deadline4 Feb 2019, 5:40:29 UTC
Received21 Nov 2018, 7:05:50 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID44167
Run time22 hours 39 min 43 sec
CPU time22 hours 4 min 24 sec
Validate stateValid
Credit18,982.93
Device peak FLOPS3.88 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size522.41 MB
Peak swap size542.13 MB
Peak disk usage9.80 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
329834, propagate_backward_time: 434.8379211426, weight_update_time: 0.9360694289, other_time: 9.6526184082
epoch time: 52.7299232483s, input_fired_time: 0.7686532140, output_fired_time: 0.0000000000, propagate_forward_time: 50.3242378235, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6370315552
validation[          , genome  6374] predictions:    5343/  10000 (53.43%), best:    5465/10000 (54.65%), error:     14130.00684, best error:     13606.82031 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 747.8767700195s, input_fired_time: 6.6573328972, output_fired_time: 5.3972234726, propagate_forward_time: 248.2522735596, propagate_backward_time: 478.1704406738, weight_update_time: 0.9309782386, other_time: 9.3995056152
epoch time: 50.4646530151s, input_fired_time: 0.7345469594, output_fired_time: 0.0000000000, propagate_forward_time: 48.1985244751, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5315818787
validation[          , genome  6374] predictions:    5370/  10000 (53.70%), best:    5465/10000 (54.65%), error:     14013.49902, best error:     13606.82031 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 749.9227905273s, input_fired_time: 9.4813585281, output_fired_time: 7.9443874359, propagate_forward_time: 263.4684753418, propagate_backward_time: 454.4434204102, weight_update_time: 1.1605653763, other_time: 14.5851135254
epoch time: 61.1058502197s, input_fired_time: 1.6236264706, output_fired_time: 0.0000000000, propagate_forward_time: 55.7265129089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7557106018
validation[          , genome  6374] predictions:    5492/  10000 (54.92%), best:    5465/10000 (54.65%), error:     13805.43164, best error:     13606.82031 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 763.4974365234s, input_fired_time: 10.6981306076, output_fired_time: 8.7567234039, propagate_forward_time: 267.8092651367, propagate_backward_time: 458.7072143555, weight_update_time: 1.2732075453, other_time: 17.5261230469
epoch time: 57.3210678101s, input_fired_time: 1.0471774340, output_fired_time: 0.0000000000, propagate_forward_time: 54.1641120911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1097793579
validation[          , genome  6374] predictions:    5700/  10000 (57.00%), best:    5700/10000 (57.00%), error:     13305.44922, best error:     13305.44922 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 705.2740478516s, input_fired_time: 6.5989794731, output_fired_time: 5.1828579903, propagate_forward_time: 255.7988739014, propagate_backward_time: 428.6404113770, weight_update_time: 0.8997679353, other_time: 9.0528869629
epoch time: 49.7199287415s, input_fired_time: 0.7463204265, output_fired_time: 0.0000000000, propagate_forward_time: 47.4949607849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4786491394
validation[          , genome  6374] predictions:    5766/  10000 (57.66%), best:    5766/10000 (57.66%), error:     12859.36816, best error:     12859.36816 on epoch:    19, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 744.0300292969s, input_fired_time: 8.6468868256, output_fired_time: 6.9840798378, propagate_forward_time: 264.3162231445, propagate_backward_time: 451.2634582520, weight_update_time: 1.0666701794, other_time: 12.8193664551
epoch time: 58.7701072693s, input_fired_time: 1.4847679138, output_fired_time: 0.0000000000, propagate_forward_time: 53.5094528198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7758865356
validation[          , genome  6374] predictions:    5737/  10000 (57.37%), best:    5766/10000 (57.66%), error:     13061.77441, best error:     12859.36816 on epoch:    19, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 754.2854003906s, input_fired_time: 10.2021408081, output_fired_time: 8.1374921799, propagate_forward_time: 265.8288879395, propagate_backward_time: 453.1540527344, weight_update_time: 1.2841368914, other_time: 16.9627990723
epoch time: 61.0749664307s, input_fired_time: 1.5585398674, output_fired_time: 0.0000000000, propagate_forward_time: 55.5944976807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9219284058
validation[          , genome  6374] predictions:    5719/  10000 (57.19%), best:    5766/10000 (57.66%), error:     13552.58496, best error:     12859.36816 on epoch:    19, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 784.3787231445s, input_fired_time: 11.7807416916, output_fired_time: 9.7847623825, propagate_forward_time: 273.2114562988, propagate_backward_time: 469.3251037598, weight_update_time: 1.3951245546, other_time: 20.2766113281
epoch time: 60.3554534912s, input_fired_time: 1.6770995855, output_fired_time: 0.0000000000, propagate_forward_time: 54.7237167358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9546356201
validation[          , genome  6374] predictions:    5568/  10000 (55.68%), best:    5766/10000 (57.66%), error:     13938.41016, best error:     12859.36816 on epoch:    19, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 702.4357910156s, input_fired_time: 6.7381386757, output_fired_time: 5.4076609612, propagate_forward_time: 257.7862854004, propagate_backward_time: 423.3307189941, weight_update_time: 0.8942040801, other_time: 9.1729736328
epoch time: 55.4993934631s, input_fired_time: 1.1571171284, output_fired_time: 0.0000000000, propagate_forward_time: 51.6016845703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7405929565
validation[          , genome  6374] predictions:    5842/  10000 (58.42%), best:    5842/10000 (58.42%), error:     12856.85352, best error:     12856.85352 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 772.8984375000s, input_fired_time: 9.5113439560, output_fired_time: 7.8059091568, propagate_forward_time: 266.7912292480, propagate_backward_time: 474.3237915039, weight_update_time: 1.1085290909, other_time: 14.4661560059
epoch time: 54.3225250244s, input_fired_time: 0.8101510406, output_fired_time: 0.0000000000, propagate_forward_time: 51.9004249573, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6119499207
validation[          , genome  6374] predictions:    5357/  10000 (53.57%), best:    5842/10000 (58.42%), error:     14631.32324, best error:     12856.85352 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 701.3295288086s, input_fired_time: 7.3221678734, output_fired_time: 5.7710180283, propagate_forward_time: 249.9822692871, propagate_backward_time: 427.8852844238, weight_update_time: 0.9672812819, other_time: 10.3688354492
epoch time: 49.5422401428s, input_fired_time: 0.7691574097, output_fired_time: 0.0000000000, propagate_forward_time: 47.3019561768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4711265564
validation[          , genome  6374] predictions:    5645/  10000 (56.45%), best:    5842/10000 (58.42%), error:     13293.76270, best error:     12856.85352 on epoch:    23, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 724.4976806641s, input_fired_time: 8.6435337067, output_fired_time: 6.8529734612, propagate_forward_time: 253.3913879395, propagate_backward_time: 442.4200744629, weight_update_time: 1.0802680254, other_time: 13.1896972656
epoch time: 49.6505241394s, input_fired_time: 0.7564641833, output_fired_time: 0.0000000000, propagate_forward_time: 47.3655204773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5285377502
validation[          , genome  6374] predictions:    5680/  10000 (56.80%), best:    5842/10000 (58.42%), error:     13327.65039, best error:     12856.85352 on epoch:    23, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 749.2912597656s, input_fired_time: 8.9368257523, output_fired_time: 6.7810525894, propagate_forward_time: 271.1098632813, propagate_backward_time: 449.6266479492, weight_update_time: 1.0721043348, other_time: 12.8368530273
epoch time: 61.5756721497s, input_fired_time: 1.6031388044, output_fired_time: 0.0000000000, propagate_forward_time: 56.2407760620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7317581177
validation[          , genome  6374] predictions:    5597/  10000 (55.97%), best:    5842/10000 (58.42%), error:     13461.82129, best error:     12856.85352 on epoch:    23, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 815.7518310547s, input_fired_time: 12.9793529510, output_fired_time: 10.7729148865, propagate_forward_time: 280.9772338867, propagate_backward_time: 489.8496093750, weight_update_time: 1.3787517548, other_time: 21.1727294922
epoch time: 61.9318466187s, input_fired_time: 1.6938779354, output_fired_time: 0.0000000000, propagate_forward_time: 56.3422164917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8957519531
validation[          , genome  6374] predictions:    5740/  10000 (57.40%), best:    5842/10000 (58.42%), error:     13297.20898, best error:     12856.85352 on epoch:    23, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 758.0105590820s, input_fired_time: 11.6604719162, output_fired_time: 9.1594762802, propagate_forward_time: 264.3983459473, propagate_backward_time: 452.5998229980, weight_update_time: 1.3650337458, other_time: 20.1924438477
epoch time: 56.7611846924s, input_fired_time: 1.4273033142, output_fired_time: 0.0000000000, propagate_forward_time: 51.6673431396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6665382385
validation[          , genome  6374] predictions:    6073/  10000 (60.73%), best:    6073/10000 (60.73%), error:     11972.61816, best error:     11972.61816 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 738.0528564453s, input_fired_time: 11.3760499954, output_fired_time: 9.0847396851, propagate_forward_time: 258.0711669922, propagate_backward_time: 438.9606018066, weight_update_time: 1.3760873079, other_time: 20.5603332520
epoch time: 56.5776557922s, input_fired_time: 1.4361307621, output_fired_time: 0.0000000000, propagate_forward_time: 51.4696922302, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6718330383
validation[          , genome  6374] predictions:    5878/  10000 (58.78%), best:    6073/10000 (60.73%), error:     12512.96094, best error:     11972.61816 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 746.9001464844s, input_fired_time: 11.6018981934, output_fired_time: 9.3516321182, propagate_forward_time: 261.1849975586, propagate_backward_time: 444.0724182129, weight_update_time: 1.3793305159, other_time: 20.6891784668
epoch time: 59.9636878967s, input_fired_time: 1.6673527956, output_fired_time: 0.0000000000, propagate_forward_time: 54.4161262512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8802070618
validation[          , genome  6374] predictions:    5988/  10000 (59.88%), best:    6073/10000 (60.73%), error:     12311.45020, best error:     11972.61816 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 781.2469482422s, input_fired_time: 12.5405321121, output_fired_time: 10.1810026169, propagate_forward_time: 270.6992492676, propagate_backward_time: 466.9808349609, weight_update_time: 1.3899787664, other_time: 20.8453063965
epoch time: 59.6008453369s, input_fired_time: 1.6659790277, output_fired_time: 0.0000000000, propagate_forward_time: 54.0954246521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8394432068
validation[          , genome  6374] predictions:    5862/  10000 (58.62%), best:    6073/10000 (60.73%), error:     12859.45020, best error:     11972.61816 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 734.0766601563s, input_fired_time: 11.1588850021, output_fired_time: 8.6717643738, propagate_forward_time: 257.1956787109, propagate_backward_time: 436.8326110840, weight_update_time: 1.3579525948, other_time: 20.2177429199
epoch time: 56.0495567322s, input_fired_time: 1.4335536957, output_fired_time: 0.0000000000, propagate_forward_time: 50.9520111084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6639938354
validation[          , genome  6374] predictions:    5710/  10000 (57.10%), best:    6073/10000 (60.73%), error:     12998.77148, best error:     11972.61816 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 726.9906005859s, input_fired_time: 11.0179357529, output_fired_time: 8.5524682999, propagate_forward_time: 255.1378784180, propagate_backward_time: 432.1632690430, weight_update_time: 1.3567847013, other_time: 20.1190185547
epoch time: 57.4483337402s, input_fired_time: 1.4637086391, output_fired_time: 0.0000000000, propagate_forward_time: 52.2563552856, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7282714844
validation[          , genome  6374] predictions:    5850/  10000 (58.50%), best:    6073/10000 (60.73%), error:     12993.81934, best error:     11972.61816 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 732.9483032227s, input_fired_time: 10.9008884430, output_fired_time: 8.4988107681, propagate_forward_time: 257.3364257813, propagate_backward_time: 436.3495788574, weight_update_time: 1.3499846458, other_time: 19.8625793457
epoch time: 60.0037765503s, input_fired_time: 1.5780438185, output_fired_time: 0.0000000000, propagate_forward_time: 54.7199630737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7057685852
validation[          , genome  6374] predictions:    5934/  10000 (59.34%), best:    6073/10000 (60.73%), error:     12235.72461, best error:     11972.61816 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 772.8077392578s, input_fired_time: 12.4838466644, output_fired_time: 9.5056343079, propagate_forward_time: 273.4447021484, propagate_backward_time: 456.7643432617, weight_update_time: 1.3711130619, other_time: 20.6092529297
epoch time: 61.3791122437s, input_fired_time: 1.7972636223, output_fired_time: 0.0000000000, propagate_forward_time: 55.5083961487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0734519958
validation[          , genome  6374] predictions:    6083/  10000 (60.83%), best:    6083/10000 (60.83%), error:     11850.79785, best error:     11850.79785 on epoch:    36, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 772.3779907227s, input_fired_time: 12.4397888184, output_fired_time: 9.5413560867, propagate_forward_time: 272.5878906250, propagate_backward_time: 457.3190307617, weight_update_time: 1.3726788759, other_time: 20.4899291992
epoch time: 58.7550048828s, input_fired_time: 1.5276552439, output_fired_time: 0.0000000000, propagate_forward_time: 53.6227836609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6045646667
validation[          , genome  6374] predictions:    6084/  10000 (60.84%), best:    6083/10000 (60.83%), error:     12061.72559, best error:     11850.79785 on epoch:    36, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 779.5340576172s, input_fired_time: 12.5635204315, output_fired_time: 9.9894056320, propagate_forward_time: 272.6458435059, propagate_backward_time: 463.6812744141, weight_update_time: 1.3837411404, other_time: 20.6540222168
epoch time: 59.2651405334s, input_fired_time: 1.5220253468, output_fired_time: 0.0000000000, propagate_forward_time: 54.3095512390, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4335632324
validation[          , genome  6374] predictions:    6121/  10000 (61.21%), best:    6121/10000 (61.21%), error:     11820.02051, best error:     11820.02051 on epoch:    38, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 767.3848266602s, input_fired_time: 12.0312910080, output_fired_time: 9.5371551514, propagate_forward_time: 267.8266906738, propagate_backward_time: 457.9211730957, weight_update_time: 1.3634068966, other_time: 20.0684814453
epoch time: 58.2483367920s, input_fired_time: 1.6321214437, output_fired_time: 0.0000000000, propagate_forward_time: 52.7786331177, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8375816345
validation[          , genome  6374] predictions:    6133/  10000 (61.33%), best:    6133/10000 (61.33%), error:     11671.68848, best error:     11671.68848 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 740.2349853516s, input_fired_time: 11.3852720261, output_fired_time: 8.9895439148, propagate_forward_time: 258.8834838867, propagate_backward_time: 440.7676696777, weight_update_time: 1.3414802551, other_time: 20.2090148926
epoch time: 56.5419082642s, input_fired_time: 1.4524383545, output_fired_time: 0.0000000000, propagate_forward_time: 51.5381317139, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5513381958
validation[          , genome  6374] predictions:    5972/  10000 (59.72%), best:    6133/10000 (61.33%), error:     12131.40918, best error:     11671.68848 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 753.7614746094s, input_fired_time: 11.6338291168, output_fired_time: 9.2646369934, propagate_forward_time: 263.1409301758, propagate_backward_time: 448.8842773438, weight_update_time: 1.3847312927, other_time: 20.8377685547
epoch time: 56.7490997314s, input_fired_time: 1.4526281357, output_fired_time: 0.0000000000, propagate_forward_time: 51.7270050049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5694656372
validation[          , genome  6374] predictions:    6053/  10000 (60.53%), best:    6133/10000 (61.33%), error:     12077.03320, best error:     11671.68848 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 799.2087402344s, input_fired_time: 12.6248321533, output_fired_time: 10.3124465942, propagate_forward_time: 275.6310119629, propagate_backward_time: 479.5197143555, weight_update_time: 1.4052054882, other_time: 21.1207580566
epoch time: 60.2741012573s, input_fired_time: 1.6582260132, output_fired_time: 0.0000000000, propagate_forward_time: 54.8187980652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7970771790
validation[          , genome  6374] predictions:    5979/  10000 (59.79%), best:    6133/10000 (61.33%), error:     12685.02148, best error:     11671.68848 on epoch:    39, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 756.8950805664s, input_fired_time: 11.8301410675, output_fired_time: 9.2813301086, propagate_forward_time: 264.0808410645, propagate_backward_time: 451.4041748047, weight_update_time: 1.3741712570, other_time: 20.2986145020
epoch time: 56.2484817505s, input_fired_time: 1.4343515635, output_fired_time: 0.0000000000, propagate_forward_time: 51.2759552002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5381736755
validation[          , genome  6374] predictions:    6139/  10000 (61.39%), best:    6133/10000 (61.33%), error:     11922.05957, best error:     11671.68848 on epoch:    39, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 736.8818969727s, input_fired_time: 11.4264173508, output_fired_time: 8.9144182205, propagate_forward_time: 257.5575256348, propagate_backward_time: 438.7138061523, weight_update_time: 1.3772178888, other_time: 20.2697448730
epoch time: 56.4643669128s, input_fired_time: 1.4337184429, output_fired_time: 0.0000000000, propagate_forward_time: 51.4952163696, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5354309082
validation[          , genome  6374] predictions:    6164/  10000 (61.64%), best:    6133/10000 (61.33%), error:     11754.50000, best error:     11671.68848 on epoch:    39, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 738.8298339844s, input_fired_time: 11.4082050323, output_fired_time: 8.9134664536, propagate_forward_time: 258.2911987305, propagate_backward_time: 440.2326354980, weight_update_time: 1.3614329100, other_time: 19.9843444824
epoch time: 58.9057083130s, input_fired_time: 1.6571830511, output_fired_time: 0.0000000000, propagate_forward_time: 53.5084457397, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7400779724
validation[          , genome  6374] predictions:    6110/  10000 (61.10%), best:    6133/10000 (61.33%), error:     11731.06152, best error:     11671.68848 on epoch:    39, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 775.0042114258s, input_fired_time: 12.3133459091, output_fired_time: 9.6025123596, propagate_forward_time: 268.7635498047, propagate_backward_time: 463.8096923828, weight_update_time: 1.3876752853, other_time: 20.5150756836
epoch time: 58.7111663818s, input_fired_time: 1.6064387560, output_fired_time: 0.0000000000, propagate_forward_time: 53.4891738892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6155548096
validation[          , genome  6374] predictions:    6084/  10000 (60.84%), best:    6133/10000 (61.33%), error:     12011.12988, best error:     11671.68848 on epoch:    39, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 774.7711791992s, input_fired_time: 11.8911781311, output_fired_time: 8.7592744827, propagate_forward_time: 270.5865173340, propagate_backward_time: 463.1818237305, weight_update_time: 1.3690435886, other_time: 20.3523864746
epoch time: 57.9603233337s, input_fired_time: 1.4997137785, output_fired_time: 0.0000000000, propagate_forward_time: 52.9857101440, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4748992920
validation[          , genome  6374] predictions:    6108/  10000 (61.08%), best:    6133/10000 (61.33%), error:     11858.00391, best error:     11671.68848 on epoch:    39, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 764.7780761719s, input_fired_time: 11.5318078995, output_fired_time: 8.4924650192, propagate_forward_time: 266.7813720703, propagate_backward_time: 457.5375366211, weight_update_time: 1.3660484552, other_time: 20.4348754883
epoch time: 57.4771347046s, input_fired_time: 1.4737046957, output_fired_time: 0.0000000000, propagate_forward_time: 52.4682121277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5352172852
validation[          , genome  6374] predictions:    6022/  10000 (60.22%), best:    6133/10000 (61.33%), error:     12208.06250, best error:     11671.68848 on epoch:    39, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 765.2725219727s, input_fired_time: 11.4611587524, output_fired_time: 8.5079097748, propagate_forward_time: 266.7813110352, propagate_backward_time: 457.8005371094, weight_update_time: 1.4111911058, other_time: 20.7215576172
epoch time: 57.2059707642s, input_fired_time: 1.4655669928, output_fired_time: 0.0000000000, propagate_forward_time: 52.2306098938, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5097923279
validation[          , genome  6374] predictions:    5968/  10000 (59.68%), best:    6133/10000 (61.33%), error:     12711.72363, best error:     11671.68848 on epoch:    39, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 733.2475585938s, input_fired_time: 9.3851003647, output_fired_time: 7.1572237015, propagate_forward_time: 257.7068481445, propagate_backward_time: 442.4862976074, weight_update_time: 1.1883206367, other_time: 16.5121154785
epoch time: 56.0180168152s, input_fired_time: 1.4318020344, output_fired_time: 0.0000000000, propagate_forward_time: 51.0919494629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4942665100
validation[          , genome  6374] predictions:    6051/  10000 (60.51%), best:    6133/10000 (61.33%), error:     12039.39551, best error:     11671.68848 on epoch:    39, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 733.7411499023s, input_fired_time: 11.3624343872, output_fired_time: 8.8629713058, propagate_forward_time: 256.3916015625, propagate_backward_time: 436.7370605469, weight_update_time: 1.3640636206, other_time: 20.3870849609
epoch time: 55.7350463867s, input_fired_time: 1.4143551588, output_fired_time: 0.0000000000, propagate_forward_time: 50.7335777283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5871124268
validation[          , genome  6374] predictions:    6216/  10000 (62.16%), best:    6216/10000 (62.16%), error:     11472.96875, best error:     11472.96875 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 734.0512695313s, input_fired_time: 11.3093795776, output_fired_time: 8.8254632950, propagate_forward_time: 256.3805236816, propagate_backward_time: 437.3868713379, weight_update_time: 1.3606318235, other_time: 20.1490478516
epoch time: 56.1228370667s, input_fired_time: 1.4310543537, output_fired_time: 0.0000000000, propagate_forward_time: 51.0733184814, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6184654236
validation[          , genome  6374] predictions:    5978/  10000 (59.78%), best:    6216/10000 (62.16%), error:     12449.16016, best error:     11472.96875 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 754.9348754883s, input_fired_time: 12.0383558273, output_fired_time: 9.5665683746, propagate_forward_time: 261.9839477539, propagate_backward_time: 451.2190856934, weight_update_time: 1.3868035078, other_time: 20.1269226074
epoch time: 57.8360710144s, input_fired_time: 1.5205110312, output_fired_time: 0.0000000000, propagate_forward_time: 52.6981391907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6174201965
validation[          , genome  6374] predictions:    6075/  10000 (60.75%), best:    6216/10000 (62.16%), error:     11917.98047, best error:     11472.96875 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 756.3758544922s, input_fired_time: 11.9095802307, output_fired_time: 9.2961311340, propagate_forward_time: 262.9196777344, propagate_backward_time: 452.0676879883, weight_update_time: 1.3631118536, other_time: 20.1827392578
epoch time: 57.8285217285s, input_fired_time: 1.5177192688, output_fired_time: 0.0000000000, propagate_forward_time: 52.6397247314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6710777283
validation[          , genome  6374] predictions:    6173/  10000 (61.73%), best:    6216/10000 (62.16%), error:     11560.04883, best error:     11472.96875 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 749.0446166992s, input_fired_time: 11.6383914948, output_fired_time: 8.9607915878, propagate_forward_time: 262.5265197754, propagate_backward_time: 445.6083984375, weight_update_time: 1.3637959957, other_time: 20.3105163574
epoch time: 58.1832695007s, input_fired_time: 1.5420919657, output_fired_time: 0.0000000000, propagate_forward_time: 52.9189186096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7222595215
validation[          , genome  6374] predictions:    6175/  10000 (61.75%), best:    6216/10000 (62.16%), error:     11677.67676, best error:     11472.96875 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 749.8770141602s, input_fired_time: 11.6194047928, output_fired_time: 8.9076089859, propagate_forward_time: 262.7605895996, propagate_backward_time: 446.1980895996, weight_update_time: 1.3425134420, other_time: 20.3913574219
epoch time: 57.1238632202s, input_fired_time: 1.4874093533, output_fired_time: 0.0000000000, propagate_forward_time: 51.9272651672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7091903687
validation[          , genome  6374] predictions:    6197/  10000 (61.97%), best:    6216/10000 (62.16%), error:     11501.89063, best error:     11472.96875 on epoch:    51, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 767.7933349609s, input_fired_time: 11.8746604919, output_fired_time: 9.1411523819, propagate_forward_time: 267.7193908691, propagate_backward_time: 458.6976318359, weight_update_time: 1.3526767492, other_time: 20.3605041504
epoch time: 58.6395950317s, input_fired_time: 1.5448614359, output_fired_time: 0.0000000000, propagate_forward_time: 53.4509086609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6438255310
validation[          , genome  6374] predictions:    6184/  10000 (61.84%), best:    6216/10000 (62.16%), error:     11479.30078, best error:     11472.96875 on epoch:    51, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 767.8544311523s, input_fired_time: 12.2060403824, output_fired_time: 9.4922647476, propagate_forward_time: 268.6203918457, propagate_backward_time: 456.7926635742, weight_update_time: 1.3784440756, other_time: 20.7430725098
epoch time: 61.5097885132s, input_fired_time: 1.7078331709, output_fired_time: 0.0000000000, propagate_forward_time: 55.8935852051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9083709717
validation[          , genome  6374] predictions:    6235/  10000 (62.35%), best:    6235/10000 (62.35%), error:     11350.15137, best error:     11350.15137 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 785.8096923828s, input_fired_time: 12.6028671265, output_fired_time: 9.9254055023, propagate_forward_time: 274.0670166016, propagate_backward_time: 468.4403076172, weight_update_time: 1.4796476364, other_time: 20.7741088867
epoch time: 59.5913619995s, input_fired_time: 1.6951086521, output_fired_time: 0.0000000000, propagate_forward_time: 54.0987930298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7974586487
validation[          , genome  6374] predictions:    6246/  10000 (62.46%), best:    6235/10000 (62.35%), error:     11483.44727, best error:     11350.15137 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 780.9161987305s, input_fired_time: 12.4727134705, output_fired_time: 10.1333274841, propagate_forward_time: 270.7891845703, propagate_backward_time: 467.0406494141, weight_update_time: 1.3896013498, other_time: 20.4803466797
epoch time: 59.0471611023s, input_fired_time: 1.6210345030, output_fired_time: 0.0000000000, propagate_forward_time: 53.9381408691, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4879875183
validation[          , genome  6374] predictions:    6271/  10000 (62.71%), best:    6271/10000 (62.71%), error:     11164.20215, best error:     11164.20215 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 804.0130004883s, input_fired_time: 12.8093404770, output_fired_time: 10.2701492310, propagate_forward_time: 279.1739196777, propagate_backward_time: 480.9575805664, weight_update_time: 1.3830481768, other_time: 20.8020324707
epoch time: 60.7323646545s, input_fired_time: 1.6042706966, output_fired_time: 0.0000000000, propagate_forward_time: 55.3582801819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7698135376
validation[          , genome  6374] predictions:    6227/  10000 (62.27%), best:    6271/10000 (62.71%), error:     11566.06445, best error:     11164.20215 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 799.9188232422s, input_fired_time: 12.6333093643, output_fired_time: 9.9302225113, propagate_forward_time: 276.8758239746, propagate_backward_time: 479.2088623047, weight_update_time: 1.4058537483, other_time: 21.2705993652
epoch time: 60.6660423279s, input_fired_time: 1.6184250116, output_fired_time: 0.0000000000, propagate_forward_time: 55.4415588379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6060600281
validation[          , genome  6374] predictions:    6196/  10000 (61.96%), best:    6271/10000 (62.71%), error:     11692.85352, best error:     11164.20215 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 807.1665039063s, input_fired_time: 12.8866004944, output_fired_time: 10.6045284271, propagate_forward_time: 278.0312194824, propagate_backward_time: 484.8679504395, weight_update_time: 1.3817831278, other_time: 20.7761840820
epoch time: 60.4594154358s, input_fired_time: 1.6560006142, output_fired_time: 0.0000000000, propagate_forward_time: 55.1276664734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6757469177
validation[          , genome  6374] predictions:    6268/  10000 (62.68%), best:    6271/10000 (62.71%), error:     11587.37305, best error:     11164.20215 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 783.8884277344s, input_fired_time: 12.3368701935, output_fired_time: 10.1795921326, propagate_forward_time: 272.2022094727, propagate_backward_time: 468.9605407715, weight_update_time: 1.3758788109, other_time: 20.2092590332
epoch time: 59.3833465576s, input_fired_time: 1.6878393888, output_fired_time: 0.0000000000, propagate_forward_time: 53.6264152527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0690917969
validation[          , genome  6374] predictions:    6118/  10000 (61.18%), best:    6271/10000 (62.71%), error:     11760.19727, best error:     11164.20215 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 740.4702758789s, input_fired_time: 11.5836019516, output_fired_time: 9.1244287491, propagate_forward_time: 259.6964416504, propagate_backward_time: 439.8638305664, weight_update_time: 1.3702573776, other_time: 20.2019348145
epoch time: 57.2468032837s, input_fired_time: 1.5224726200, output_fired_time: 0.0000000000, propagate_forward_time: 52.0661468506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6581840515
validation[          , genome  6374] predictions:    6227/  10000 (62.27%), best:    6271/10000 (62.71%), error:     11425.84473, best error:     11164.20215 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 741.2443237305s, input_fired_time: 11.5829000473, output_fired_time: 9.1757974625, propagate_forward_time: 259.2769470215, propagate_backward_time: 441.0542907715, weight_update_time: 1.3669675589, other_time: 20.1544189453
epoch time: 58.7880821228s, input_fired_time: 1.6176204681, output_fired_time: 0.0000000000, propagate_forward_time: 53.3080978394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8623657227
validation[          , genome  6374] predictions:    6364/  10000 (63.64%), best:    6364/10000 (63.64%), error:     11052.40234, best error:     11052.40234 on epoch:    66, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 754.3643188477s, input_fired_time: 12.1195087433, output_fired_time: 9.5006837845, propagate_forward_time: 262.6760253906, propagate_backward_time: 449.7196350098, weight_update_time: 1.3798778057, other_time: 20.3484802246
epoch time: 58.9589195251s, input_fired_time: 1.7183421850, output_fired_time: 0.0000000000, propagate_forward_time: 53.3017692566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9388084412
validation[          , genome  6374] predictions:    6254/  10000 (62.54%), best:    6364/10000 (63.64%), error:     11318.55078, best error:     11052.40234 on epoch:    66, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 778.8742065430s, input_fired_time: 12.8850364685, output_fired_time: 10.0936727524, propagate_forward_time: 271.7148742676, propagate_backward_time: 462.2931213379, weight_update_time: 1.4801155329, other_time: 21.8875122070
epoch time: 57.7645797729s, input_fired_time: 1.5881381035, output_fired_time: 0.0000000000, propagate_forward_time: 52.3166847229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8597564697
validation[          , genome  6374] predictions:    6301/  10000 (63.01%), best:    6364/10000 (63.64%), error:     11265.79004, best error:     11052.40234 on epoch:    66, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 751.6748657227s, input_fired_time: 12.3095903397, output_fired_time: 9.5181198120, propagate_forward_time: 261.8395385742, propagate_backward_time: 446.2060546875, weight_update_time: 1.4355332851, other_time: 21.8015747070
epoch time: 57.2876091003s, input_fired_time: 1.5593832731, output_fired_time: 0.0000000000, propagate_forward_time: 51.9731941223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7550315857
validation[          , genome  6374] predictions:    6250/  10000 (62.50%), best:    6364/10000 (63.64%), error:     11519.63672, best error:     11052.40234 on epoch:    66, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 752.1502075195s, input_fired_time: 12.2718839645, output_fired_time: 9.5635738373, propagate_forward_time: 262.5052795410, propagate_backward_time: 446.1078796387, weight_update_time: 1.4361776114, other_time: 21.7015380859
epoch time: 58.6019401550s, input_fired_time: 1.7584041357, output_fired_time: 0.0000000000, propagate_forward_time: 52.7195739746, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1239624023
validation[          , genome  6374] predictions:    6242/  10000 (62.42%), best:    6364/10000 (63.64%), error:     11378.57813, best error:     11052.40234 on epoch:    66, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 783.5872802734s, input_fired_time: 13.1570711136, output_fired_time: 10.4434022903, propagate_forward_time: 270.8462524414, propagate_backward_time: 466.9963073730, weight_update_time: 1.4466011524, other_time: 22.1442565918
epoch time: 59.9290046692s, input_fired_time: 1.6637561321, output_fired_time: 0.0000000000, propagate_forward_time: 54.3142127991, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9510345459
validation[          , genome  6374] predictions:    6316/  10000 (63.16%), best:    6364/10000 (63.64%), error:     11107.08301, best error:     11052.40234 on epoch:    66, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 777.8040771484s, input_fired_time: 12.7873201370, output_fired_time: 9.9441986084, propagate_forward_time: 269.3982543945, propagate_backward_time: 463.4627685547, weight_update_time: 1.4650167227, other_time: 22.2115478516
epoch time: 58.3650207520s, input_fired_time: 1.6258637905, output_fired_time: 0.0000000000, propagate_forward_time: 52.4456672668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2934913635
validation[          , genome  6374] predictions:    6275/  10000 (62.75%), best:    6364/10000 (63.64%), error:     11359.52441, best error:     11052.40234 on epoch:    66, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 755.7554931641s, input_fired_time: 12.6333875656, output_fired_time: 9.7770032883, propagate_forward_time: 261.3524475098, propagate_backward_time: 447.6553039551, weight_update_time: 1.5634551048, other_time: 24.3374023438
epoch time: 58.1626281738s, input_fired_time: 1.6404246092, output_fired_time: 0.0000000000, propagate_forward_time: 52.3425025940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1797027588
validation[          , genome  6374] predictions:    6220/  10000 (62.20%), best:    6364/10000 (63.64%), error:     11558.89453, best error:     11052.40234 on epoch:    66, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 755.9996337891s, input_fired_time: 12.7183074951, output_fired_time: 9.6977920532, propagate_forward_time: 261.1711425781, propagate_backward_time: 447.8132019043, weight_update_time: 1.5451221466, other_time: 24.5991516113
epoch time: 58.3420639038s, input_fired_time: 1.6369206905, output_fired_time: 0.0000000000, propagate_forward_time: 52.4335441589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2715988159
validation[          , genome  6374] predictions:    6295/  10000 (62.95%), best:    6364/10000 (63.64%), error:     11386.57813, best error:     11052.40234 on epoch:    66, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 758.6885375977s, input_fired_time: 12.7298507690, output_fired_time: 9.7582492828, propagate_forward_time: 262.0749206543, propagate_backward_time: 449.6492614746, weight_update_time: 1.5565479994, other_time: 24.4762573242
epoch time: 58.4311828613s, input_fired_time: 1.6388854980, output_fired_time: 0.0000000000, propagate_forward_time: 52.4869804382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3053169250
validation[          , genome  6374] predictions:    6286/  10000 (62.86%), best:    6364/10000 (63.64%), error:     11387.45605, best error:     11052.40234 on epoch:    66, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 760.2516479492s, input_fired_time: 12.1160783768, output_fired_time: 9.5554533005, propagate_forward_time: 262.4169006348, propagate_backward_time: 453.5005187988, weight_update_time: 1.4687798023, other_time: 22.6626586914
epoch time: 58.0648269653s, input_fired_time: 1.5444798470, output_fired_time: 0.0000000000, propagate_forward_time: 52.4233283997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0970191956
validation[          , genome  6374] predictions:    6269/  10000 (62.69%), best:    6364/10000 (63.64%), error:     11347.53613, best error:     11052.40234 on epoch:    66, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 758.1381225586s, input_fired_time: 12.1088838577, output_fired_time: 9.4589281082, propagate_forward_time: 262.7716674805, propagate_backward_time: 451.6328735352, weight_update_time: 1.4454017878, other_time: 22.1657714844
epoch time: 58.1554450989s, input_fired_time: 1.5824649334, output_fired_time: 0.0000000000, propagate_forward_time: 52.4442176819, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1287612915
validation[          , genome  6374] predictions:    6281/  10000 (62.81%), best:    6364/10000 (63.64%), error:     11254.20117, best error:     11052.40234 on epoch:    66, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 756.8494873047s, input_fired_time: 12.0699977875, output_fired_time: 9.4603996277, propagate_forward_time: 262.5771484375, propagate_backward_time: 450.8061523438, weight_update_time: 1.4329657555, other_time: 21.9357910156
epoch time: 58.1901626587s, input_fired_time: 1.5872063637, output_fired_time: 0.0000000000, propagate_forward_time: 52.6314506531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9715042114
validation[          , genome  6374] predictions:    6221/  10000 (62.21%), best:    6364/10000 (63.64%), error:     11502.84473, best error:     11052.40234 on epoch:    66, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 757.6781005859s, input_fired_time: 12.0664730072, output_fired_time: 9.4668807983, propagate_forward_time: 262.7796325684, propagate_backward_time: 450.9781799316, weight_update_time: 1.4403676987, other_time: 22.3869628906
epoch time: 58.0595397949s, input_fired_time: 1.5638332367, output_fired_time: 0.0000000000, propagate_forward_time: 52.4951896667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0005149841
validation[          , genome  6374] predictions:    6273/  10000 (62.73%), best:    6364/10000 (63.64%), error:     11358.18066, best error:     11052.40234 on epoch:    66, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 756.6987304688s, input_fired_time: 12.0483493805, output_fired_time: 9.4647054672, propagate_forward_time: 262.7486572266, propagate_backward_time: 450.3687133789, weight_update_time: 1.4523594379, other_time: 22.0682983398
epoch time: 58.3827438354s, input_fired_time: 1.5641744137, output_fired_time: 0.0000000000, propagate_forward_time: 52.7608795166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0576896667
validation[          , genome  6374] predictions:    6276/  10000 (62.76%), best:    6364/10000 (63.64%), error:     11408.30664, best error:     11052.40234 on epoch:    66, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 761.8603515625s, input_fired_time: 12.7667264938, output_fired_time: 9.8022966385, propagate_forward_time: 264.1213989258, propagate_backward_time: 451.1397094727, weight_update_time: 1.5203940868, other_time: 24.0302124023
epoch time: 59.2049179077s, input_fired_time: 1.6520187855, output_fired_time: 0.0000000000, propagate_forward_time: 53.2033004761, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3495979309
validation[          , genome  6374] predictions:    6332/  10000 (63.32%), best:    6364/10000 (63.64%), error:     11240.13965, best error:     11052.40234 on epoch:    66, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 719.2984619141s, input_fired_time: 10.3035860062, output_fired_time: 7.7868375778, propagate_forward_time: 252.4417724609, propagate_backward_time: 431.1412048340, weight_update_time: 1.2467525005, other_time: 17.6250305176
epoch time: 49.2502479553s, input_fired_time: 0.8148418665, output_fired_time: 0.0000000000, propagate_forward_time: 46.9527053833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4827003479
validation[          , genome  6374] predictions:    6245/  10000 (62.45%), best:    6364/10000 (63.64%), error:     11482.79297, best error:     11052.40234 on epoch:    66, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 657.5843505859s, input_fired_time: 6.6819562912, output_fired_time: 4.9309849739, propagate_forward_time: 234.9514770508, propagate_backward_time: 402.5004272461, weight_update_time: 0.8635193706, other_time: 8.5195312500
epoch time: 49.2754859924s, input_fired_time: 0.8177490234, output_fired_time: 0.0000000000, propagate_forward_time: 46.9568977356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5008392334
validation[          , genome  6374] predictions:    6320/  10000 (63.20%), best:    6364/10000 (63.64%), error:     11145.53809, best error:     11052.40234 on epoch:    66, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 657.7196044922s, input_fired_time: 6.6854863167, output_fired_time: 4.9344134331, propagate_forward_time: 235.0397949219, propagate_backward_time: 402.5384216309, weight_update_time: 0.8627232313, other_time: 8.5215148926
epoch time: 49.2655143738s, input_fired_time: 0.8144363165, output_fired_time: 0.0000000000, propagate_forward_time: 46.9601402283, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4909362793
validation[          , genome  6374] predictions:    6312/  10000 (63.12%), best:    6364/10000 (63.64%), error:     11335.72656, best error:     11052.40234 on epoch:    66, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 658.6743164063s, input_fired_time: 6.6901102066, output_fired_time: 4.9923090935, propagate_forward_time: 235.5183715820, propagate_backward_time: 402.9350280762, weight_update_time: 0.8641098142, other_time: 8.5384826660
epoch time: 49.3436393738s, input_fired_time: 0.8208349943, output_fired_time: 0.0000000000, propagate_forward_time: 47.0276832581, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4951210022
validation[          , genome  6374] predictions:    6339/  10000 (63.39%), best:    6364/10000 (63.64%), error:     11262.59180, best error:     11052.40234 on epoch:    66, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 658.5603637695s, input_fired_time: 6.6953825951, output_fired_time: 4.9609808922, propagate_forward_time: 235.2439422607, propagate_backward_time: 403.3223571777, weight_update_time: 0.8582733274, other_time: 8.3376770020
epoch time: 48.9118194580s, input_fired_time: 0.8050800562, output_fired_time: 0.0000000000, propagate_forward_time: 46.6584243774, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4483146667
validation[          , genome  6374] predictions:    6240/  10000 (62.40%), best:    6364/10000 (63.64%), error:     11356.63574, best error:     11052.40234 on epoch:    66, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 653.2113037109s, input_fired_time: 6.6498851776, output_fired_time: 4.9074134827, propagate_forward_time: 233.4826354980, propagate_backward_time: 399.8915100098, weight_update_time: 0.8566122651, other_time: 8.2798461914
epoch time: 48.8723030090s, input_fired_time: 0.8094493151, output_fired_time: 0.0000000000, propagate_forward_time: 46.6226158142, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4402389526
validation[          , genome  6374] predictions:    6330/  10000 (63.30%), best:    6364/10000 (63.64%), error:     11271.92188, best error:     11052.40234 on epoch:    66, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 765.0235595703s, input_fired_time: 11.1223115921, output_fired_time: 8.7358093262, propagate_forward_time: 267.8296508789, propagate_backward_time: 458.4560241699, weight_update_time: 1.2856239080, other_time: 18.8797302246
epoch time: 60.2259559631s, input_fired_time: 1.6013425589, output_fired_time: 0.0000000000, propagate_forward_time: 54.9431838989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6814308167
validation[          , genome  6374] predictions:    6278/  10000 (62.78%), best:    6364/10000 (63.64%), error:     11358.69531, best error:     11052.40234 on epoch:    66, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 777.2570190430s, input_fired_time: 11.8439273834, output_fired_time: 9.5576400757, propagate_forward_time: 269.2766418457, propagate_backward_time: 466.3401794434, weight_update_time: 1.3632467985, other_time: 20.2386474609
epoch time: 59.3562316895s, input_fired_time: 1.5493916273, output_fired_time: 0.0000000000, propagate_forward_time: 54.1650772095, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6417617798
validation[          , genome  6374] predictions:    6308/  10000 (63.08%), best:    6364/10000 (63.64%), error:     11350.58789, best error:     11052.40234 on epoch:    66, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 763.1186523438s, input_fired_time: 11.9467077255, output_fired_time: 9.5557708740, propagate_forward_time: 264.9494628906, propagate_backward_time: 455.6837768555, weight_update_time: 1.3788483143, other_time: 20.9829101563
epoch time: 56.7977256775s, input_fired_time: 1.4610414505, output_fired_time: 0.0000000000, propagate_forward_time: 51.7893295288, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5473556519
validation[          , genome  6374] predictions:    6303/  10000 (63.03%), best:    6364/10000 (63.64%), error:     11241.37695, best error:     11052.40234 on epoch:    66, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 747.6724853516s, input_fired_time: 10.8791389465, output_fired_time: 8.9504852295, propagate_forward_time: 259.4721984863, propagate_backward_time: 449.0167846680, weight_update_time: 1.2813268900, other_time: 19.3538513184
epoch time: 57.2600898743s, input_fired_time: 1.4448096752, output_fired_time: 0.0000000000, propagate_forward_time: 52.1180343628, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6972465515
validation[          , genome  6374] predictions:    6321/  10000 (63.21%), best:    6364/10000 (63.64%), error:     11259.87891, best error:     11052.40234 on epoch:    66, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 747.9496459961s, input_fired_time: 10.9143266678, output_fired_time: 8.9504499435, propagate_forward_time: 260.0303649902, propagate_backward_time: 448.5062255859, weight_update_time: 1.2815883160, other_time: 19.5483093262
epoch time: 56.7760848999s, input_fired_time: 1.4101945162, output_fired_time: 0.0000000000, propagate_forward_time: 51.8848495483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4810409546
validation[          , genome  6374] predictions:    6299/  10000 (62.99%), best:    6364/10000 (63.64%), error:     11277.47070, best error:     11052.40234 on epoch:    66, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 760.2612915039s, input_fired_time: 11.4727306366, output_fired_time: 9.2246093750, propagate_forward_time: 264.7386474609, propagate_backward_time: 454.7826843262, weight_update_time: 1.3274818659, other_time: 20.0426330566
epoch time: 58.3826026917s, input_fired_time: 1.5863647461, output_fired_time: 0.0000000000, propagate_forward_time: 52.9382324219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8580055237
validation[          , genome  6374] predictions:    6256/  10000 (62.56%), best:    6364/10000 (63.64%), error:     11377.28809, best error:     11052.40234 on epoch:    66, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 764.1059570313s, input_fired_time: 12.1148834229, output_fired_time: 9.4875888824, propagate_forward_time: 265.1527709961, propagate_backward_time: 456.2960510254, weight_update_time: 1.3861646652, other_time: 21.0546569824
epoch time: 58.3683853149s, input_fired_time: 1.6179627180, output_fired_time: 0.0000000000, propagate_forward_time: 53.0262527466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7241706848
validation[          , genome  6374] predictions:    6318/  10000 (63.18%), best:    6364/10000 (63.64%), error:     11199.14160, best error:     11052.40234 on epoch:    66, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 764.8741455078s, input_fired_time: 12.0776796341, output_fired_time: 9.5041713715, propagate_forward_time: 265.2120971680, propagate_backward_time: 456.9414672852, weight_update_time: 1.3925683498, other_time: 21.1387329102
epoch time: 57.9896697998s, input_fired_time: 1.5918618441, output_fired_time: 0.0000000000, propagate_forward_time: 52.6911506653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7066574097
validation[          , genome  6374] predictions:    6334/  10000 (63.34%), best:    6364/10000 (63.64%), error:     11323.76465, best error:     11052.40234 on epoch:    66, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 769.2455444336s, input_fired_time: 11.5950946808, output_fired_time: 9.4592275620, propagate_forward_time: 266.6655883789, propagate_backward_time: 461.3213806152, weight_update_time: 1.3276369572, other_time: 20.2042541504
epoch time: 58.0748252869s, input_fired_time: 1.4192357063, output_fired_time: 0.0000000000, propagate_forward_time: 53.2884902954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3670997620
validation[          , genome  6374] predictions:    6301/  10000 (63.01%), best:    6364/10000 (63.64%), error:     11211.29590, best error:     11052.40234 on epoch:    66, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 770.6566772461s, input_fired_time: 11.3488788605, output_fired_time: 9.4695024490, propagate_forward_time: 266.4721679688, propagate_backward_time: 463.4415283203, weight_update_time: 1.3071181774, other_time: 19.9246215820
epoch time: 57.6685981750s, input_fired_time: 1.4849678278, output_fired_time: 0.0000000000, propagate_forward_time: 52.7192687988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4643630981
validation[          , genome  6374] predictions:    6265/  10000 (62.65%), best:    6364/10000 (63.64%), error:     11311.08301, best error:     11052.40234 on epoch:    66, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 797.8258666992s, input_fired_time: 11.6707725525, output_fired_time: 9.5337982178, propagate_forward_time: 274.7994995117, propagate_backward_time: 481.7711791992, weight_update_time: 1.3232071400, other_time: 20.0505981445
epoch time: 60.7362251282s, input_fired_time: 1.6400572062, output_fired_time: 0.0000000000, propagate_forward_time: 55.3766670227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7195014954
validation[          , genome  6374] predictions:    6297/  10000 (62.97%), best:    6364/10000 (63.64%), error:     11357.38574, best error:     11052.40234 on epoch:    66, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 806.1683349609s, input_fired_time: 13.0007352829, output_fired_time: 10.1944818497, propagate_forward_time: 277.1790466309, propagate_backward_time: 484.1071472168, weight_update_time: 1.4269467592, other_time: 21.6869506836
epoch time: 61.3041725159s, input_fired_time: 1.6418192387, output_fired_time: 0.0000000000, propagate_forward_time: 55.8566856384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8056678772
validation[          , genome  6374] predictions:    6349/  10000 (63.49%), best:    6364/10000 (63.64%), error:     11244.94141, best error:     11052.40234 on epoch:    66, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 811.8994140625s, input_fired_time: 13.0997953415, output_fired_time: 10.3720197678, propagate_forward_time: 278.7118225098, propagate_backward_time: 488.0307312012, weight_update_time: 1.4298212528, other_time: 21.6850585938
epoch time: 61.7417831421s, input_fired_time: 1.8260731697, output_fired_time: 0.0000000000, propagate_forward_time: 55.8782882690, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0374221802
validation[          , genome  6374] predictions:    6315/  10000 (63.15%), best:    6364/10000 (63.64%), error:     11259.70703, best error:     11052.40234 on epoch:    66, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 305.4444580078s, input_fired_time: 8.4291315079, output_fired_time: 0.0000000000, propagate_forward_time: 277.7807006836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 19.2346191406
best training[          , genome  6374] predictions:   39839/  50000 (79.68%), best:    6364/10000 (63.64%), error:     30104.67578, best error:     11052.40234 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 62.6644020081s, input_fired_time: 1.6658861637, output_fired_time: 0.0000000000, propagate_forward_time: 56.7336730957, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2648429871
   testing[          , genome  6374] predictions:    6364/  10000 (63.64%), best:    6364/10000 (63.64%), error:     11052.40234, best error:     11052.40234 on epoch:    66, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
07:04:28 (1292): called boinc_finish(0)

</stderr_txt>
]]>