Nameexact_genome_1542727803_185_6413_1
Workunit4101007
Created20 Nov 2018, 16:47:07 UTC
Sent20 Nov 2018, 16:47:07 UTC
Report deadline21 Feb 2019, 12:26:22 UTC
Received23 Nov 2018, 15:27:52 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID71624
Run time1 days 2 hours 7 min 18 sec
CPU time1 days 1 hours 42 min 28 sec
Validate stateValid
Credit23,204.73
Device peak FLOPS3.44 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.0.80</core_client_version>
<![CDATA[
<stderr_txt>
2/10000 (55.12%), error:     13894.63281, best error:     13894.63281 on epoch:    15, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 2170.2990722656s, input_fired_time: 10.4290781021, output_fired_time: 17.0118122101, propagate_forward_time: 611.5157470703, propagate_backward_time: 1507.2753906250, weight_update_time: 2.8538777828, other_time: 24.0670166016
epoch time: 123.6225128174s, input_fired_time: 0.7308205962, output_fired_time: 0.0000000000, propagate_forward_time: 118.3763885498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5153045654
validation[          , genome  6413] predictions:    5321/  10000 (53.21%), best:    5512/10000 (55.12%), error:     15184.25391, best error:     13894.63281 on epoch:    15, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 2168.7607421875s, input_fired_time: 19.3997402191, output_fired_time: 10.2239694595, propagate_forward_time: 613.7926635742, propagate_backward_time: 1505.5175781250, weight_update_time: 4.8600192070, other_time: 19.8269042969
epoch time: 125.2758331299s, input_fired_time: 0.7425624132, output_fired_time: 0.0000000000, propagate_forward_time: 121.9341430664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5991287231
validation[          , genome  6413] predictions:    5165/  10000 (51.65%), best:    5512/10000 (55.12%), error:     14895.43066, best error:     13894.63281 on epoch:    15, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 2137.1826171875s, input_fired_time: 18.4899978638, output_fired_time: 16.2460117340, propagate_forward_time: 595.3657836914, propagate_backward_time: 1491.1601562500, weight_update_time: 0.8538581729, other_time: 15.9206542969
epoch time: 125.5883636475s, input_fired_time: 4.7768650055, output_fired_time: 0.0000000000, propagate_forward_time: 116.2261734009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5853271484
validation[          , genome  6413] predictions:    5487/  10000 (54.87%), best:    5487/10000 (54.87%), error:     13779.99805, best error:     13779.99805 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 2153.2207031250s, input_fired_time: 24.4269943237, output_fired_time: 11.1027374268, propagate_forward_time: 610.9896240234, propagate_backward_time: 1488.8055419922, weight_update_time: 0.8307923675, other_time: 17.8957519531
epoch time: 126.8348083496s, input_fired_time: 3.6840510368, output_fired_time: 0.0000000000, propagate_forward_time: 119.5725250244, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5782318115
validation[          , genome  6413] predictions:    5495/  10000 (54.95%), best:    5487/10000 (54.87%), error:     14241.90430, best error:     13779.99805 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 2150.0568847656s, input_fired_time: 21.4774227142, output_fired_time: 11.2806634903, propagate_forward_time: 592.6674194336, propagate_backward_time: 1502.6373291016, weight_update_time: 1.8472552299, other_time: 21.9937744141
epoch time: 126.9453659058s, input_fired_time: 1.7804889679, output_fired_time: 0.0000000000, propagate_forward_time: 120.5704193115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5944595337
validation[          , genome  6413] predictions:    5481/  10000 (54.81%), best:    5487/10000 (54.87%), error:     14337.36035, best error:     13779.99805 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 2165.4902343750s, input_fired_time: 17.5524864197, output_fired_time: 20.3524551392, propagate_forward_time: 603.4201660156, propagate_backward_time: 1503.2808837891, weight_update_time: 0.8346773982, other_time: 20.8841552734
epoch time: 122.6976242065s, input_fired_time: 1.7495300770, output_fired_time: 0.0000000000, propagate_forward_time: 119.4766921997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4714050293
validation[          , genome  6413] predictions:    5578/  10000 (55.78%), best:    5578/10000 (55.78%), error:     13644.63574, best error:     13644.63574 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 2144.4887695313s, input_fired_time: 13.4916028976, output_fired_time: 14.2360334396, propagate_forward_time: 611.4044799805, propagate_backward_time: 1483.4436035156, weight_update_time: 1.8231185675, other_time: 21.9128417969
epoch time: 125.2281723022s, input_fired_time: 0.7713799477, output_fired_time: 0.0000000000, propagate_forward_time: 122.9544677734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5023269653
validation[          , genome  6413] predictions:    5632/  10000 (56.32%), best:    5632/10000 (56.32%), error:     13377.94922, best error:     13377.94922 on epoch:    22, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 2195.9328613281s, input_fired_time: 14.7103099823, output_fired_time: 12.3769083023, propagate_forward_time: 613.2669067383, propagate_backward_time: 1531.5666503906, weight_update_time: 3.8599977493, other_time: 24.0122070313
epoch time: 134.0200958252s, input_fired_time: 1.8023408651, output_fired_time: 0.0000000000, propagate_forward_time: 127.6087875366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6089706421
validation[          , genome  6413] predictions:    5605/  10000 (56.05%), best:    5632/10000 (56.32%), error:     13440.87402, best error:     13377.94922 on epoch:    22, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 2175.5456542969s, input_fired_time: 18.6377925873, output_fired_time: 13.2999286652, propagate_forward_time: 636.4978027344, propagate_backward_time: 1485.1944580078, weight_update_time: 2.8672292233, other_time: 21.9156494141
epoch time: 127.4834976196s, input_fired_time: 2.7821264267, output_fired_time: 0.0000000000, propagate_forward_time: 123.1741256714, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5272445679
validation[          , genome  6413] predictions:    5649/  10000 (56.49%), best:    5649/10000 (56.49%), error:     13183.40430, best error:     13183.40430 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 2201.8703613281s, input_fired_time: 25.6612339020, output_fired_time: 16.2795639038, propagate_forward_time: 599.6241455078, propagate_backward_time: 1537.3273925781, weight_update_time: 0.8515437841, other_time: 22.9781494141
epoch time: 128.4579162598s, input_fired_time: 0.7763389349, output_fired_time: 0.0000000000, propagate_forward_time: 125.1489944458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5325851440
validation[          , genome  6413] predictions:    5760/  10000 (57.60%), best:    5760/10000 (57.60%), error:     12989.95898, best error:     12989.95898 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 2193.5314941406s, input_fired_time: 28.6468029022, output_fired_time: 8.2937650681, propagate_forward_time: 632.9433593750, propagate_backward_time: 1501.6578369141, weight_update_time: 1.8557378054, other_time: 21.9898681641
epoch time: 128.4513397217s, input_fired_time: 4.8037962914, output_fired_time: 0.0000000000, propagate_forward_time: 119.1738967896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4736480713
validation[          , genome  6413] predictions:    5485/  10000 (54.85%), best:    5760/10000 (57.60%), error:     13667.94043, best error:     12989.95898 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 2251.8842773438s, input_fired_time: 15.7656164169, output_fired_time: 13.5133886337, propagate_forward_time: 633.8225097656, propagate_backward_time: 1559.3540039063, weight_update_time: 0.8753827214, other_time: 29.4287109375
epoch time: 134.8334045410s, input_fired_time: 2.8277511597, output_fired_time: 0.0000000000, propagate_forward_time: 123.2828750610, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.7227706909
validation[          , genome  6413] predictions:    5600/  10000 (56.00%), best:    5760/10000 (57.60%), error:     13568.60449, best error:     12989.95898 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 2210.2858886719s, input_fired_time: 13.6514263153, output_fired_time: 18.2831554413, propagate_forward_time: 633.6725463867, propagate_backward_time: 1532.8226318359, weight_update_time: 0.8548435569, other_time: 11.8560791016
epoch time: 125.7397766113s, input_fired_time: 0.7718612552, output_fired_time: 0.0000000000, propagate_forward_time: 123.4286346436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5392837524
validation[          , genome  6413] predictions:    5464/  10000 (54.64%), best:    5760/10000 (57.60%), error:     13829.64063, best error:     12989.95898 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 2172.6562500000s, input_fired_time: 20.6727809906, output_fired_time: 13.0818920135, propagate_forward_time: 617.8748168945, propagate_backward_time: 1502.2165527344, weight_update_time: 1.8500314951, other_time: 18.8103027344
epoch time: 128.1701660156s, input_fired_time: 0.7741824985, output_fired_time: 0.0000000000, propagate_forward_time: 122.8206634521, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5753173828
validation[          , genome  6413] predictions:    5718/  10000 (57.18%), best:    5760/10000 (57.60%), error:     13411.32324, best error:     12989.95898 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 2160.3913574219s, input_fired_time: 25.4407882690, output_fired_time: 13.1978139877, propagate_forward_time: 594.5618286133, propagate_backward_time: 1506.4432373047, weight_update_time: 3.8455634117, other_time: 20.7479248047
epoch time: 125.5883560181s, input_fired_time: 1.7798143625, output_fired_time: 0.0000000000, propagate_forward_time: 119.3407669067, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4677734375
validation[          , genome  6413] predictions:    5579/  10000 (55.79%), best:    5760/10000 (57.60%), error:     13851.60059, best error:     12989.95898 on epoch:    25, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 2155.5710449219s, input_fired_time: 18.3726520538, output_fired_time: 12.2199430466, propagate_forward_time: 595.1305541992, propagate_backward_time: 1503.2839355469, weight_update_time: 6.7715339661, other_time: 26.5639648438
epoch time: 126.7606124878s, input_fired_time: 2.7891337872, output_fired_time: 0.0000000000, propagate_forward_time: 122.5163345337, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4551467896
validation[          , genome  6413] predictions:    5744/  10000 (57.44%), best:    5744/10000 (57.44%), error:     12942.56934, best error:     12942.56934 on epoch:    31, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 2152.0031738281s, input_fired_time: 13.5652742386, output_fired_time: 16.2825355530, propagate_forward_time: 598.6297607422, propagate_backward_time: 1503.8862304688, weight_update_time: 2.8446543217, other_time: 19.6395263672
epoch time: 127.9421005249s, input_fired_time: 0.7773914933, output_fired_time: 0.0000000000, propagate_forward_time: 119.7210693359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4436416626
validation[          , genome  6413] predictions:    5702/  10000 (57.02%), best:    5744/10000 (57.44%), error:     13433.40918, best error:     12942.56934 on epoch:    31, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 2172.7922363281s, input_fired_time: 15.4407682419, output_fired_time: 9.2348384857, propagate_forward_time: 598.8695678711, propagate_backward_time: 1522.4942626953, weight_update_time: 0.8419463038, other_time: 26.7528076172
epoch time: 126.6988296509s, input_fired_time: 2.8020524979, output_fired_time: 0.0000000000, propagate_forward_time: 122.4152679443, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4815063477
validation[          , genome  6413] predictions:    5763/  10000 (57.63%), best:    5744/10000 (57.44%), error:     13089.09570, best error:     12942.56934 on epoch:    31, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 2115.1264648438s, input_fired_time: 18.2979202271, output_fired_time: 11.0772695541, propagate_forward_time: 606.3039550781, propagate_backward_time: 1464.0097656250, weight_update_time: 0.8165088892, other_time: 15.4377441406
epoch time: 126.6691360474s, input_fired_time: 1.7947634459, output_fired_time: 0.0000000000, propagate_forward_time: 117.3611068726, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.5132675171
validation[          , genome  6413] predictions:    5568/  10000 (55.68%), best:    5744/10000 (57.44%), error:     13773.45703, best error:     12942.56934 on epoch:    31, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 2185.4001464844s, input_fired_time: 22.6464538574, output_fired_time: 11.2969532013, propagate_forward_time: 599.5230102539, propagate_backward_time: 1525.1047363281, weight_update_time: 0.8402989507, other_time: 26.8291015625
epoch time: 130.2371215820s, input_fired_time: 0.8120862246, output_fired_time: 0.0000000000, propagate_forward_time: 120.8322525024, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 8.5927810669
validation[          , genome  6413] predictions:    5819/  10000 (58.19%), best:    5819/10000 (58.19%), error:     12804.20996, best error:     12804.20996 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 2179.2866210938s, input_fired_time: 22.7133102417, output_fired_time: 22.2708797455, propagate_forward_time: 619.8635864258, propagate_backward_time: 1493.5227050781, weight_update_time: 5.8729124069, other_time: 20.9160156250
epoch time: 127.1885681152s, input_fired_time: 3.8059115410, output_fired_time: 0.0000000000, propagate_forward_time: 117.8447799683, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5378799438
validation[          , genome  6413] predictions:    5556/  10000 (55.56%), best:    5819/10000 (58.19%), error:     13621.03613, best error:     12804.20996 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 2197.1518554688s, input_fired_time: 19.6826477051, output_fired_time: 15.2115478516, propagate_forward_time: 632.3009643555, propagate_backward_time: 1513.1312255859, weight_update_time: 0.8473013043, other_time: 16.8255615234
epoch time: 128.3809967041s, input_fired_time: 0.8134168983, output_fired_time: 0.0000000000, propagate_forward_time: 126.0419616699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5256195068
validation[          , genome  6413] predictions:    5849/  10000 (58.49%), best:    5819/10000 (58.19%), error:     12923.57715, best error:     12804.20996 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 2192.8479003906s, input_fired_time: 16.7961349487, output_fired_time: 11.2907705307, propagate_forward_time: 625.6582641602, propagate_backward_time: 1519.2872314453, weight_update_time: 0.8553102016, other_time: 19.8155517578
epoch time: 129.7344512939s, input_fired_time: 0.8074244857, output_fired_time: 0.0000000000, propagate_forward_time: 124.4731750488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4538574219
validation[          , genome  6413] predictions:    5680/  10000 (56.80%), best:    5819/10000 (58.19%), error:     13672.08203, best error:     12804.20996 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 2185.5141601563s, input_fired_time: 21.8692817688, output_fired_time: 10.0925559998, propagate_forward_time: 605.2583618164, propagate_backward_time: 1519.4031982422, weight_update_time: 3.8709709644, other_time: 28.8907470703
epoch time: 128.8692169189s, input_fired_time: 4.8373966217, output_fired_time: 0.0000000000, propagate_forward_time: 122.4708099365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5610122681
validation[          , genome  6413] predictions:    5801/  10000 (58.01%), best:    5819/10000 (58.19%), error:     13036.26660, best error:     12804.20996 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 2189.7263183594s, input_fired_time: 19.8097419739, output_fired_time: 14.2368373871, propagate_forward_time: 621.0231323242, propagate_backward_time: 1517.8813476563, weight_update_time: 1.8364627361, other_time: 16.7751464844
epoch time: 129.9218902588s, input_fired_time: 0.8007524610, output_fired_time: 0.0000000000, propagate_forward_time: 127.6129837036, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5081558228
validation[          , genome  6413] predictions:    5930/  10000 (59.30%), best:    5930/10000 (59.30%), error:     12462.70020, best error:     12462.70020 on epoch:    40, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 2190.5297851563s, input_fired_time: 25.6456184387, output_fired_time: 8.2662048340, propagate_forward_time: 607.5195312500, propagate_backward_time: 1529.1660156250, weight_update_time: 0.8417198062, other_time: 19.9326171875
epoch time: 130.0202026367s, input_fired_time: 0.8160110116, output_fired_time: 0.0000000000, propagate_forward_time: 124.6609191895, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5432739258
validation[          , genome  6413] predictions:    5983/  10000 (59.83%), best:    5983/10000 (59.83%), error:     12206.41992, best error:     12206.41992 on epoch:    41, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 2192.6442871094s, input_fired_time: 22.8722076416, output_fired_time: 9.2834005356, propagate_forward_time: 616.5214233398, propagate_backward_time: 1528.1076660156, weight_update_time: 0.8577176332, other_time: 15.8593750000
epoch time: 129.9280853271s, input_fired_time: 2.8295781612, output_fired_time: 0.0000000000, propagate_forward_time: 123.5566177368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5418930054
validation[          , genome  6413] predictions:    5991/  10000 (59.91%), best:    5983/10000 (59.83%), error:     12357.66211, best error:     12206.41992 on epoch:    41, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 2190.2019042969s, input_fired_time: 18.8018226624, output_fired_time: 17.3429107666, propagate_forward_time: 602.4537353516, propagate_backward_time: 1523.9750976563, weight_update_time: 0.8348734975, other_time: 27.6282958984
epoch time: 127.3418502808s, input_fired_time: 1.8140006065, output_fired_time: 0.0000000000, propagate_forward_time: 123.9939117432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5339355469
validation[          , genome  6413] predictions:    5953/  10000 (59.53%), best:    5983/10000 (59.83%), error:     12308.58691, best error:     12206.41992 on epoch:    41, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 2189.8500976563s, input_fired_time: 22.8675022125, output_fired_time: 17.3413848877, propagate_forward_time: 606.9262695313, propagate_backward_time: 1524.8432617188, weight_update_time: 1.8519786596, other_time: 17.8718261719
epoch time: 129.9022827148s, input_fired_time: 1.8342207670, output_fired_time: 0.0000000000, propagate_forward_time: 123.4923553467, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5757141113
validation[          , genome  6413] predictions:    6009/  10000 (60.09%), best:    5983/10000 (59.83%), error:     12363.99316, best error:     12206.41992 on epoch:    41, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 2194.5993652344s, input_fired_time: 17.8870677948, output_fired_time: 13.2832221985, propagate_forward_time: 619.1540527344, propagate_backward_time: 1514.3696289063, weight_update_time: 2.8506419659, other_time: 29.9055175781
epoch time: 127.5290756226s, input_fired_time: 4.8419823647, output_fired_time: 0.0000000000, propagate_forward_time: 121.1614379883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5256576538
validation[          , genome  6413] predictions:    5899/  10000 (58.99%), best:    5983/10000 (59.83%), error:     12471.66992, best error:     12206.41992 on epoch:    41, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 2194.9384765625s, input_fired_time: 16.7283687592, output_fired_time: 11.2229471207, propagate_forward_time: 603.9479980469, propagate_backward_time: 1534.1406250000, weight_update_time: 1.8439804316, other_time: 28.8986816406
epoch time: 130.3162231445s, input_fired_time: 1.8275637627, output_fired_time: 0.0000000000, propagate_forward_time: 125.9517822266, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5368804932
validation[          , genome  6413] predictions:    6017/  10000 (60.17%), best:    5983/10000 (59.83%), error:     12218.35449, best error:     12206.41992 on epoch:    41, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 2187.9326171875s, input_fired_time: 20.7459468842, output_fired_time: 13.1974992752, propagate_forward_time: 601.4777221680, propagate_backward_time: 1524.8156738281, weight_update_time: 0.8294410706, other_time: 27.6958007813
epoch time: 130.0533294678s, input_fired_time: 1.8284766674, output_fired_time: 0.0000000000, propagate_forward_time: 124.8095321655, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4153213501
validation[          , genome  6413] predictions:    5816/  10000 (58.16%), best:    5983/10000 (59.83%), error:     12898.64063, best error:     12206.41992 on epoch:    41, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 2190.7263183594s, input_fired_time: 26.9300155640, output_fired_time: 13.2811164856, propagate_forward_time: 623.6441040039, propagate_backward_time: 1509.1546630859, weight_update_time: 1.8565992117, other_time: 17.7166748047
epoch time: 131.6940002441s, input_fired_time: 0.8318278790, output_fired_time: 0.0000000000, propagate_forward_time: 127.3106079102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5515594482
validation[          , genome  6413] predictions:    5972/  10000 (59.72%), best:    5972/10000 (59.72%), error:     12178.79590, best error:     12178.79590 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 2190.0976562500s, input_fired_time: 18.8045711517, output_fired_time: 11.2985334396, propagate_forward_time: 626.7415161133, propagate_backward_time: 1518.3736572266, weight_update_time: 1.8522899151, other_time: 14.8792724609
epoch time: 129.6315460205s, input_fired_time: 0.8339164853, output_fired_time: 0.0000000000, propagate_forward_time: 125.2288360596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5687866211
validation[          , genome  6413] predictions:    6068/  10000 (60.68%), best:    6068/10000 (60.68%), error:     12122.54395, best error:     12122.54395 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 2189.0788574219s, input_fired_time: 18.8653240204, output_fired_time: 14.2941236496, propagate_forward_time: 601.5698852539, propagate_backward_time: 1523.4903564453, weight_update_time: 6.7798523903, other_time: 30.8592529297
epoch time: 127.7024765015s, input_fired_time: 2.8399662971, output_fired_time: 0.0000000000, propagate_forward_time: 119.2958679199, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5666427612
validation[          , genome  6413] predictions:    5880/  10000 (58.80%), best:    6068/10000 (60.68%), error:     12757.86328, best error:     12122.54395 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 2187.4221191406s, input_fired_time: 22.8538093567, output_fired_time: 12.2834968567, propagate_forward_time: 645.9201660156, propagate_backward_time: 1482.5635986328, weight_update_time: 0.8296374679, other_time: 23.8011474609
epoch time: 130.0650177002s, input_fired_time: 1.8409285545, output_fired_time: 0.0000000000, propagate_forward_time: 124.6914749146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5326156616
validation[          , genome  6413] predictions:    6007/  10000 (60.07%), best:    6007/10000 (60.07%), error:     12115.04297, best error:     12115.04297 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 2201.9296875000s, input_fired_time: 16.9470157623, output_fired_time: 8.3647460938, propagate_forward_time: 640.0659790039, propagate_backward_time: 1517.8041992188, weight_update_time: 0.8423925042, other_time: 18.7478027344
epoch time: 128.4829711914s, input_fired_time: 0.8281949162, output_fired_time: 0.0000000000, propagate_forward_time: 124.1291580200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5256195068
validation[          , genome  6413] predictions:    6051/  10000 (60.51%), best:    6051/10000 (60.51%), error:     11992.16699, best error:     11992.16699 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 2187.0646972656s, input_fired_time: 17.7060947418, output_fired_time: 17.3241271973, propagate_forward_time: 613.6577148438, propagate_backward_time: 1515.6166992188, weight_update_time: 0.8472402096, other_time: 22.7600097656
epoch time: 128.9025268555s, input_fired_time: 3.8354322910, output_fired_time: 0.0000000000, propagate_forward_time: 119.4808349609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5862579346
validation[          , genome  6413] predictions:    6044/  10000 (60.44%), best:    6051/10000 (60.51%), error:     12143.45801, best error:     11992.16699 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 2180.7312011719s, input_fired_time: 17.7744884491, output_fired_time: 12.2594738007, propagate_forward_time: 608.0218505859, propagate_backward_time: 1520.7998046875, weight_update_time: 2.8541841507, other_time: 21.8756103516
epoch time: 129.5552520752s, input_fired_time: 0.8231209517, output_fired_time: 0.0000000000, propagate_forward_time: 123.2672576904, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4648742676
validation[          , genome  6413] predictions:    5999/  10000 (59.99%), best:    6051/10000 (60.51%), error:     12258.22168, best error:     11992.16699 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 2179.9228515625s, input_fired_time: 16.7653007507, output_fired_time: 8.3012199402, propagate_forward_time: 618.3621215820, propagate_backward_time: 1514.6253662109, weight_update_time: 0.8520565629, other_time: 21.8687744141
epoch time: 128.2868041992s, input_fired_time: 3.7272803783, output_fired_time: 0.0000000000, propagate_forward_time: 119.0413818359, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5181427002
validation[          , genome  6413] predictions:    5936/  10000 (59.36%), best:    6051/10000 (60.51%), error:     12493.10156, best error:     11992.16699 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 2177.5715332031s, input_fired_time: 14.8723211288, output_fired_time: 16.3590278625, propagate_forward_time: 622.8762817383, propagate_backward_time: 1505.8297119141, weight_update_time: 4.7739338875, other_time: 17.6341552734
epoch time: 129.7705078125s, input_fired_time: 0.8223478198, output_fired_time: 0.0000000000, propagate_forward_time: 123.4237899780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5243759155
validation[          , genome  6413] predictions:    6053/  10000 (60.53%), best:    6051/10000 (60.51%), error:     12121.64746, best error:     11992.16699 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 2175.0434570313s, input_fired_time: 13.8297882080, output_fired_time: 18.2113132477, propagate_forward_time: 611.4735107422, propagate_backward_time: 1514.8669433594, weight_update_time: 1.8567332029, other_time: 16.6617431641
epoch time: 130.3576812744s, input_fired_time: 0.8343188167, output_fired_time: 0.0000000000, propagate_forward_time: 128.0281219482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4952392578
validation[          , genome  6413] predictions:    6142/  10000 (61.42%), best:    6142/10000 (61.42%), error:     11854.17969, best error:     11854.17969 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 2184.9787597656s, input_fired_time: 8.7711257935, output_fired_time: 14.2883930206, propagate_forward_time: 628.0033569336, propagate_backward_time: 1517.3049316406, weight_update_time: 1.8527129889, other_time: 16.6108398438
epoch time: 127.2317352295s, input_fired_time: 5.8561248779, output_fired_time: 0.0000000000, propagate_forward_time: 114.7977600098, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5778503418
validation[          , genome  6413] predictions:    6123/  10000 (61.23%), best:    6142/10000 (61.42%), error:     11963.46289, best error:     11854.17969 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 2185.1818847656s, input_fired_time: 18.8961582184, output_fired_time: 20.2063732147, propagate_forward_time: 598.4535522461, propagate_backward_time: 1526.8632812500, weight_update_time: 0.8389678597, other_time: 20.7624511719
epoch time: 126.9229431152s, input_fired_time: 2.8397009373, output_fired_time: 0.0000000000, propagate_forward_time: 121.5784683228, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5047760010
validation[          , genome  6413] predictions:    6147/  10000 (61.47%), best:    6142/10000 (61.42%), error:     12051.39746, best error:     11854.17969 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 2181.7485351563s, input_fired_time: 16.8198051453, output_fired_time: 16.2506446838, propagate_forward_time: 607.3916015625, propagate_backward_time: 1524.5399169922, weight_update_time: 0.8413549662, other_time: 16.7464599609
epoch time: 129.8311614990s, input_fired_time: 0.8291071653, output_fired_time: 0.0000000000, propagate_forward_time: 126.4811401367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5209197998
validation[          , genome  6413] predictions:    6020/  10000 (60.20%), best:    6142/10000 (61.42%), error:     12108.39453, best error:     11854.17969 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 2177.4287109375s, input_fired_time: 18.9489154816, output_fired_time: 14.2373914719, propagate_forward_time: 595.7658691406, propagate_backward_time: 1525.6502685547, weight_update_time: 2.8542754650, other_time: 22.8262939453
epoch time: 127.2383499146s, input_fired_time: 1.8254027367, output_fired_time: 0.0000000000, propagate_forward_time: 120.8827819824, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5301666260
validation[          , genome  6413] predictions:    6133/  10000 (61.33%), best:    6142/10000 (61.42%), error:     11977.93652, best error:     11854.17969 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 2180.0207519531s, input_fired_time: 19.9346427917, output_fired_time: 20.0168647766, propagate_forward_time: 601.3835449219, propagate_backward_time: 1513.8896484375, weight_update_time: 0.8624929190, other_time: 24.7961425781
epoch time: 127.6725387573s, input_fired_time: 2.8457036018, output_fired_time: 0.0000000000, propagate_forward_time: 123.3308792114, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4959564209
validation[          , genome  6413] predictions:    6134/  10000 (61.34%), best:    6142/10000 (61.42%), error:     12021.36230, best error:     11854.17969 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 2179.0986328125s, input_fired_time: 17.8989238739, output_fired_time: 29.1339092255, propagate_forward_time: 630.0648803711, propagate_backward_time: 1484.1895751953, weight_update_time: 0.8472865820, other_time: 17.8114013672
epoch time: 130.0612792969s, input_fired_time: 0.8393500447, output_fired_time: 0.0000000000, propagate_forward_time: 123.6069717407, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6149520874
validation[          , genome  6413] predictions:    6083/  10000 (60.83%), best:    6142/10000 (61.42%), error:     12140.07715, best error:     11854.17969 on epoch:    57, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 2176.8022460938s, input_fired_time: 23.7222576141, output_fired_time: 14.2228679657, propagate_forward_time: 612.3845214844, propagate_backward_time: 1509.7336425781, weight_update_time: 1.8535703421, other_time: 16.7390136719
epoch time: 128.5813751221s, input_fired_time: 0.8262146115, output_fired_time: 0.0000000000, propagate_forward_time: 124.2322616577, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5228958130
validation[          , genome  6413] predictions:    6087/  10000 (60.87%), best:    6142/10000 (61.42%), error:     12199.03418, best error:     11854.17969 on epoch:    57, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 2180.6542968750s, input_fired_time: 17.8017311096, output_fired_time: 20.1280994415, propagate_forward_time: 615.0914916992, propagate_backward_time: 1508.8781738281, weight_update_time: 4.8696255684, other_time: 18.7546386719
epoch time: 127.3242568970s, input_fired_time: 0.8311172724, output_fired_time: 0.0000000000, propagate_forward_time: 109.9388580322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.5542831421
validation[          , genome  6413] predictions:    6113/  10000 (61.13%), best:    6142/10000 (61.42%), error:     12078.06738, best error:     11854.17969 on epoch:    57, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 2187.0031738281s, input_fired_time: 20.0050373077, output_fired_time: 13.3532714844, propagate_forward_time: 615.2160644531, propagate_backward_time: 1519.5953369141, weight_update_time: 2.8595829010, other_time: 18.8333740234
epoch time: 127.6933898926s, input_fired_time: 0.8383787274, output_fired_time: 0.0000000000, propagate_forward_time: 120.3072433472, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5477676392
validation[          , genome  6413] predictions:    6075/  10000 (60.75%), best:    6142/10000 (61.42%), error:     12005.53125, best error:     11854.17969 on epoch:    57, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 2181.8435058594s, input_fired_time: 17.8877792358, output_fired_time: 16.3336505890, propagate_forward_time: 633.6909179688, propagate_backward_time: 1483.9688720703, weight_update_time: 2.8668215275, other_time: 29.9622802734
epoch time: 130.6479949951s, input_fired_time: 2.8612654209, output_fired_time: 0.0000000000, propagate_forward_time: 125.2579040527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5288238525
validation[          , genome  6413] predictions:    6188/  10000 (61.88%), best:    6188/10000 (61.88%), error:     11797.32520, best error:     11797.32520 on epoch:    67, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 2181.7409667969s, input_fired_time: 20.8916721344, output_fired_time: 17.2301769257, propagate_forward_time: 616.2882690430, propagate_backward_time: 1501.6108398438, weight_update_time: 4.8621559143, other_time: 25.7199707031
epoch time: 129.9099121094s, input_fired_time: 0.8415852189, output_fired_time: 0.0000000000, propagate_forward_time: 126.6387329102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4295959473
validation[          , genome  6413] predictions:    6108/  10000 (61.08%), best:    6188/10000 (61.88%), error:     11925.13965, best error:     11797.32520 on epoch:    67, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 2172.1123046875s, input_fired_time: 16.9489936829, output_fired_time: 20.2471580505, propagate_forward_time: 621.7581787109, propagate_backward_time: 1494.6748046875, weight_update_time: 0.8318042755, other_time: 18.4832763672
epoch time: 130.0251464844s, input_fired_time: 1.8524458408, output_fired_time: 0.0000000000, propagate_forward_time: 121.6354522705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.5372467041
validation[          , genome  6413] predictions:    6062/  10000 (60.62%), best:    6188/10000 (61.88%), error:     12015.45313, best error:     11797.32520 on epoch:    67, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 2169.2290039063s, input_fired_time: 12.7639694214, output_fired_time: 14.0426254272, propagate_forward_time: 594.4402465820, propagate_backward_time: 1519.1605224609, weight_update_time: 2.8579781055, other_time: 28.8216552734
epoch time: 137.4549407959s, input_fired_time: 0.8550111055, output_fired_time: 0.0000000000, propagate_forward_time: 135.1012878418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4986419678
validation[          , genome  6413] predictions:    6164/  10000 (61.64%), best:    6188/10000 (61.88%), error:     11843.83594, best error:     11797.32520 on epoch:    67, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 2197.0966796875s, input_fired_time: 16.8667430878, output_fired_time: 11.3063220978, propagate_forward_time: 617.2695922852, propagate_backward_time: 1529.4793701172, weight_update_time: 2.1249363422, other_time: 22.1746826172
epoch time: 129.9637145996s, input_fired_time: 2.8673796654, output_fired_time: 0.0000000000, propagate_forward_time: 121.5210342407, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5753021240
validation[          , genome  6413] predictions:    6192/  10000 (61.92%), best:    6188/10000 (61.88%), error:     11819.64063, best error:     11797.32520 on epoch:    67, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 2193.8486328125s, input_fired_time: 14.8023862839, output_fired_time: 13.2193651199, propagate_forward_time: 613.6419067383, propagate_backward_time: 1535.3917236328, weight_update_time: 0.8452211618, other_time: 16.7930908203
epoch time: 130.2304687500s, input_fired_time: 3.8680367470, output_fired_time: 0.0000000000, propagate_forward_time: 124.8691329956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4933013916
validation[          , genome  6413] predictions:    6147/  10000 (61.47%), best:    6188/10000 (61.88%), error:     11932.30762, best error:     11797.32520 on epoch:    67, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 2196.5976562500s, input_fired_time: 21.0315113068, output_fired_time: 9.2172632217, propagate_forward_time: 602.0522460938, propagate_backward_time: 1545.4497070313, weight_update_time: 0.8458099961, other_time: 18.8469238281
epoch time: 129.9824523926s, input_fired_time: 1.8660445213, output_fired_time: 0.0000000000, propagate_forward_time: 126.5971527100, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5192565918
validation[          , genome  6413] predictions:    6161/  10000 (61.61%), best:    6188/10000 (61.88%), error:     11799.66699, best error:     11797.32520 on epoch:    67, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 2197.4748535156s, input_fired_time: 19.0162467957, output_fired_time: 13.3213815689, propagate_forward_time: 602.8972778320, propagate_backward_time: 1540.4481201172, weight_update_time: 2.8541178703, other_time: 21.7918701172
epoch time: 129.7147369385s, input_fired_time: 2.8623342514, output_fired_time: 0.0000000000, propagate_forward_time: 125.3551940918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4972076416
validation[          , genome  6413] predictions:    6228/  10000 (62.28%), best:    6228/10000 (62.28%), error:     11657.82520, best error:     11657.82520 on epoch:    74, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 2192.3681640625s, input_fired_time: 37.1309700012, output_fired_time: 14.2657823563, propagate_forward_time: 587.7711181641, propagate_backward_time: 1527.3997802734, weight_update_time: 1.8370665312, other_time: 25.8005371094
epoch time: 129.7187652588s, input_fired_time: 0.8493523598, output_fired_time: 0.0000000000, propagate_forward_time: 123.3030166626, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5663986206
validation[          , genome  6413] predictions:    6195/  10000 (61.95%), best:    6228/10000 (62.28%), error:     11706.27344, best error:     11657.82520 on epoch:    74, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 2189.9138183594s, input_fired_time: 22.9472236633, output_fired_time: 9.3272275925, propagate_forward_time: 613.1888427734, propagate_backward_time: 1523.5346679688, weight_update_time: 0.8611705303, other_time: 20.9158935547
epoch time: 129.8495941162s, input_fired_time: 0.8554406166, output_fired_time: 0.0000000000, propagate_forward_time: 125.4555206299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5386352539
validation[          , genome  6413] predictions:    6175/  10000 (61.75%), best:    6228/10000 (62.28%), error:     11818.52344, best error:     11657.82520 on epoch:    74, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 2194.3474121094s, input_fired_time: 19.0042037964, output_fired_time: 11.2809247971, propagate_forward_time: 634.0070190430, propagate_backward_time: 1501.1455078125, weight_update_time: 1.8485035896, other_time: 28.9096679688
epoch time: 129.9091644287s, input_fired_time: 0.8595963717, output_fired_time: 0.0000000000, propagate_forward_time: 124.4707794189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5787811279
validation[          , genome  6413] predictions:    6178/  10000 (61.78%), best:    6228/10000 (62.28%), error:     11842.55078, best error:     11657.82520 on epoch:    74, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 2190.7641601563s, input_fired_time: 18.0671920776, output_fired_time: 13.3019590378, propagate_forward_time: 635.5379028320, propagate_backward_time: 1509.0507812500, weight_update_time: 0.8498237729, other_time: 14.8063964844
epoch time: 130.3173980713s, input_fired_time: 3.8839263916, output_fired_time: 0.0000000000, propagate_forward_time: 116.8729553223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.5605163574
validation[          , genome  6413] predictions:    6128/  10000 (61.28%), best:    6228/10000 (62.28%), error:     11965.42676, best error:     11657.82520 on epoch:    74, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 2192.6862792969s, input_fired_time: 12.9554023743, output_fired_time: 10.3215818405, propagate_forward_time: 604.9227294922, propagate_backward_time: 1549.6834716797, weight_update_time: 3.8724205494, other_time: 14.8032226563
epoch time: 132.3605804443s, input_fired_time: 4.8731660843, output_fired_time: 0.0000000000, propagate_forward_time: 123.9501037598, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5373077393
validation[          , genome  6413] predictions:    6141/  10000 (61.41%), best:    6228/10000 (62.28%), error:     12075.26270, best error:     11657.82520 on epoch:    74, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 2197.1042480469s, input_fired_time: 20.0040588379, output_fired_time: 13.2305450439, propagate_forward_time: 614.0559082031, propagate_backward_time: 1528.0830078125, weight_update_time: 2.8422713280, other_time: 21.7307128906
epoch time: 129.9156799316s, input_fired_time: 1.8673899174, output_fired_time: 0.0000000000, propagate_forward_time: 126.5362854004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5120086670
validation[          , genome  6413] predictions:    6225/  10000 (62.25%), best:    6228/10000 (62.28%), error:     11716.25391, best error:     11657.82520 on epoch:    74, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 2190.4619140625s, input_fired_time: 24.1401119232, output_fired_time: 9.3030681610, propagate_forward_time: 636.9544067383, propagate_backward_time: 1497.1676025391, weight_update_time: 0.8607146740, other_time: 22.8968505859
epoch time: 130.0440673828s, input_fired_time: 0.8524641395, output_fired_time: 0.0000000000, propagate_forward_time: 125.6475143433, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5440902710
validation[          , genome  6413] predictions:    6169/  10000 (61.69%), best:    6228/10000 (62.28%), error:     11866.24805, best error:     11657.82520 on epoch:    74, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 2197.1428222656s, input_fired_time: 26.1204948425, output_fired_time: 11.1781864166, propagate_forward_time: 613.1596679688, propagate_backward_time: 1524.7512207031, weight_update_time: 0.8539784551, other_time: 21.9331054688
epoch time: 128.9166870117s, input_fired_time: 0.8660458326, output_fired_time: 0.0000000000, propagate_forward_time: 124.5156936646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5349502563
validation[          , genome  6413] predictions:    6258/  10000 (62.58%), best:    6258/10000 (62.58%), error:     11648.03516, best error:     11648.03516 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 2197.0339355469s, input_fired_time: 10.0327062607, output_fired_time: 12.3798627853, propagate_forward_time: 637.1682128906, propagate_backward_time: 1513.5638427734, weight_update_time: 0.8527922034, other_time: 23.8892822266
epoch time: 129.8623504639s, input_fired_time: 0.8596275449, output_fired_time: 0.0000000000, propagate_forward_time: 124.4578247070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5448913574
validation[          , genome  6413] predictions:    6193/  10000 (61.93%), best:    6258/10000 (62.58%), error:     11931.56641, best error:     11648.03516 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 2190.4404296875s, input_fired_time: 16.9343757629, output_fired_time: 16.2347450256, propagate_forward_time: 607.7165527344, propagate_backward_time: 1521.5825195313, weight_update_time: 1.8697007895, other_time: 27.9721679688
epoch time: 131.4824676514s, input_fired_time: 0.8801411390, output_fired_time: 0.0000000000, propagate_forward_time: 125.0389862061, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5633392334
validation[          , genome  6413] predictions:    6209/  10000 (62.09%), best:    6258/10000 (62.58%), error:     11732.02832, best error:     11648.03516 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 2194.4274902344s, input_fired_time: 18.9843044281, output_fired_time: 16.4034576416, propagate_forward_time: 599.8383178711, propagate_backward_time: 1545.5584716797, weight_update_time: 0.8642692566, other_time: 13.6427001953
epoch time: 131.2668914795s, input_fired_time: 2.8749196529, output_fired_time: 0.0000000000, propagate_forward_time: 126.9125747681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4793930054
validation[          , genome  6413] predictions:    6211/  10000 (62.11%), best:    6258/10000 (62.58%), error:     11668.19141, best error:     11648.03516 on epoch:    82, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 2188.8491210938s, input_fired_time: 18.9474506378, output_fired_time: 17.2485370636, propagate_forward_time: 605.4573364258, propagate_backward_time: 1522.2784423828, weight_update_time: 2.8598382473, other_time: 24.9173583984
epoch time: 130.2578430176s, input_fired_time: 2.8815011978, output_fired_time: 0.0000000000, propagate_forward_time: 125.8450164795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5313262939
validation[          , genome  6413] predictions:    6237/  10000 (62.37%), best:    6258/10000 (62.58%), error:     11664.37695, best error:     11648.03516 on epoch:    82, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 2192.8022460938s, input_fired_time: 26.0076293945, output_fired_time: 14.1337509155, propagate_forward_time: 599.9030151367, propagate_backward_time: 1536.9758300781, weight_update_time: 1.8402749300, other_time: 15.7819824219
epoch time: 127.7431030273s, input_fired_time: 4.8851666451, output_fired_time: 0.0000000000, propagate_forward_time: 120.3264846802, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5314483643
validation[          , genome  6413] predictions:    6185/  10000 (61.85%), best:    6258/10000 (62.58%), error:     11753.27832, best error:     11648.03516 on epoch:    82, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 2189.9833984375s, input_fired_time: 15.0454368591, output_fired_time: 14.2942304611, propagate_forward_time: 626.1492919922, propagate_backward_time: 1522.7496337891, weight_update_time: 0.8502585888, other_time: 11.7448730469
epoch time: 128.2856292725s, input_fired_time: 1.8685574532, output_fired_time: 0.0000000000, propagate_forward_time: 123.8792648315, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5378036499
validation[          , genome  6413] predictions:    6217/  10000 (62.17%), best:    6258/10000 (62.58%), error:     11780.53125, best error:     11648.03516 on epoch:    82, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 2195.6547851563s, input_fired_time: 28.0494747162, output_fired_time: 17.2538452148, propagate_forward_time: 618.5122680664, propagate_backward_time: 1509.1085205078, weight_update_time: 0.8359246254, other_time: 22.7305908203
epoch time: 128.3399353027s, input_fired_time: 0.8511636853, output_fired_time: 0.0000000000, propagate_forward_time: 125.9836502075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5051193237
validation[          , genome  6413] predictions:    6211/  10000 (62.11%), best:    6258/10000 (62.58%), error:     11746.12793, best error:     11648.03516 on epoch:    82, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 2192.4604492188s, input_fired_time: 20.0876789093, output_fired_time: 9.2766160965, propagate_forward_time: 640.8755493164, propagate_backward_time: 1492.5954589844, weight_update_time: 0.8241164684, other_time: 29.6252441406
epoch time: 127.8503112793s, input_fired_time: 3.8761715889, output_fired_time: 0.0000000000, propagate_forward_time: 119.4281082153, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5460281372
validation[          , genome  6413] predictions:    6241/  10000 (62.41%), best:    6258/10000 (62.58%), error:     11692.85742, best error:     11648.03516 on epoch:    82, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 2190.1040039063s, input_fired_time: 18.1202735901, output_fired_time: 9.2332477570, propagate_forward_time: 640.8187866211, propagate_backward_time: 1497.1131591797, weight_update_time: 1.8567227125, other_time: 24.8184814453
epoch time: 129.8790130615s, input_fired_time: 1.8613566160, output_fired_time: 0.0000000000, propagate_forward_time: 125.4990310669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5186233521
validation[          , genome  6413] predictions:    6216/  10000 (62.16%), best:    6258/10000 (62.58%), error:     11690.87012, best error:     11648.03516 on epoch:    82, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 2197.3137207031s, input_fired_time: 15.0953445435, output_fired_time: 9.0747375488, propagate_forward_time: 624.2391967773, propagate_backward_time: 1530.1735839844, weight_update_time: 0.8494427204, other_time: 18.7307128906
epoch time: 128.6501007080s, input_fired_time: 1.8561352491, output_fired_time: 0.0000000000, propagate_forward_time: 123.2797470093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5142211914
validation[          , genome  6413] predictions:    6209/  10000 (62.09%), best:    6258/10000 (62.58%), error:     11716.68555, best error:     11648.03516 on epoch:    82, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 2196.6853027344s, input_fired_time: 28.0204143524, output_fired_time: 11.3110227585, propagate_forward_time: 600.1895751953, propagate_backward_time: 1540.5603027344, weight_update_time: 0.8507871032, other_time: 16.6038818359
epoch time: 128.5957794189s, input_fired_time: 0.8609064817, output_fired_time: 0.0000000000, propagate_forward_time: 120.2634963989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4713745117
validation[          , genome  6413] predictions:    6201/  10000 (62.01%), best:    6258/10000 (62.58%), error:     11809.12988, best error:     11648.03516 on epoch:    82, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 2245.1081542969s, input_fired_time: 22.2843170166, output_fired_time: 18.3243122101, propagate_forward_time: 634.7869262695, propagate_backward_time: 1548.6505126953, weight_update_time: 0.8708910346, other_time: 21.0621337891
epoch time: 135.3473663330s, input_fired_time: 4.8183426857, output_fired_time: 0.0000000000, propagate_forward_time: 123.8870010376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6420211792
validation[          , genome  6413] predictions:    6250/  10000 (62.50%), best:    6250/10000 (62.50%), error:     11631.19238, best error:     11631.19238 on epoch:    94, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 2209.7519531250s, input_fired_time: 18.0144462585, output_fired_time: 10.3448610306, propagate_forward_time: 633.8776855469, propagate_backward_time: 1508.6087646484, weight_update_time: 3.8672440052, other_time: 38.9061279297
epoch time: 129.8180084229s, input_fired_time: 2.8736257553, output_fired_time: 0.0000000000, propagate_forward_time: 121.4324493408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5119323730
validation[          , genome  6413] predictions:    6233/  10000 (62.33%), best:    6250/10000 (62.50%), error:     11719.96094, best error:     11631.19238 on epoch:    94, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 2187.1918945313s, input_fired_time: 24.8986053467, output_fired_time: 19.2124748230, propagate_forward_time: 640.5928955078, propagate_backward_time: 1482.6903076172, weight_update_time: 0.8480917215, other_time: 19.7976074219
epoch time: 129.8695068359s, input_fired_time: 1.8691710234, output_fired_time: 0.0000000000, propagate_forward_time: 126.4852752686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5150604248
validation[          , genome  6413] predictions:    6254/  10000 (62.54%), best:    6250/10000 (62.50%), error:     11669.05469, best error:     11631.19238 on epoch:    94, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 2181.9589843750s, input_fired_time: 22.9832057953, output_fired_time: 15.3104820251, propagate_forward_time: 624.7507934570, propagate_backward_time: 1493.0993652344, weight_update_time: 2.8513226509, other_time: 25.8151855469
epoch time: 128.5270690918s, input_fired_time: 1.8683174849, output_fired_time: 0.0000000000, propagate_forward_time: 122.1137542725, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5449981689
validation[          , genome  6413] predictions:    6281/  10000 (62.81%), best:    6281/10000 (62.81%), error:     11622.18457, best error:     11622.18457 on epoch:    97, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 2189.9348144531s, input_fired_time: 20.0900554657, output_fired_time: 9.2840423584, propagate_forward_time: 616.2083740234, propagate_backward_time: 1525.5911865234, weight_update_time: 0.8374553919, other_time: 18.7612304688
epoch time: 130.8079681396s, input_fired_time: 0.8616246581, output_fired_time: 0.0000000000, propagate_forward_time: 128.3952484131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.5511016846
validation[          , genome  6413] predictions:    6215/  10000 (62.15%), best:    6281/10000 (62.81%), error:     11693.22852, best error:     11622.18457 on epoch:    97, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 2196.4658203125s, input_fired_time: 17.0798034668, output_fired_time: 18.4057846069, propagate_forward_time: 619.3715209961, propagate_backward_time: 1514.7030029297, weight_update_time: 3.8715267181, other_time: 26.9056396484
epoch time: 127.4075241089s, input_fired_time: 4.7774958611, output_fired_time: 0.0000000000, propagate_forward_time: 120.0957641602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5342636108
validation[          , genome  6413] predictions:    6251/  10000 (62.51%), best:    6281/10000 (62.81%), error:     11636.73047, best error:     11622.18457 on epoch:    97, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 2194.3630371094s, input_fired_time: 17.9206886292, output_fired_time: 21.3676242828, propagate_forward_time: 608.6500854492, propagate_backward_time: 1520.5346679688, weight_update_time: 4.8654007912, other_time: 25.8898925781
epoch time: 130.2123870850s, input_fired_time: 0.8639924526, output_fired_time: 0.0000000000, propagate_forward_time: 123.8758087158, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4725799561
validation[          , genome  6413] predictions:    6223/  10000 (62.23%), best:    6281/10000 (62.81%), error:     11679.24219, best error:     11622.18457 on epoch:    97, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 645.9200439453s, input_fired_time: 13.3731832504, output_fired_time: 0.0000000000, propagate_forward_time: 614.7821655273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 17.7647094727
best training[          , genome  6413] predictions:   41622/  50000 (83.24%), best:    6281/10000 (62.81%), error:     26819.75195, best error:     11622.18457 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 127.5656280518s, input_fired_time: 1.8576600552, output_fired_time: 0.0000000000, propagate_forward_time: 121.9824523926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7255172729
   testing[          , genome  6413] predictions:    6281/  10000 (62.81%), best:    6281/10000 (62.81%), error:     11622.18457, best error:     11622.18457 on epoch:    97, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
16:27:17 (20564): called boinc_finish(0)

</stderr_txt>
]]>