Nameexact_genome_1542365403_183_6063_0
Workunit4092899
Created16 Nov 2018, 15:44:00 UTC
Sent16 Nov 2018, 15:50:50 UTC
Report deadline28 Jan 2019, 17:56:08 UTC
Received19 Nov 2018, 23:25:49 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID43734
Run time3 days 2 hours 36 min 51 sec
CPU time2 days 23 hours 29 min 14 sec
Validate stateValid
Credit18,271.76
Device peak FLOPS1.13 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34

Stderr output

<core_client_version>7.2.47</core_client_version>
<![CDATA[
<stderr_txt>
   15507.74023, best error:     13754.31152 on epoch:    14, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 2582.1516113281s, input_fired_time: 18.2557907104, output_fired_time: 14.7529039383, propagate_forward_time: 972.6472778320, propagate_backward_time: 1540.5270996094, weight_update_time: 6.6462140083, other_time: 35.9685058594
epoch time: 200.1071472168s, input_fired_time: 2.1684186459, output_fired_time: 0.0000000000, propagate_forward_time: 193.1830444336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7556915283
validation[          , genome  6063] predictions:    5015/  10000 (50.15%), best:    5484/10000 (54.84%), error:     16637.96289, best error:     13754.31152 on epoch:    14, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 2567.4206542969s, input_fired_time: 18.2111148834, output_fired_time: 13.7132987976, propagate_forward_time: 971.2079467773, propagate_backward_time: 1537.4316406250, weight_update_time: 6.4749164581, other_time: 26.8564453125
epoch time: 200.9535980225s, input_fired_time: 2.2074351311, output_fired_time: 0.0000000000, propagate_forward_time: 194.7706604004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9755096436
validation[          , genome  6063] predictions:    5508/  10000 (55.08%), best:    5484/10000 (54.84%), error:     13808.07129, best error:     13754.31152 on epoch:    14, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 2571.7849121094s, input_fired_time: 18.4345417023, output_fired_time: 13.7494029999, propagate_forward_time: 974.6695556641, propagate_backward_time: 1537.8419189453, weight_update_time: 7.5398402214, other_time: 27.0893554688
epoch time: 199.7581787109s, input_fired_time: 2.1120519638, output_fired_time: 0.0000000000, propagate_forward_time: 193.9088287354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7373046875
validation[          , genome  6063] predictions:    5249/  10000 (52.49%), best:    5484/10000 (54.84%), error:     14611.85352, best error:     13754.31152 on epoch:    14, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 2577.7216796875s, input_fired_time: 17.3520145416, output_fired_time: 13.9716224670, propagate_forward_time: 974.6727905273, propagate_backward_time: 1543.2167968750, weight_update_time: 8.5357236862, other_time: 28.5083007813
epoch time: 201.5871124268s, input_fired_time: 2.1485214233, output_fired_time: 0.0000000000, propagate_forward_time: 194.6614379883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7771606445
validation[          , genome  6063] predictions:    5317/  10000 (53.17%), best:    5484/10000 (54.84%), error:     14512.34766, best error:     13754.31152 on epoch:    14, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 2575.2348632813s, input_fired_time: 18.0741348267, output_fired_time: 14.7805929184, propagate_forward_time: 970.9976806641, propagate_backward_time: 1543.2583007813, weight_update_time: 6.5517435074, other_time: 28.1241455078
epoch time: 198.0631408691s, input_fired_time: 2.1241660118, output_fired_time: 0.0000000000, propagate_forward_time: 192.2187500000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7202301025
validation[          , genome  6063] predictions:    5158/  10000 (51.58%), best:    5484/10000 (54.84%), error:     14937.51758, best error:     13754.31152 on epoch:    14, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 2565.7744140625s, input_fired_time: 18.4067573547, output_fired_time: 14.7239341736, propagate_forward_time: 975.5723876953, propagate_backward_time: 1531.0924072266, weight_update_time: 6.5037336349, other_time: 25.9790039063
epoch time: 199.7168731689s, input_fired_time: 2.1207189560, output_fired_time: 0.0000000000, propagate_forward_time: 193.8724670410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7236938477
validation[          , genome  6063] predictions:    5438/  10000 (54.38%), best:    5484/10000 (54.84%), error:     14100.86230, best error:     13754.31152 on epoch:    14, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 2568.6430664063s, input_fired_time: 18.3256130219, output_fired_time: 14.7451620102, propagate_forward_time: 971.5397338867, propagate_backward_time: 1538.1326904297, weight_update_time: 6.4286379814, other_time: 25.8997802734
epoch time: 197.6690063477s, input_fired_time: 2.1369426250, output_fired_time: 0.0000000000, propagate_forward_time: 190.7963256836, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7357330322
validation[          , genome  6063] predictions:    5378/  10000 (53.78%), best:    5484/10000 (54.84%), error:     14550.07422, best error:     13754.31152 on epoch:    14, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 2559.9370117188s, input_fired_time: 19.4938392639, output_fired_time: 13.6118898392, propagate_forward_time: 967.3114013672, propagate_backward_time: 1532.5490722656, weight_update_time: 6.4850397110, other_time: 26.9708251953
epoch time: 199.8779754639s, input_fired_time: 2.1668272018, output_fired_time: 0.0000000000, propagate_forward_time: 193.8972167969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8139343262
validation[          , genome  6063] predictions:    5368/  10000 (53.68%), best:    5484/10000 (54.84%), error:     14356.08594, best error:     13754.31152 on epoch:    14, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 2551.8444824219s, input_fired_time: 17.3782024384, output_fired_time: 14.6124925613, propagate_forward_time: 968.0710449219, propagate_backward_time: 1524.7113037109, weight_update_time: 6.5055909157, other_time: 27.0714111328
epoch time: 199.3680267334s, input_fired_time: 2.1839332581, output_fired_time: 0.0000000000, propagate_forward_time: 193.3618011475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8222961426
validation[          , genome  6063] predictions:    5321/  10000 (53.21%), best:    5484/10000 (54.84%), error:     14562.34668, best error:     13754.31152 on epoch:    14, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 2541.2160644531s, input_fired_time: 18.4028415680, output_fired_time: 14.6018056870, propagate_forward_time: 951.2484130859, propagate_backward_time: 1528.7069091797, weight_update_time: 6.5637216568, other_time: 28.2561035156
epoch time: 196.8160095215s, input_fired_time: 2.1792225838, output_fired_time: 0.0000000000, propagate_forward_time: 190.7941894531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8425903320
validation[          , genome  6063] predictions:    5525/  10000 (55.25%), best:    5484/10000 (54.84%), error:     13998.67578, best error:     13754.31152 on epoch:    14, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 2550.7521972656s, input_fired_time: 17.3547096252, output_fired_time: 14.8624486923, propagate_forward_time: 959.9898681641, propagate_backward_time: 1532.4012451172, weight_update_time: 6.5872430801, other_time: 26.1437988281
epoch time: 201.3178253174s, input_fired_time: 2.1945323944, output_fired_time: 0.0000000000, propagate_forward_time: 195.3391113281, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7841796875
validation[          , genome  6063] predictions:    5711/  10000 (57.11%), best:    5711/10000 (57.11%), error:     12927.03906, best error:     12927.03906 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 2544.1201171875s, input_fired_time: 18.4527969360, output_fired_time: 13.6867313385, propagate_forward_time: 960.0940551758, propagate_backward_time: 1523.6976318359, weight_update_time: 8.5279664993, other_time: 28.1888427734
epoch time: 195.9103546143s, input_fired_time: 2.1522781849, output_fired_time: 0.0000000000, propagate_forward_time: 189.9873199463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7707519531
validation[          , genome  6063] predictions:    5518/  10000 (55.18%), best:    5711/10000 (57.11%), error:     13608.67090, best error:     12927.03906 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 2541.1513671875s, input_fired_time: 18.4874153137, output_fired_time: 14.6464557648, propagate_forward_time: 950.0474243164, propagate_backward_time: 1530.5507812500, weight_update_time: 6.6252555847, other_time: 27.4194335938
epoch time: 197.9406738281s, input_fired_time: 2.1746375561, output_fired_time: 0.0000000000, propagate_forward_time: 190.9620056152, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8040313721
validation[          , genome  6063] predictions:    5517/  10000 (55.17%), best:    5711/10000 (57.11%), error:     13902.89551, best error:     12927.03906 on epoch:    26, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 2544.2368164063s, input_fired_time: 17.4803409576, output_fired_time: 13.5619773865, propagate_forward_time: 945.6848144531, propagate_backward_time: 1540.2792968750, weight_update_time: 7.5711145401, other_time: 27.2304687500
epoch time: 198.7705383301s, input_fired_time: 2.1895325184, output_fired_time: 0.0000000000, propagate_forward_time: 192.7439575195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8370513916
validation[          , genome  6063] predictions:    5546/  10000 (55.46%), best:    5711/10000 (57.11%), error:     13988.36133, best error:     12927.03906 on epoch:    26, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 2551.3552246094s, input_fired_time: 17.4926986694, output_fired_time: 13.7171907425, propagate_forward_time: 949.8456420898, propagate_backward_time: 1544.0346679688, weight_update_time: 6.5909533501, other_time: 26.2648925781
epoch time: 199.4492187500s, input_fired_time: 2.1475524902, output_fired_time: 0.0000000000, propagate_forward_time: 193.4903564453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8113098145
validation[          , genome  6063] predictions:    5530/  10000 (55.30%), best:    5711/10000 (57.11%), error:     13674.24219, best error:     12927.03906 on epoch:    26, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 2552.7502441406s, input_fired_time: 19.4698982239, output_fired_time: 14.7997741699, propagate_forward_time: 964.7946166992, propagate_backward_time: 1525.6135253906, weight_update_time: 8.5465812683, other_time: 28.0722656250
epoch time: 196.8529052734s, input_fired_time: 2.1708030701, output_fired_time: 0.0000000000, propagate_forward_time: 190.8869934082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7951049805
validation[          , genome  6063] predictions:    5612/  10000 (56.12%), best:    5711/10000 (57.11%), error:     13481.45508, best error:     12927.03906 on epoch:    26, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 2545.7602539063s, input_fired_time: 17.6236553192, output_fired_time: 14.7188644409, propagate_forward_time: 954.1116943359, propagate_backward_time: 1531.1198730469, weight_update_time: 7.4645962715, other_time: 28.1864013672
epoch time: 197.0491180420s, input_fired_time: 2.1760456562, output_fired_time: 0.0000000000, propagate_forward_time: 191.0903625488, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7827148438
validation[          , genome  6063] predictions:    5646/  10000 (56.46%), best:    5711/10000 (57.11%), error:     13305.53027, best error:     12927.03906 on epoch:    26, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 2546.4130859375s, input_fired_time: 21.7138481140, output_fired_time: 14.6602535248, propagate_forward_time: 956.9135131836, propagate_backward_time: 1525.8369140625, weight_update_time: 6.5557141304, other_time: 27.2885742188
epoch time: 198.7888793945s, input_fired_time: 2.2034258842, output_fired_time: 0.0000000000, propagate_forward_time: 192.7266235352, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8588256836
validation[          , genome  6063] predictions:    5552/  10000 (55.52%), best:    5711/10000 (57.11%), error:     13739.29004, best error:     12927.03906 on epoch:    26, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 2553.0329589844s, input_fired_time: 18.7208366394, output_fired_time: 13.6468629837, propagate_forward_time: 960.7686157227, propagate_backward_time: 1531.7358398438, weight_update_time: 7.5033240318, other_time: 28.1606445313
epoch time: 196.0719299316s, input_fired_time: 2.3047254086, output_fired_time: 0.0000000000, propagate_forward_time: 189.9355926514, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8316192627
validation[          , genome  6063] predictions:    5783/  10000 (57.83%), best:    5711/10000 (57.11%), error:     13072.91113, best error:     12927.03906 on epoch:    26, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 2551.0751953125s, input_fired_time: 21.8864173889, output_fired_time: 13.7844400406, propagate_forward_time: 957.7370605469, propagate_backward_time: 1527.5443115234, weight_update_time: 6.7157526016, other_time: 30.1229248047
epoch time: 199.8868713379s, input_fired_time: 2.4997007847, output_fired_time: 0.0000000000, propagate_forward_time: 192.4687805176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9183959961
validation[          , genome  6063] predictions:    5890/  10000 (58.90%), best:    5890/10000 (58.90%), error:     12345.13770, best error:     12345.13770 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 2554.1887207031s, input_fired_time: 18.6435070038, output_fired_time: 13.6269235611, propagate_forward_time: 964.3818969727, propagate_backward_time: 1531.3646240234, weight_update_time: 6.6140537262, other_time: 26.1717529297
epoch time: 196.9436645508s, input_fired_time: 2.1850881577, output_fired_time: 0.0000000000, propagate_forward_time: 190.9503631592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8082122803
validation[          , genome  6063] predictions:    5857/  10000 (58.57%), best:    5890/10000 (58.90%), error:     12754.08398, best error:     12345.13770 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 2551.6018066406s, input_fired_time: 18.6810054779, output_fired_time: 14.6721601486, propagate_forward_time: 968.9367065430, propagate_backward_time: 1522.0979003906, weight_update_time: 7.6120414734, other_time: 27.2141113281
epoch time: 197.9710845947s, input_fired_time: 3.2102167606, output_fired_time: 0.0000000000, propagate_forward_time: 190.9745178223, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7863464355
validation[          , genome  6063] predictions:    5905/  10000 (59.05%), best:    5890/10000 (58.90%), error:     12556.18457, best error:     12345.13770 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 2551.6953125000s, input_fired_time: 18.8367118835, output_fired_time: 14.6855602264, propagate_forward_time: 960.5317382813, propagate_backward_time: 1530.4556884766, weight_update_time: 6.5781812668, other_time: 27.1856689453
epoch time: 196.3444519043s, input_fired_time: 3.2127034664, output_fired_time: 0.0000000000, propagate_forward_time: 189.3519592285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7797851563
validation[          , genome  6063] predictions:    5642/  10000 (56.42%), best:    5890/10000 (58.90%), error:     13520.87207, best error:     12345.13770 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 2604.2331542969s, input_fired_time: 20.9761848450, output_fired_time: 15.8176851273, propagate_forward_time: 988.0878906250, propagate_backward_time: 1549.5096435547, weight_update_time: 6.7035965919, other_time: 29.8419189453
epoch time: 197.9867248535s, input_fired_time: 2.2266047001, output_fired_time: 0.0000000000, propagate_forward_time: 191.8866271973, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8734893799
validation[          , genome  6063] predictions:    5771/  10000 (57.71%), best:    5890/10000 (58.90%), error:     12774.42871, best error:     12345.13770 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 2548.5498046875s, input_fired_time: 18.7017974854, output_fired_time: 15.6423463821, propagate_forward_time: 953.1939697266, propagate_backward_time: 1534.8525390625, weight_update_time: 6.6102590561, other_time: 26.1590576172
epoch time: 196.1620178223s, input_fired_time: 2.2266759872, output_fired_time: 0.0000000000, propagate_forward_time: 190.1092529297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8260955811
validation[          , genome  6063] predictions:    5862/  10000 (58.62%), best:    5890/10000 (58.90%), error:     12745.97656, best error:     12345.13770 on epoch:    35, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 2541.3591308594s, input_fired_time: 18.1301803589, output_fired_time: 13.5387306213, propagate_forward_time: 958.1246948242, propagate_backward_time: 1522.4738769531, weight_update_time: 7.5344128609, other_time: 29.0915527344
epoch time: 197.4127960205s, input_fired_time: 2.2268791199, output_fired_time: 0.0000000000, propagate_forward_time: 191.3852081299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8007049561
validation[          , genome  6063] predictions:    5949/  10000 (59.49%), best:    5890/10000 (58.90%), error:     12390.53906, best error:     12345.13770 on epoch:    35, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 2557.7209472656s, input_fired_time: 17.8012466431, output_fired_time: 13.7847881317, propagate_forward_time: 965.2088012695, propagate_backward_time: 1532.7470703125, weight_update_time: 6.5206604004, other_time: 28.1791992188
epoch time: 197.4441375732s, input_fired_time: 2.2068467140, output_fired_time: 0.0000000000, propagate_forward_time: 191.3723297119, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8649597168
validation[          , genome  6063] predictions:    5846/  10000 (58.46%), best:    5890/10000 (58.90%), error:     12701.50098, best error:     12345.13770 on epoch:    35, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 2558.8562011719s, input_fired_time: 18.8873672485, output_fired_time: 14.7271213531, propagate_forward_time: 963.1529541016, propagate_backward_time: 1535.6546630859, weight_update_time: 6.5732917786, other_time: 26.4340820313
epoch time: 196.8199005127s, input_fired_time: 2.2682659626, output_fired_time: 0.0000000000, propagate_forward_time: 190.7378387451, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8137969971
validation[          , genome  6063] predictions:    5915/  10000 (59.15%), best:    5890/10000 (58.90%), error:     12638.41113, best error:     12345.13770 on epoch:    35, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 2560.1782226563s, input_fired_time: 19.9821376801, output_fired_time: 15.0352935791, propagate_forward_time: 957.1425170898, propagate_backward_time: 1540.5631103516, weight_update_time: 6.6311588287, other_time: 27.4549560547
epoch time: 207.0905914307s, input_fired_time: 2.3510253429, output_fired_time: 0.0000000000, propagate_forward_time: 200.7830657959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9564971924
validation[          , genome  6063] predictions:    5867/  10000 (58.67%), best:    5890/10000 (58.90%), error:     12628.97754, best error:     12345.13770 on epoch:    35, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 2786.3666992188s, input_fired_time: 20.9230117798, output_fired_time: 15.8676319122, propagate_forward_time: 1041.5582275391, propagate_backward_time: 1674.2714843750, weight_update_time: 8.5083599091, other_time: 33.7462158203
epoch time: 218.1319580078s, input_fired_time: 3.5638298988, output_fired_time: 0.0000000000, propagate_forward_time: 210.2557373047, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3123931885
validation[          , genome  6063] predictions:    5983/  10000 (59.83%), best:    5983/10000 (59.83%), error:     12255.20508, best error:     12255.20508 on epoch:    45, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 2800.7939453125s, input_fired_time: 21.9986305237, output_fired_time: 15.0396108627, propagate_forward_time: 1040.9113769531, propagate_backward_time: 1692.3043212891, weight_update_time: 8.3392000198, other_time: 30.5401611328
epoch time: 214.3704071045s, input_fired_time: 2.4806425571, output_fired_time: 0.0000000000, propagate_forward_time: 207.6591949463, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2305755615
validation[          , genome  6063] predictions:    5913/  10000 (59.13%), best:    5983/10000 (59.83%), error:     12349.07715, best error:     12255.20508 on epoch:    45, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 2871.8164062500s, input_fired_time: 22.3314628601, output_fired_time: 15.1280250549, propagate_forward_time: 1065.0661621094, propagate_backward_time: 1734.7254638672, weight_update_time: 7.6056113243, other_time: 34.5653076172
epoch time: 217.0014038086s, input_fired_time: 2.5509572029, output_fired_time: 0.0000000000, propagate_forward_time: 209.9562072754, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4942321777
validation[          , genome  6063] predictions:    5982/  10000 (59.82%), best:    5982/10000 (59.82%), error:     11942.70898, best error:     11942.70898 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 2836.5053710938s, input_fired_time: 21.3801670074, output_fired_time: 15.1084737778, propagate_forward_time: 1047.8701171875, propagate_backward_time: 1720.1707763672, weight_update_time: 7.4693875313, other_time: 31.9759521484
epoch time: 198.8491821289s, input_fired_time: 2.2389762402, output_fired_time: 0.0000000000, propagate_forward_time: 192.8179168701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7922821045
validation[          , genome  6063] predictions:    5949/  10000 (59.49%), best:    5982/10000 (59.82%), error:     12201.54492, best error:     11942.70898 on epoch:    47, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 2559.8312988281s, input_fired_time: 19.9745388031, output_fired_time: 15.9353418350, propagate_forward_time: 951.2883300781, propagate_backward_time: 1545.2979736328, weight_update_time: 7.6626391411, other_time: 27.3350830078
epoch time: 195.9532623291s, input_fired_time: 3.2859122753, output_fired_time: 0.0000000000, propagate_forward_time: 187.8784790039, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7888641357
validation[          , genome  6063] predictions:    6007/  10000 (60.07%), best:    5982/10000 (59.82%), error:     12077.06348, best error:     11942.70898 on epoch:    47, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 2553.3171386719s, input_fired_time: 20.1014690399, output_fired_time: 13.6355972290, propagate_forward_time: 966.0805664063, propagate_backward_time: 1526.0938720703, weight_update_time: 6.6051964760, other_time: 27.4056396484
epoch time: 197.7228240967s, input_fired_time: 2.2503197193, output_fired_time: 0.0000000000, propagate_forward_time: 191.6516265869, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8208770752
validation[          , genome  6063] predictions:    6032/  10000 (60.32%), best:    5982/10000 (59.82%), error:     12104.44336, best error:     11942.70898 on epoch:    47, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 2550.5197753906s, input_fired_time: 18.9206619263, output_fired_time: 14.8824329376, propagate_forward_time: 956.5299682617, propagate_backward_time: 1531.0815429688, weight_update_time: 6.5702695847, other_time: 29.1052246094
epoch time: 197.3933105469s, input_fired_time: 2.2755768299, output_fired_time: 0.0000000000, propagate_forward_time: 190.3537902832, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7639465332
validation[          , genome  6063] predictions:    5985/  10000 (59.85%), best:    5982/10000 (59.82%), error:     12130.74121, best error:     11942.70898 on epoch:    47, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 2548.9443359375s, input_fired_time: 18.2022476196, output_fired_time: 13.6350069046, propagate_forward_time: 959.0809936523, propagate_backward_time: 1530.6771240234, weight_update_time: 7.6118545532, other_time: 27.3489990234
epoch time: 197.0688781738s, input_fired_time: 2.3010644913, output_fired_time: 0.0000000000, propagate_forward_time: 190.9289550781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8388519287
validation[          , genome  6063] predictions:    6005/  10000 (60.05%), best:    5982/10000 (59.82%), error:     12390.27734, best error:     11942.70898 on epoch:    47, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 2555.6206054688s, input_fired_time: 19.1768283844, output_fired_time: 13.7948970795, propagate_forward_time: 969.2612915039, propagate_backward_time: 1526.1530761719, weight_update_time: 6.5368580818, other_time: 27.2346191406
epoch time: 197.0312500000s, input_fired_time: 2.3231911659, output_fired_time: 0.0000000000, propagate_forward_time: 190.9340057373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7740478516
validation[          , genome  6063] predictions:    6049/  10000 (60.49%), best:    5982/10000 (59.82%), error:     12177.34180, best error:     11942.70898 on epoch:    47, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 2552.6467285156s, input_fired_time: 19.2714099884, output_fired_time: 16.9181232452, propagate_forward_time: 958.1719360352, propagate_backward_time: 1529.8875732422, weight_update_time: 6.5747838020, other_time: 28.3975830078
epoch time: 196.5498962402s, input_fired_time: 3.3736979961, output_fired_time: 0.0000000000, propagate_forward_time: 189.3369140625, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8392791748
validation[          , genome  6063] predictions:    5955/  10000 (59.55%), best:    5982/10000 (59.82%), error:     12276.51270, best error:     11942.70898 on epoch:    47, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 2552.6784667969s, input_fired_time: 19.2013950348, output_fired_time: 13.7817592621, propagate_forward_time: 962.0180664063, propagate_backward_time: 1530.5480957031, weight_update_time: 7.5668821335, other_time: 27.1291503906
epoch time: 197.4279022217s, input_fired_time: 2.2499809265, output_fired_time: 0.0000000000, propagate_forward_time: 191.3300018311, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8479156494
validation[          , genome  6063] predictions:    5985/  10000 (59.85%), best:    5982/10000 (59.82%), error:     12002.72168, best error:     11942.70898 on epoch:    47, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 2551.5930175781s, input_fired_time: 19.0460968018, output_fired_time: 13.6547012329, propagate_forward_time: 964.7760009766, propagate_backward_time: 1527.8454589844, weight_update_time: 6.5851340294, other_time: 26.2706298828
epoch time: 198.9691009521s, input_fired_time: 2.3010263443, output_fired_time: 0.0000000000, propagate_forward_time: 192.8565979004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8114776611
validation[          , genome  6063] predictions:    5941/  10000 (59.41%), best:    5982/10000 (59.82%), error:     12428.20898, best error:     11942.70898 on epoch:    47, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 2552.4538574219s, input_fired_time: 21.0113410950, output_fired_time: 15.7355422974, propagate_forward_time: 956.0173950195, propagate_backward_time: 1532.6202392578, weight_update_time: 6.5620989799, other_time: 27.0694580078
epoch time: 197.5025329590s, input_fired_time: 3.2169916630, output_fired_time: 0.0000000000, propagate_forward_time: 190.5073089600, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7782287598
validation[          , genome  6063] predictions:    5965/  10000 (59.65%), best:    5982/10000 (59.82%), error:     12268.16504, best error:     11942.70898 on epoch:    47, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 2545.4990234375s, input_fired_time: 18.1008586884, output_fired_time: 14.6868324280, propagate_forward_time: 956.0512695313, propagate_backward_time: 1528.3955078125, weight_update_time: 6.5695295334, other_time: 28.2646484375
epoch time: 201.8450164795s, input_fired_time: 2.2976748943, output_fired_time: 0.0000000000, propagate_forward_time: 194.7984771729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7488708496
validation[          , genome  6063] predictions:    6071/  10000 (60.71%), best:    5982/10000 (59.82%), error:     12026.46484, best error:     11942.70898 on epoch:    47, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 2552.1059570313s, input_fired_time: 20.2789783478, output_fired_time: 13.6867027283, propagate_forward_time: 962.9158935547, propagate_backward_time: 1528.1623535156, weight_update_time: 7.5135078430, other_time: 27.0618896484
epoch time: 197.9081268311s, input_fired_time: 2.3225424290, output_fired_time: 0.0000000000, propagate_forward_time: 190.7851409912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8004455566
validation[          , genome  6063] predictions:    6025/  10000 (60.25%), best:    5982/10000 (59.82%), error:     12187.66992, best error:     11942.70898 on epoch:    47, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 2552.7592773438s, input_fired_time: 18.2484817505, output_fired_time: 13.6841764450, propagate_forward_time: 959.5759277344, propagate_backward_time: 1532.9522705078, weight_update_time: 7.6307587624, other_time: 28.2984619141
epoch time: 198.5696411133s, input_fired_time: 2.2844243050, output_fired_time: 0.0000000000, propagate_forward_time: 192.5079193115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7772979736
validation[          , genome  6063] predictions:    5891/  10000 (58.91%), best:    5982/10000 (59.82%), error:     12411.80273, best error:     11942.70898 on epoch:    47, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 2551.1457519531s, input_fired_time: 18.2414588928, output_fired_time: 14.8675289154, propagate_forward_time: 963.1637573242, propagate_backward_time: 1528.6649169922, weight_update_time: 6.5404968262, other_time: 26.2081298828
epoch time: 198.8455657959s, input_fired_time: 2.2821033001, output_fired_time: 0.0000000000, propagate_forward_time: 191.7477874756, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8156738281
validation[          , genome  6063] predictions:    6033/  10000 (60.33%), best:    5982/10000 (59.82%), error:     12091.28809, best error:     11942.70898 on epoch:    47, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 2544.0263671875s, input_fired_time: 19.0580101013, output_fired_time: 14.6511774063, propagate_forward_time: 957.2061767578, propagate_backward_time: 1526.9084472656, weight_update_time: 6.5803971291, other_time: 26.2025146484
epoch time: 197.5585784912s, input_fired_time: 3.2814378738, output_fired_time: 0.0000000000, propagate_forward_time: 190.4983825684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7787628174
validation[          , genome  6063] predictions:    6053/  10000 (60.53%), best:    5982/10000 (59.82%), error:     12080.98828, best error:     11942.70898 on epoch:    47, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 2551.2585449219s, input_fired_time: 18.1429347992, output_fired_time: 13.6218261719, propagate_forward_time: 960.7968750000, propagate_backward_time: 1530.4118652344, weight_update_time: 6.6096920967, other_time: 28.2851562500
epoch time: 198.3833770752s, input_fired_time: 2.3414788246, output_fired_time: 0.0000000000, propagate_forward_time: 192.2748260498, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7670745850
validation[          , genome  6063] predictions:    6066/  10000 (60.66%), best:    5982/10000 (59.82%), error:     12309.54785, best error:     11942.70898 on epoch:    47, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 2549.6262207031s, input_fired_time: 21.2567615509, output_fired_time: 15.7910242081, propagate_forward_time: 952.8411865234, propagate_backward_time: 1530.5760498047, weight_update_time: 6.6040935516, other_time: 29.1611328125
epoch time: 199.7895812988s, input_fired_time: 2.3153109550, output_fired_time: 0.0000000000, propagate_forward_time: 193.6540679932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8202056885
validation[          , genome  6063] predictions:    5997/  10000 (59.97%), best:    5982/10000 (59.82%), error:     12358.78906, best error:     11942.70898 on epoch:    47, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 2550.5068359375s, input_fired_time: 19.4552898407, output_fired_time: 13.6363639832, propagate_forward_time: 965.0831909180, propagate_backward_time: 1525.2062988281, weight_update_time: 6.6245994568, other_time: 27.1254882813
epoch time: 198.2941589355s, input_fired_time: 2.3011004925, output_fired_time: 0.0000000000, propagate_forward_time: 192.2316131592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7614440918
validation[          , genome  6063] predictions:    6099/  10000 (60.99%), best:    5982/10000 (59.82%), error:     12129.90820, best error:     11942.70898 on epoch:    47, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 2630.4633789063s, input_fired_time: 18.9527320862, output_fired_time: 14.2648801804, propagate_forward_time: 997.4185180664, propagate_backward_time: 1572.0319824219, weight_update_time: 6.7049336433, other_time: 27.7954101563
epoch time: 198.4787750244s, input_fired_time: 2.3403685093, output_fired_time: 0.0000000000, propagate_forward_time: 192.3666687012, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7717437744
validation[          , genome  6063] predictions:    6038/  10000 (60.38%), best:    5982/10000 (59.82%), error:     11967.67578, best error:     11942.70898 on epoch:    47, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 2554.2270507813s, input_fired_time: 19.2921981812, output_fired_time: 13.7241258621, propagate_forward_time: 961.8189086914, propagate_backward_time: 1530.0565185547, weight_update_time: 8.6284599304, other_time: 29.3353271484
epoch time: 197.3530120850s, input_fired_time: 2.4004604816, output_fired_time: 0.0000000000, propagate_forward_time: 191.1895904541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7629547119
validation[          , genome  6063] predictions:    6105/  10000 (61.05%), best:    6105/10000 (61.05%), error:     11718.34277, best error:     11718.34277 on epoch:    67, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 2578.5263671875s, input_fired_time: 18.3183364868, output_fired_time: 14.7809400558, propagate_forward_time: 967.8400878906, propagate_backward_time: 1551.1787109375, weight_update_time: 6.6499729156, other_time: 26.4082031250
epoch time: 198.5117340088s, input_fired_time: 2.3625023365, output_fired_time: 0.0000000000, propagate_forward_time: 192.3795928955, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7696380615
validation[          , genome  6063] predictions:    6079/  10000 (60.79%), best:    6105/10000 (61.05%), error:     11872.08203, best error:     11718.34277 on epoch:    67, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 2641.3857421875s, input_fired_time: 21.1540260315, output_fired_time: 16.3605346680, propagate_forward_time: 984.0153808594, propagate_backward_time: 1590.3055419922, weight_update_time: 6.8287572861, other_time: 29.5501708984
epoch time: 198.9624633789s, input_fired_time: 2.3696982861, output_fired_time: 0.0000000000, propagate_forward_time: 192.8229370117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7698211670
validation[          , genome  6063] predictions:    5989/  10000 (59.89%), best:    6105/10000 (61.05%), error:     12221.50586, best error:     11718.34277 on epoch:    67, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 2631.2978515625s, input_fired_time: 19.8384361267, output_fired_time: 15.0777864456, propagate_forward_time: 980.1564941406, propagate_backward_time: 1586.8652343750, weight_update_time: 7.7642107010, other_time: 29.3598632813
epoch time: 202.9949493408s, input_fired_time: 2.3938167095, output_fired_time: 0.0000000000, propagate_forward_time: 196.7476196289, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8535156250
validation[          , genome  6063] predictions:    6087/  10000 (60.87%), best:    6105/10000 (61.05%), error:     11845.73926, best error:     11718.34277 on epoch:    67, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 2930.1877441406s, input_fired_time: 23.3373546600, output_fired_time: 15.5689697266, propagate_forward_time: 1089.0841064453, propagate_backward_time: 1768.2784423828, weight_update_time: 8.6344795227, other_time: 33.9187011719
epoch time: 212.9964904785s, input_fired_time: 2.5633144379, output_fired_time: 0.0000000000, propagate_forward_time: 205.1940002441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2391815186
validation[          , genome  6063] predictions:    6149/  10000 (61.49%), best:    6149/10000 (61.49%), error:     11716.57715, best error:     11716.57715 on epoch:    71, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 2579.4614257813s, input_fired_time: 22.9233055115, output_fired_time: 14.8749647141, propagate_forward_time: 962.6002197266, propagate_backward_time: 1552.2302246094, weight_update_time: 7.0119037628, other_time: 26.8326416016
epoch time: 197.2684326172s, input_fired_time: 2.3188192844, output_fired_time: 0.0000000000, propagate_forward_time: 191.1002502441, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8493652344
validation[          , genome  6063] predictions:    6064/  10000 (60.64%), best:    6149/10000 (61.49%), error:     12067.42871, best error:     11716.57715 on epoch:    71, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 2557.8186035156s, input_fired_time: 18.3342361450, output_fired_time: 13.6927156448, propagate_forward_time: 962.4281616211, propagate_backward_time: 1536.0646972656, weight_update_time: 6.5989508629, other_time: 27.2988281250
epoch time: 197.4569396973s, input_fired_time: 2.3559060097, output_fired_time: 0.0000000000, propagate_forward_time: 191.2677917480, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8332366943
validation[          , genome  6063] predictions:    6123/  10000 (61.23%), best:    6149/10000 (61.49%), error:     11822.66016, best error:     11716.57715 on epoch:    71, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 2582.5898437500s, input_fired_time: 19.1690216064, output_fired_time: 13.7962665558, propagate_forward_time: 971.6842651367, propagate_backward_time: 1548.3718261719, weight_update_time: 6.6757321358, other_time: 29.5683593750
epoch time: 199.0570983887s, input_fired_time: 2.3507640362, output_fired_time: 0.0000000000, propagate_forward_time: 192.8639068604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8424224854
validation[          , genome  6063] predictions:    6122/  10000 (61.22%), best:    6149/10000 (61.49%), error:     11821.67090, best error:     11716.57715 on epoch:    71, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 2550.5944824219s, input_fired_time: 18.4191589355, output_fired_time: 14.6750087738, propagate_forward_time: 966.0402832031, propagate_backward_time: 1524.3433837891, weight_update_time: 6.5537552834, other_time: 27.1165771484
epoch time: 202.3974456787s, input_fired_time: 2.4403018951, output_fired_time: 0.0000000000, propagate_forward_time: 196.0805664063, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8765716553
validation[          , genome  6063] predictions:    6183/  10000 (61.83%), best:    6183/10000 (61.83%), error:     11697.99414, best error:     11697.99414 on epoch:    75, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 2558.9982910156s, input_fired_time: 18.2963581085, output_fired_time: 14.6524677277, propagate_forward_time: 962.4635009766, propagate_backward_time: 1537.2340087891, weight_update_time: 6.6392807961, other_time: 26.3518066406
epoch time: 198.1763458252s, input_fired_time: 2.3321554661, output_fired_time: 0.0000000000, propagate_forward_time: 191.9047393799, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9394531250
validation[          , genome  6063] predictions:    6063/  10000 (60.63%), best:    6183/10000 (61.83%), error:     11949.78516, best error:     11697.99414 on epoch:    75, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 2565.1157226563s, input_fired_time: 18.4205112457, output_fired_time: 14.6635036469, propagate_forward_time: 968.8517456055, propagate_backward_time: 1535.7845458984, weight_update_time: 6.6754579544, other_time: 27.3953857422
epoch time: 198.1907501221s, input_fired_time: 2.3863711357, output_fired_time: 0.0000000000, propagate_forward_time: 191.9944610596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8099212646
validation[          , genome  6063] predictions:    6156/  10000 (61.56%), best:    6183/10000 (61.83%), error:     11743.59082, best error:     11697.99414 on epoch:    75, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 2549.5397949219s, input_fired_time: 20.7430419922, output_fired_time: 13.6260709763, propagate_forward_time: 956.1835937500, propagate_backward_time: 1532.0653076172, weight_update_time: 6.5988378525, other_time: 26.9219970703
epoch time: 210.3528594971s, input_fired_time: 2.4862415791, output_fired_time: 0.0000000000, propagate_forward_time: 203.7526855469, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1139373779
validation[          , genome  6063] predictions:    6129/  10000 (61.29%), best:    6183/10000 (61.83%), error:     11928.22461, best error:     11697.99414 on epoch:    75, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 2585.6230468750s, input_fired_time: 19.4038467407, output_fired_time: 14.7833805084, propagate_forward_time: 974.4808959961, propagate_backward_time: 1547.3958740234, weight_update_time: 6.6419401169, other_time: 29.5589599609
epoch time: 203.1988677979s, input_fired_time: 3.3139634132, output_fired_time: 0.0000000000, propagate_forward_time: 196.0663604736, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8185424805
validation[          , genome  6063] predictions:    6111/  10000 (61.11%), best:    6183/10000 (61.83%), error:     11817.21875, best error:     11697.99414 on epoch:    75, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 2561.3276367188s, input_fired_time: 18.4522018433, output_fired_time: 13.7850370407, propagate_forward_time: 962.9123535156, propagate_backward_time: 1537.7812500000, weight_update_time: 6.6089510918, other_time: 28.3967285156
epoch time: 198.1315612793s, input_fired_time: 2.3492040634, output_fired_time: 0.0000000000, propagate_forward_time: 191.9418029785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8405609131
validation[          , genome  6063] predictions:    6177/  10000 (61.77%), best:    6183/10000 (61.83%), error:     11880.71387, best error:     11697.99414 on epoch:    75, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 2555.6916503906s, input_fired_time: 19.3119049072, output_fired_time: 15.3635740280, propagate_forward_time: 957.6798095703, propagate_backward_time: 1537.2117919922, weight_update_time: 6.6149816513, other_time: 26.1245117188
epoch time: 197.8101959229s, input_fired_time: 2.4101772308, output_fired_time: 0.0000000000, propagate_forward_time: 191.5827484131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8172760010
validation[          , genome  6063] predictions:    6133/  10000 (61.33%), best:    6183/10000 (61.83%), error:     11777.97949, best error:     11697.99414 on epoch:    75, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 2562.5710449219s, input_fired_time: 20.4126415253, output_fired_time: 13.6809482574, propagate_forward_time: 969.2411499023, propagate_backward_time: 1530.0917968750, weight_update_time: 6.5711460114, other_time: 29.1445312500
epoch time: 198.1216430664s, input_fired_time: 2.3462936878, output_fired_time: 0.0000000000, propagate_forward_time: 191.9278717041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8474731445
validation[          , genome  6063] predictions:    6156/  10000 (61.56%), best:    6156/10000 (61.56%), error:     11628.10449, best error:     11628.10449 on epoch:    82, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 2553.1254882813s, input_fired_time: 19.4137725830, output_fired_time: 13.6249961853, propagate_forward_time: 964.5831909180, propagate_backward_time: 1527.2612304688, weight_update_time: 6.5663704872, other_time: 28.2421875000
epoch time: 198.4209747314s, input_fired_time: 2.2966010571, output_fired_time: 0.0000000000, propagate_forward_time: 192.3096923828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8146820068
validation[          , genome  6063] predictions:    6153/  10000 (61.53%), best:    6156/10000 (61.56%), error:     11723.26465, best error:     11628.10449 on epoch:    82, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 2555.1828613281s, input_fired_time: 20.4883651733, output_fired_time: 14.5825643539, propagate_forward_time: 962.5020141602, propagate_backward_time: 1529.1033935547, weight_update_time: 6.6288557053, other_time: 28.5067138672
epoch time: 204.9109344482s, input_fired_time: 2.3591620922, output_fired_time: 0.0000000000, propagate_forward_time: 198.5882720947, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9635009766
validation[          , genome  6063] predictions:    6183/  10000 (61.83%), best:    6156/10000 (61.56%), error:     11689.81738, best error:     11628.10449 on epoch:    82, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 2679.9069824219s, input_fired_time: 20.6550674438, output_fired_time: 14.3607282639, propagate_forward_time: 1012.7756347656, propagate_backward_time: 1602.5107421875, weight_update_time: 8.9027585983, other_time: 29.6047363281
epoch time: 195.3443756104s, input_fired_time: 2.3188102245, output_fired_time: 0.0000000000, propagate_forward_time: 189.2703399658, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7552185059
validation[          , genome  6063] predictions:    6212/  10000 (62.12%), best:    6212/10000 (62.12%), error:     11606.58105, best error:     11606.58105 on epoch:    85, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 2558.5002441406s, input_fired_time: 19.4214115143, output_fired_time: 13.6657266617, propagate_forward_time: 960.8063964844, propagate_backward_time: 1538.3719482422, weight_update_time: 6.5852751732, other_time: 26.2347412109
epoch time: 198.1879272461s, input_fired_time: 2.3480236530, output_fired_time: 0.0000000000, propagate_forward_time: 192.0724334717, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7674713135
validation[          , genome  6063] predictions:    6176/  10000 (61.76%), best:    6212/10000 (62.12%), error:     11734.54395, best error:     11606.58105 on epoch:    85, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 2555.5024414063s, input_fired_time: 19.6559715271, output_fired_time: 14.6950492859, propagate_forward_time: 964.6966552734, propagate_backward_time: 1529.4124755859, weight_update_time: 6.5479521751, other_time: 27.0422363281
epoch time: 196.2431030273s, input_fired_time: 2.4139251709, output_fired_time: 0.0000000000, propagate_forward_time: 190.0643157959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7648620605
validation[          , genome  6063] predictions:    6230/  10000 (62.30%), best:    6230/10000 (62.30%), error:     11606.04688, best error:     11606.04688 on epoch:    87, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 2551.7414550781s, input_fired_time: 18.4767780304, output_fired_time: 14.6696825027, propagate_forward_time: 959.8173217773, propagate_backward_time: 1530.5898437500, weight_update_time: 6.6451501846, other_time: 28.1877441406
epoch time: 197.4681701660s, input_fired_time: 2.3437788486, output_fired_time: 0.0000000000, propagate_forward_time: 191.3319244385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7924652100
validation[          , genome  6063] predictions:    6136/  10000 (61.36%), best:    6230/10000 (62.30%), error:     11766.93262, best error:     11606.04688 on epoch:    87, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 2550.2043457031s, input_fired_time: 19.4648380280, output_fired_time: 14.6145830154, propagate_forward_time: 958.4166259766, propagate_backward_time: 1529.3364257813, weight_update_time: 6.5885004997, other_time: 28.3719482422
epoch time: 196.8913574219s, input_fired_time: 4.5656442642, output_fired_time: 0.0000000000, propagate_forward_time: 188.5238189697, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8018951416
validation[          , genome  6063] predictions:    6179/  10000 (61.79%), best:    6179/10000 (61.79%), error:     11588.57324, best error:     11588.57324 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 2558.7905273438s, input_fired_time: 20.4296054840, output_fired_time: 16.8377819061, propagate_forward_time: 963.3380737305, propagate_backward_time: 1528.0175781250, weight_update_time: 7.5126872063, other_time: 30.1672363281
epoch time: 201.0189208984s, input_fired_time: 2.3792738914, output_fired_time: 0.0000000000, propagate_forward_time: 194.8661651611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7734832764
validation[          , genome  6063] predictions:    6180/  10000 (61.80%), best:    6179/10000 (61.79%), error:     11669.54590, best error:     11588.57324 on epoch:    89, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 2548.8298339844s, input_fired_time: 18.4094886780, output_fired_time: 14.6407318115, propagate_forward_time: 968.3635253906, propagate_backward_time: 1519.1110839844, weight_update_time: 7.5779743195, other_time: 28.3051757813
epoch time: 199.1170349121s, input_fired_time: 2.4047236443, output_fired_time: 0.0000000000, propagate_forward_time: 191.8789215088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8333892822
validation[          , genome  6063] predictions:    6207/  10000 (62.07%), best:    6207/10000 (62.07%), error:     11548.87500, best error:     11548.87500 on epoch:    91, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 2627.9760742188s, input_fired_time: 19.0720272064, output_fired_time: 13.7587804794, propagate_forward_time: 987.0026855469, propagate_backward_time: 1580.8277587891, weight_update_time: 6.5527114868, other_time: 27.3148193359
epoch time: 198.0996246338s, input_fired_time: 2.3353638649, output_fired_time: 0.0000000000, propagate_forward_time: 191.9167175293, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8475494385
validation[          , genome  6063] predictions:    6214/  10000 (62.14%), best:    6214/10000 (62.14%), error:     11542.46387, best error:     11542.46387 on epoch:    92, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 2554.5617675781s, input_fired_time: 19.7827224731, output_fired_time: 13.7545070648, propagate_forward_time: 958.0962524414, propagate_backward_time: 1535.8010253906, weight_update_time: 7.5674595833, other_time: 27.1274414063
epoch time: 197.9792480469s, input_fired_time: 2.3740570545, output_fired_time: 0.0000000000, propagate_forward_time: 191.8032073975, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8019866943
validation[          , genome  6063] predictions:    6216/  10000 (62.16%), best:    6214/10000 (62.14%), error:     11622.12988, best error:     11542.46387 on epoch:    92, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 2591.6318359375s, input_fired_time: 19.8910789490, output_fired_time: 13.8795166016, propagate_forward_time: 967.4379882813, propagate_backward_time: 1562.9670410156, weight_update_time: 6.6961364746, other_time: 27.4562988281
epoch time: 200.6208496094s, input_fired_time: 2.3751285076, output_fired_time: 0.0000000000, propagate_forward_time: 192.0140228271, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.2317047119
validation[          , genome  6063] predictions:    6175/  10000 (61.75%), best:    6214/10000 (62.14%), error:     11811.37598, best error:     11542.46387 on epoch:    92, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 2763.3442382813s, input_fired_time: 23.6116428375, output_fired_time: 18.2057991028, propagate_forward_time: 1021.2796020508, propagate_backward_time: 1667.9630126953, weight_update_time: 9.1887674332, other_time: 32.2843017578
epoch time: 229.4830322266s, input_fired_time: 3.7665381432, output_fired_time: 0.0000000000, propagate_forward_time: 221.1058654785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6106262207
validation[          , genome  6063] predictions:    6185/  10000 (61.85%), best:    6214/10000 (62.14%), error:     11655.35742, best error:     11542.46387 on epoch:    92, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 2684.2172851563s, input_fired_time: 20.5059757233, output_fired_time: 16.3984680176, propagate_forward_time: 1007.8590698242, propagate_backward_time: 1611.3081054688, weight_update_time: 7.3268365860, other_time: 28.1457519531
epoch time: 195.9001617432s, input_fired_time: 2.3152444363, output_fired_time: 0.0000000000, propagate_forward_time: 189.7850189209, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7998962402
validation[          , genome  6063] predictions:    6214/  10000 (62.14%), best:    6214/10000 (62.14%), error:     11630.94727, best error:     11542.46387 on epoch:    92, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 2723.8620605469s, input_fired_time: 21.1440258026, output_fired_time: 16.5639381409, propagate_forward_time: 1022.0811767578, propagate_backward_time: 1633.6485595703, weight_update_time: 7.0900974274, other_time: 30.4243164063
epoch time: 222.9750366211s, input_fired_time: 2.7457699776, output_fired_time: 0.0000000000, propagate_forward_time: 214.9477386475, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2815246582
validation[          , genome  6063] predictions:    6212/  10000 (62.12%), best:    6214/10000 (62.14%), error:     11654.85352, best error:     11542.46387 on epoch:    92, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 3023.4057617188s, input_fired_time: 21.9124660492, output_fired_time: 19.0332317352, propagate_forward_time: 1130.7456054688, propagate_backward_time: 1817.9405517578, weight_update_time: 8.8971252441, other_time: 33.7740478516
epoch time: 258.0268554688s, input_fired_time: 3.1473834515, output_fired_time: 0.0000000000, propagate_forward_time: 248.7325897217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1468811035
validation[          , genome  6063] predictions:    6202/  10000 (62.02%), best:    6214/10000 (62.14%), error:     11636.83203, best error:     11542.46387 on epoch:    92, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 2869.6909179688s, input_fired_time: 22.2061691284, output_fired_time: 16.4619808197, propagate_forward_time: 1064.2617187500, propagate_backward_time: 1732.6585693359, weight_update_time: 8.4350223541, other_time: 34.1026611328
epoch time: 258.0561218262s, input_fired_time: 3.0892767906, output_fired_time: 0.0000000000, propagate_forward_time: 249.7846069336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1822357178
validation[          , genome  6063] predictions:    6187/  10000 (61.87%), best:    6214/10000 (62.14%), error:     11712.59570, best error:     11542.46387 on epoch:    92, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 2978.5251464844s, input_fired_time: 21.9967708588, output_fired_time: 18.0536212921, propagate_forward_time: 1097.2236328125, propagate_backward_time: 1807.9987792969, weight_update_time: 8.6107282639, other_time: 33.2521972656
epoch time: 257.4485778809s, input_fired_time: 3.1225378513, output_fired_time: 0.0000000000, propagate_forward_time: 248.1395416260, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.1864929199
validation[          , genome  6063] predictions:    6175/  10000 (61.75%), best:    6214/10000 (62.14%), error:     11661.78223, best error:     11542.46387 on epoch:    92, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 1168.1497802734s, input_fired_time: 13.9910068512, output_fired_time: 0.0000000000, propagate_forward_time: 1128.9296875000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 25.2291259766
best training[          , genome  6063] predictions:   40714/  50000 (81.43%), best:    6214/10000 (62.14%), error:     28800.90820, best error:     11542.46387 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 233.5606079102s, input_fired_time: 2.8224072456, output_fired_time: 0.0000000000, propagate_forward_time: 224.6397399902, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.0984649658
   testing[          , genome  6063] predictions:    6214/  10000 (62.14%), best:    6214/10000 (62.14%), error:     11542.46387, best error:     11542.46387 on epoch:    92, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
22:23:16 (3916): called boinc_finish(0)

</stderr_txt>
]]>