Nameexact_genome_1517574602_56_18264_2
Workunit2990687
Created9 Feb 2018, 7:22:09 UTC
Sent9 Feb 2018, 8:00:10 UTC
Report deadline25 Mar 2018, 6:14:46 UTC
Received14 Feb 2018, 5:32:22 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID68550
Run time1 days 8 hours 20 min 39 sec
CPU time1 days 8 hours 14 min 26 sec
Validate stateInitial
Credit0.00
Device peak FLOPS2.59 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size178.31 MB
Peak swap size181.86 MB
Peak disk usage4.44 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
2186890
validation[          , genome 18264] predictions:    9853/  10000 (98.53%), best:    9858/10000 (98.58%), error:       491.58487, best error:       470.74115 on epoch:     9, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 1308.6496582031s, input_fired_time: 19.4532051086, output_fired_time: 19.4221801758, propagate_forward_time: 478.0685119629, propagate_backward_time: 775.3248291016, weight_update_time: 0.8284684420, other_time: 16.3808593750
epoch time: 102.3839416504s, input_fired_time: 1.7904975414, output_fired_time: 0.0000000000, propagate_forward_time: 97.1445159912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4489288330
validation[          , genome 18264] predictions:    9867/  10000 (98.67%), best:    9867/10000 (98.67%), error:       434.65994, best error:       434.65994 on epoch:    16, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 1314.0598144531s, input_fired_time: 21.6151237488, output_fired_time: 20.2797718048, propagate_forward_time: 486.8912048340, propagate_backward_time: 770.0198364258, weight_update_time: 0.8331739306, other_time: 15.2538452148
epoch time: 101.5075836182s, input_fired_time: 1.7955921888, output_fired_time: 0.0000000000, propagate_forward_time: 97.2542724609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4577178955
validation[          , genome 18264] predictions:    9836/  10000 (98.36%), best:    9867/10000 (98.67%), error:       527.82928, best error:       434.65994 on epoch:    16, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 1310.2081298828s, input_fired_time: 22.8512592316, output_fired_time: 17.4103927612, propagate_forward_time: 469.9521484375, propagate_backward_time: 781.6018066406, weight_update_time: 0.8351744413, other_time: 18.3924560547
epoch time: 101.7404708862s, input_fired_time: 1.8022172451, output_fired_time: 0.0000000000, propagate_forward_time: 96.4860382080, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4522171021
validation[          , genome 18264] predictions:    9845/  10000 (98.45%), best:    9867/10000 (98.67%), error:       506.28763, best error:       434.65994 on epoch:    16, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 1304.4841308594s, input_fired_time: 17.6722335815, output_fired_time: 18.2093410492, propagate_forward_time: 481.1033020020, propagate_backward_time: 772.0895385742, weight_update_time: 0.8293237090, other_time: 15.4097290039
epoch time: 103.2377166748s, input_fired_time: 1.8125361204, output_fired_time: 0.0000000000, propagate_forward_time: 98.9589309692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4662475586
validation[          , genome 18264] predictions:    9793/  10000 (97.93%), best:    9867/10000 (98.67%), error:       630.01306, best error:       434.65994 on epoch:    16, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 1312.0085449219s, input_fired_time: 21.6949157715, output_fired_time: 18.4482631683, propagate_forward_time: 480.7814636230, propagate_backward_time: 776.7740478516, weight_update_time: 0.8301822543, other_time: 14.3098144531
epoch time: 102.0142822266s, input_fired_time: 1.8105189800, output_fired_time: 0.0000000000, propagate_forward_time: 97.7166595459, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4871063232
validation[          , genome 18264] predictions:    9853/  10000 (98.53%), best:    9867/10000 (98.67%), error:       497.33069, best error:       434.65994 on epoch:    16, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 1316.4804687500s, input_fired_time: 20.6872348785, output_fired_time: 19.2526969910, propagate_forward_time: 491.7699890137, propagate_backward_time: 769.3524780273, weight_update_time: 0.8328196406, other_time: 15.4180297852
epoch time: 103.5542449951s, input_fired_time: 1.8150578737, output_fired_time: 0.0000000000, propagate_forward_time: 98.3109970093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4281921387
validation[          , genome 18264] predictions:    9854/  10000 (98.54%), best:    9867/10000 (98.67%), error:       459.18277, best error:       434.65994 on epoch:    16, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1307.3599853516s, input_fired_time: 17.5306415558, output_fired_time: 16.3064537048, propagate_forward_time: 484.6261596680, propagate_backward_time: 771.5298461914, weight_update_time: 0.8292745352, other_time: 17.3669433594
epoch time: 101.0514221191s, input_fired_time: 1.7825492620, output_fired_time: 0.0000000000, propagate_forward_time: 95.8219680786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4469070435
validation[          , genome 18264] predictions:    9845/  10000 (98.45%), best:    9867/10000 (98.67%), error:       485.15973, best error:       434.65994 on epoch:    16, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 1314.6633300781s, input_fired_time: 16.5628242493, output_fired_time: 18.4262924194, propagate_forward_time: 473.4146118164, propagate_backward_time: 786.1265869141, weight_update_time: 1.8125634193, other_time: 20.1329956055
epoch time: 102.1651000977s, input_fired_time: 3.7609705925, output_fired_time: 0.0000000000, propagate_forward_time: 94.9430313110, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4610977173
validation[          , genome 18264] predictions:    9859/  10000 (98.59%), best:    9867/10000 (98.67%), error:       471.64301, best error:       434.65994 on epoch:    16, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 1312.7425537109s, input_fired_time: 19.4604549408, output_fired_time: 21.6178855896, propagate_forward_time: 481.9588317871, propagate_backward_time: 772.5333251953, weight_update_time: 0.8253248334, other_time: 17.1719970703
epoch time: 101.9534759521s, input_fired_time: 1.8178040981, output_fired_time: 0.0000000000, propagate_forward_time: 96.6788330078, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4568405151
validation[          , genome 18264] predictions:    9874/  10000 (98.74%), best:    9874/10000 (98.74%), error:       414.74237, best error:       414.74237 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 1320.5115966797s, input_fired_time: 17.7213363647, output_fired_time: 18.5250892639, propagate_forward_time: 482.1502990723, propagate_backward_time: 786.6933593750, weight_update_time: 0.8295876384, other_time: 15.4215087891
epoch time: 102.1670761108s, input_fired_time: 1.7938430309, output_fired_time: 0.0000000000, propagate_forward_time: 96.9487533569, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4244766235
validation[          , genome 18264] predictions:    9845/  10000 (98.45%), best:    9874/10000 (98.74%), error:       501.14926, best error:       414.74237 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 1316.9179687500s, input_fired_time: 18.6884174347, output_fired_time: 18.4987602234, propagate_forward_time: 487.9409179688, propagate_backward_time: 773.4701538086, weight_update_time: 0.8275156021, other_time: 18.3196411133
epoch time: 103.2968750000s, input_fired_time: 2.7827997208, output_fired_time: 0.0000000000, propagate_forward_time: 97.0053558350, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5087203979
validation[          , genome 18264] predictions:    9870/  10000 (98.70%), best:    9874/10000 (98.74%), error:       423.51959, best error:       414.74237 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 1314.7144775391s, input_fired_time: 20.5615024567, output_fired_time: 16.6983871460, propagate_forward_time: 485.3785095215, propagate_backward_time: 773.8175659180, weight_update_time: 0.8317331672, other_time: 18.2584838867
epoch time: 102.9891662598s, input_fired_time: 1.8302776814, output_fired_time: 0.0000000000, propagate_forward_time: 98.6764144897, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4824752808
validation[          , genome 18264] predictions:    9821/  10000 (98.21%), best:    9874/10000 (98.74%), error:       557.96149, best error:       414.74237 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 1323.8283691406s, input_fired_time: 19.6066875458, output_fired_time: 19.3966503143, propagate_forward_time: 480.6855163574, propagate_backward_time: 788.8795776367, weight_update_time: 0.8277661800, other_time: 15.2599487305
epoch time: 102.1200637817s, input_fired_time: 1.7990944386, output_fired_time: 0.0000000000, propagate_forward_time: 94.9020843506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4188842773
validation[          , genome 18264] predictions:    9859/  10000 (98.59%), best:    9874/10000 (98.74%), error:       434.34741, best error:       414.74237 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 1305.5976562500s, input_fired_time: 20.6131725311, output_fired_time: 21.3839550018, propagate_forward_time: 484.2950744629, propagate_backward_time: 761.9371337891, weight_update_time: 0.8302009702, other_time: 17.3684082031
epoch time: 99.3623046875s, input_fired_time: 2.8742418289, output_fired_time: 0.0000000000, propagate_forward_time: 92.9565963745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5314636230
validation[          , genome 18264] predictions:    9886/  10000 (98.86%), best:    9886/10000 (98.86%), error:       367.80960, best error:       367.80960 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 1319.5952148438s, input_fired_time: 19.7843875885, output_fired_time: 18.3549957275, propagate_forward_time: 482.0316772461, propagate_backward_time: 784.1143188477, weight_update_time: 0.8315898776, other_time: 15.3098144531
epoch time: 104.0314483643s, input_fired_time: 1.8194749355, output_fired_time: 0.0000000000, propagate_forward_time: 97.7827529907, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4292221069
validation[          , genome 18264] predictions:    9825/  10000 (98.25%), best:    9886/10000 (98.86%), error:       537.98932, best error:       367.80960 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1316.5822753906s, input_fired_time: 16.7257843018, output_fired_time: 19.6365146637, propagate_forward_time: 484.2361450195, propagate_backward_time: 778.7053833008, weight_update_time: 0.8266513944, other_time: 17.2784423828
epoch time: 100.4924926758s, input_fired_time: 1.7926787138, output_fired_time: 0.0000000000, propagate_forward_time: 96.2848510742, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4149627686
validation[          , genome 18264] predictions:    9862/  10000 (98.62%), best:    9886/10000 (98.86%), error:       439.81744, best error:       367.80960 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1312.9086914063s, input_fired_time: 21.7963809967, output_fired_time: 19.3877964020, propagate_forward_time: 486.3386535645, propagate_backward_time: 768.0175170898, weight_update_time: 0.8323447704, other_time: 17.3683471680
epoch time: 103.7865829468s, input_fired_time: 3.7945294380, output_fired_time: 0.0000000000, propagate_forward_time: 97.5378417969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4542083740
validation[          , genome 18264] predictions:    9873/  10000 (98.73%), best:    9886/10000 (98.86%), error:       418.33878, best error:       367.80960 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 1314.5439453125s, input_fired_time: 19.6119499207, output_fired_time: 18.3600177765, propagate_forward_time: 481.0067443848, propagate_backward_time: 775.3273315430, weight_update_time: 1.8134887218, other_time: 20.2379760742
epoch time: 102.6036605835s, input_fired_time: 1.8009730577, output_fired_time: 0.0000000000, propagate_forward_time: 98.3426742554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4600143433
validation[          , genome 18264] predictions:    9862/  10000 (98.62%), best:    9886/10000 (98.86%), error:       425.01486, best error:       367.80960 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1316.7663574219s, input_fired_time: 23.7258262634, output_fired_time: 17.4688091278, propagate_forward_time: 475.6077575684, propagate_backward_time: 782.7059936523, weight_update_time: 0.8281877041, other_time: 17.2579956055
epoch time: 101.4024276733s, input_fired_time: 2.7815928459, output_fired_time: 0.0000000000, propagate_forward_time: 95.1925964355, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4282379150
validation[          , genome 18264] predictions:    9852/  10000 (98.52%), best:    9886/10000 (98.86%), error:       494.91885, best error:       367.80960 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1310.5482177734s, input_fired_time: 18.7192020416, output_fired_time: 19.1437644958, propagate_forward_time: 485.7485046387, propagate_backward_time: 771.6307373047, weight_update_time: 0.8269416094, other_time: 15.3059082031
epoch time: 102.6226654053s, input_fired_time: 1.7969750166, output_fired_time: 0.0000000000, propagate_forward_time: 97.4024734497, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4232177734
validation[          , genome 18264] predictions:    9869/  10000 (98.69%), best:    9886/10000 (98.86%), error:       423.82254, best error:       367.80960 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1314.8291015625s, input_fired_time: 17.8103466034, output_fired_time: 18.4011821747, propagate_forward_time: 489.4603881836, propagate_backward_time: 773.7408447266, weight_update_time: 0.8341892362, other_time: 15.4164428711
epoch time: 102.3213577271s, input_fired_time: 1.7972632647, output_fired_time: 0.0000000000, propagate_forward_time: 96.0893020630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4347915649
validation[          , genome 18264] predictions:    9892/  10000 (98.92%), best:    9886/10000 (98.86%), error:       376.03873, best error:       367.80960 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1313.2185058594s, input_fired_time: 18.6685371399, output_fired_time: 18.5784549713, propagate_forward_time: 491.6859741211, propagate_backward_time: 764.1070556641, weight_update_time: 0.8309503198, other_time: 20.1784057617
epoch time: 100.0497970581s, input_fired_time: 1.7829353809, output_fired_time: 0.0000000000, propagate_forward_time: 94.8483734131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4184875488
validation[          , genome 18264] predictions:    9889/  10000 (98.89%), best:    9886/10000 (98.86%), error:       378.63593, best error:       367.80960 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 1310.8970947266s, input_fired_time: 18.6217479706, output_fired_time: 20.7493400574, propagate_forward_time: 488.0492248535, propagate_backward_time: 768.1419677734, weight_update_time: 0.8308614492, other_time: 15.3348388672
epoch time: 101.5407104492s, input_fired_time: 4.7688083649, output_fired_time: 0.0000000000, propagate_forward_time: 93.3242111206, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4476928711
validation[          , genome 18264] predictions:    9867/  10000 (98.67%), best:    9886/10000 (98.86%), error:       401.09058, best error:       367.80960 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 1314.7622070313s, input_fired_time: 26.9424152374, output_fired_time: 20.3399581909, propagate_forward_time: 477.0933227539, propagate_backward_time: 774.4255981445, weight_update_time: 0.8270762563, other_time: 15.9609375000
epoch time: 101.4253845215s, input_fired_time: 1.8042439222, output_fired_time: 0.0000000000, propagate_forward_time: 96.0831756592, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5379638672
validation[          , genome 18264] predictions:    9852/  10000 (98.52%), best:    9886/10000 (98.86%), error:       437.11142, best error:       367.80960 on epoch:    29, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 1313.7314453125s, input_fired_time: 20.5817852020, output_fired_time: 21.3059387207, propagate_forward_time: 482.1419677734, propagate_backward_time: 772.3654174805, weight_update_time: 0.8263556957, other_time: 17.3363647461
epoch time: 102.9531250000s, input_fired_time: 1.8202927113, output_fired_time: 0.0000000000, propagate_forward_time: 96.6952438354, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4375915527
validation[          , genome 18264] predictions:    9868/  10000 (98.68%), best:    9886/10000 (98.86%), error:       412.35910, best error:       367.80960 on epoch:    29, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 1313.5164794922s, input_fired_time: 15.6072502136, output_fired_time: 18.3185539246, propagate_forward_time: 496.9848022461, propagate_backward_time: 767.3214721680, weight_update_time: 0.8273264170, other_time: 15.2843017578
epoch time: 100.6605377197s, input_fired_time: 1.7958419323, output_fired_time: 0.0000000000, propagate_forward_time: 94.4518432617, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4128494263
validation[          , genome 18264] predictions:    9880/  10000 (98.80%), best:    9886/10000 (98.86%), error:       373.01944, best error:       367.80960 on epoch:    29, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 1316.1633300781s, input_fired_time: 20.6828594208, output_fired_time: 20.2246131897, propagate_forward_time: 475.4418640137, propagate_backward_time: 782.6564331055, weight_update_time: 0.8237243891, other_time: 17.1575317383
epoch time: 102.5858917236s, input_fired_time: 1.8196932077, output_fired_time: 0.0000000000, propagate_forward_time: 98.3111190796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4550781250
validation[          , genome 18264] predictions:    9862/  10000 (98.62%), best:    9886/10000 (98.86%), error:       426.79257, best error:       367.80960 on epoch:    29, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 1314.3712158203s, input_fired_time: 17.7485008240, output_fired_time: 20.5801677704, propagate_forward_time: 478.6106872559, propagate_backward_time: 779.2946777344, weight_update_time: 1.8179565668, other_time: 18.1370849609
epoch time: 103.2191009521s, input_fired_time: 2.9041717052, output_fired_time: 0.0000000000, propagate_forward_time: 96.8800048828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4349212646
validation[          , genome 18264] predictions:    9880/  10000 (98.80%), best:    9886/10000 (98.86%), error:       379.54211, best error:       367.80960 on epoch:    29, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 1315.7663574219s, input_fired_time: 17.7296237946, output_fired_time: 20.3992481232, propagate_forward_time: 489.0531005859, propagate_backward_time: 771.1765136719, weight_update_time: 0.8273218870, other_time: 17.4078369141
epoch time: 101.7935104370s, input_fired_time: 2.7990167141, output_fired_time: 0.0000000000, propagate_forward_time: 96.5543594360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4401321411
validation[          , genome 18264] predictions:    9890/  10000 (98.90%), best:    9886/10000 (98.86%), error:       371.14539, best error:       367.80960 on epoch:    29, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 1317.5648193359s, input_fired_time: 20.8685760498, output_fired_time: 16.3244705200, propagate_forward_time: 481.8395690918, propagate_backward_time: 782.0541381836, weight_update_time: 0.8327454925, other_time: 16.4780883789
epoch time: 101.5065689087s, input_fired_time: 2.7903966904, output_fired_time: 0.0000000000, propagate_forward_time: 95.1611328125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5550384521
validation[          , genome 18264] predictions:    9851/  10000 (98.51%), best:    9886/10000 (98.86%), error:       456.32462, best error:       367.80960 on epoch:    29, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 1327.8461914063s, input_fired_time: 16.7090930939, output_fired_time: 18.5165481567, propagate_forward_time: 487.0383911133, propagate_backward_time: 789.1627807617, weight_update_time: 0.8309789300, other_time: 16.4193115234
epoch time: 104.3947830200s, input_fired_time: 1.8562999964, output_fired_time: 0.0000000000, propagate_forward_time: 100.0509643555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4875183105
validation[          , genome 18264] predictions:    9884/  10000 (98.84%), best:    9884/10000 (98.84%), error:       363.24719, best error:       363.24719 on epoch:    46, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 1332.1004638672s, input_fired_time: 15.9144039154, output_fired_time: 20.9030818939, propagate_forward_time: 495.7373352051, propagate_backward_time: 785.1773681641, weight_update_time: 0.8430817127, other_time: 14.3682861328
epoch time: 105.9736785889s, input_fired_time: 3.8203260899, output_fired_time: 0.0000000000, propagate_forward_time: 97.7645874023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3887634277
validation[          , genome 18264] predictions:    9883/  10000 (98.83%), best:    9883/10000 (98.83%), error:       346.78580, best error:       346.78580 on epoch:    47, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1338.9235839844s, input_fired_time: 24.2299957275, output_fired_time: 15.7755470276, propagate_forward_time: 487.4595642090, propagate_backward_time: 796.0827636719, weight_update_time: 0.8460372090, other_time: 15.3757324219
epoch time: 104.1240234375s, input_fired_time: 1.8460114002, output_fired_time: 0.0000000000, propagate_forward_time: 99.8448791504, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4331359863
validation[          , genome 18264] predictions:    9890/  10000 (98.90%), best:    9890/10000 (98.90%), error:       337.78839, best error:       337.78839 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1339.2966308594s, input_fired_time: 17.9031314850, output_fired_time: 26.0828781128, propagate_forward_time: 494.3743591309, propagate_backward_time: 784.5556640625, weight_update_time: 0.8445100784, other_time: 16.3806152344
epoch time: 105.5092163086s, input_fired_time: 1.8349376917, output_fired_time: 0.0000000000, propagate_forward_time: 101.2080764771, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4662017822
validation[          , genome 18264] predictions:    9876/  10000 (98.76%), best:    9890/10000 (98.90%), error:       392.23798, best error:       337.78839 on epoch:    48, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 1350.9326171875s, input_fired_time: 20.0756893158, output_fired_time: 17.7702064514, propagate_forward_time: 500.2180480957, propagate_backward_time: 794.4522705078, weight_update_time: 0.8414140344, other_time: 18.4163818359
epoch time: 105.4030990601s, input_fired_time: 2.8368051052, output_fired_time: 0.0000000000, propagate_forward_time: 99.1221694946, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4441223145
validation[          , genome 18264] predictions:    9895/  10000 (98.95%), best:    9890/10000 (98.90%), error:       360.94678, best error:       337.78839 on epoch:    48, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 1343.9023437500s, input_fired_time: 18.8771686554, output_fired_time: 19.8239078522, propagate_forward_time: 500.2064819336, propagate_backward_time: 785.8320312500, weight_update_time: 1.8208239079, other_time: 19.1627807617
epoch time: 105.2515945435s, input_fired_time: 1.8708934784, output_fired_time: 0.0000000000, propagate_forward_time: 99.9401626587, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4405364990
validation[          , genome 18264] predictions:    9884/  10000 (98.84%), best:    9890/10000 (98.90%), error:       347.53625, best error:       337.78839 on epoch:    48, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 1349.0095214844s, input_fired_time: 18.8390464783, output_fired_time: 20.6543483734, propagate_forward_time: 502.1392211914, propagate_backward_time: 788.8444213867, weight_update_time: 1.8229472637, other_time: 18.5325927734
epoch time: 105.2288055420s, input_fired_time: 2.8498947620, output_fired_time: 0.0000000000, propagate_forward_time: 99.9182052612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4607086182
validation[          , genome 18264] predictions:    9889/  10000 (98.89%), best:    9889/10000 (98.89%), error:       328.79013, best error:       328.79013 on epoch:    52, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 1349.8663330078s, input_fired_time: 18.8709678650, output_fired_time: 20.7574424744, propagate_forward_time: 496.0086059570, propagate_backward_time: 796.7615356445, weight_update_time: 0.8384819627, other_time: 17.4677734375
epoch time: 104.2158203125s, input_fired_time: 1.8530228138, output_fired_time: 0.0000000000, propagate_forward_time: 98.8121337891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5506668091
validation[          , genome 18264] predictions:    9876/  10000 (98.76%), best:    9889/10000 (98.89%), error:       393.78186, best error:       328.79013 on epoch:    52, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 1347.7351074219s, input_fired_time: 21.8643741608, output_fired_time: 19.6929855347, propagate_forward_time: 504.7906494141, propagate_backward_time: 785.1046142578, weight_update_time: 0.8409274817, other_time: 16.2824707031
epoch time: 105.8740615845s, input_fired_time: 1.8455634117, output_fired_time: 0.0000000000, propagate_forward_time: 101.6040725708, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4244232178
validation[          , genome 18264] predictions:    9851/  10000 (98.51%), best:    9889/10000 (98.89%), error:       477.19238, best error:       328.79013 on epoch:    52, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 1347.2401123047s, input_fired_time: 18.8597526550, output_fired_time: 20.0059795380, propagate_forward_time: 499.5242919922, propagate_backward_time: 790.6000366211, weight_update_time: 0.8414406180, other_time: 18.2500610352
epoch time: 106.8994369507s, input_fired_time: 4.1416077614, output_fired_time: 0.0000000000, propagate_forward_time: 98.2807769775, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4770507813
validation[          , genome 18264] predictions:    9900/  10000 (99.00%), best:    9889/10000 (98.89%), error:       341.52518, best error:       328.79013 on epoch:    52, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 1349.5278320313s, input_fired_time: 16.9852409363, output_fired_time: 16.7941036224, propagate_forward_time: 501.8821716309, propagate_backward_time: 796.6417846680, weight_update_time: 0.8370840549, other_time: 17.2245483398
epoch time: 105.1986389160s, input_fired_time: 1.8659036160, output_fired_time: 0.0000000000, propagate_forward_time: 99.8796920776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4530410767
validation[          , genome 18264] predictions:    9898/  10000 (98.98%), best:    9889/10000 (98.89%), error:       338.07794, best error:       328.79013 on epoch:    52, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 1349.8618164063s, input_fired_time: 16.9700012207, output_fired_time: 16.7377624512, propagate_forward_time: 499.7963562012, propagate_backward_time: 799.9620971680, weight_update_time: 0.8483608365, other_time: 16.3955688477
epoch time: 104.4579467773s, input_fired_time: 1.8423943520, output_fired_time: 0.0000000000, propagate_forward_time: 99.1753845215, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4401702881
validation[          , genome 18264] predictions:    9904/  10000 (99.04%), best:    9904/10000 (99.04%), error:       308.07877, best error:       308.07877 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 1348.0092773438s, input_fired_time: 21.0879955292, output_fired_time: 21.7582874298, propagate_forward_time: 495.7193603516, propagate_backward_time: 793.1770019531, weight_update_time: 0.8400918841, other_time: 16.2666015625
epoch time: 104.6687545776s, input_fired_time: 1.8458167315, output_fired_time: 0.0000000000, propagate_forward_time: 100.3789978027, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4439392090
validation[          , genome 18264] predictions:    9908/  10000 (99.08%), best:    9904/10000 (99.04%), error:       316.00522, best error:       308.07877 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 1352.3061523438s, input_fired_time: 21.0540485382, output_fired_time: 22.8722133636, propagate_forward_time: 499.5294494629, propagate_backward_time: 788.4410400391, weight_update_time: 0.8335725069, other_time: 20.4094238281
epoch time: 104.4992218018s, input_fired_time: 2.8600118160, output_fired_time: 0.0000000000, propagate_forward_time: 96.2048034668, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4344100952
validation[          , genome 18264] predictions:    9894/  10000 (98.94%), best:    9904/10000 (99.04%), error:       345.94891, best error:       308.07877 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 1353.4344482422s, input_fired_time: 17.0331707001, output_fired_time: 18.7907371521, propagate_forward_time: 502.3653869629, propagate_backward_time: 796.8053588867, weight_update_time: 1.8282318115, other_time: 18.4397583008
epoch time: 105.5260543823s, input_fired_time: 2.8414773941, output_fired_time: 0.0000000000, propagate_forward_time: 100.1921844482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4923934937
validation[          , genome 18264] predictions:    9911/  10000 (99.11%), best:    9911/10000 (99.11%), error:       299.73126, best error:       299.73126 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 1338.3597412109s, input_fired_time: 18.0474739075, output_fired_time: 16.7800655365, propagate_forward_time: 491.5238037109, propagate_backward_time: 796.7743530273, weight_update_time: 0.8386468887, other_time: 15.2340698242
epoch time: 105.6658630371s, input_fired_time: 2.8393285275, output_fired_time: 0.0000000000, propagate_forward_time: 100.3500671387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4764709473
validation[          , genome 18264] predictions:    9891/  10000 (98.91%), best:    9911/10000 (99.11%), error:       349.00931, best error:       299.73126 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 1342.4114990234s, input_fired_time: 17.9354591370, output_fired_time: 18.6961078644, propagate_forward_time: 495.9484252930, propagate_backward_time: 791.4629516602, weight_update_time: 0.8388767242, other_time: 18.3685302734
epoch time: 105.4274139404s, input_fired_time: 2.9637837410, output_fired_time: 0.0000000000, propagate_forward_time: 100.0153427124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4482879639
validation[          , genome 18264] predictions:    9913/  10000 (99.13%), best:    9911/10000 (99.11%), error:       300.81369, best error:       299.73126 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 1344.3317871094s, input_fired_time: 19.9953651428, output_fired_time: 17.6979198456, propagate_forward_time: 494.0404052734, propagate_backward_time: 796.6571044922, weight_update_time: 0.8357809186, other_time: 15.9410400391
epoch time: 105.5900955200s, input_fired_time: 2.8402869701, output_fired_time: 0.0000000000, propagate_forward_time: 100.2769241333, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4728851318
validation[          , genome 18264] predictions:    9670/  10000 (96.70%), best:    9911/10000 (99.11%), error:      1105.58081, best error:       299.73126 on epoch:    60, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

resetting weights to those on epoch: 60
epoch time: 1338.6676025391s, input_fired_time: 18.8654594421, output_fired_time: 20.7752437592, propagate_forward_time: 499.6817321777, propagate_backward_time: 784.0698242188, weight_update_time: 0.8427956700, other_time: 15.2752685547
epoch time: 104.9329147339s, input_fired_time: 1.8647102118, output_fired_time: 0.0000000000, propagate_forward_time: 100.6443328857, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4238739014
validation[          , genome 18264] predictions:    9890/  10000 (98.90%), best:    9911/10000 (99.11%), error:       340.63712, best error:       299.73126 on epoch:    60, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 1352.2933349609s, input_fired_time: 20.3774337769, output_fired_time: 19.7019290924, propagate_forward_time: 506.6929321289, propagate_backward_time: 787.2103271484, weight_update_time: 1.8211442232, other_time: 18.3107299805
epoch time: 104.2859954834s, input_fired_time: 2.8580653667, output_fired_time: 0.0000000000, propagate_forward_time: 98.9681625366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4597702026
validation[          , genome 18264] predictions:    9893/  10000 (98.93%), best:    9911/10000 (99.11%), error:       315.47873, best error:       299.73126 on epoch:    60, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 1350.3504638672s, input_fired_time: 20.0635070801, output_fired_time: 22.9690532684, propagate_forward_time: 495.1085205078, propagate_backward_time: 794.6931152344, weight_update_time: 0.8416908979, other_time: 17.5163574219
epoch time: 103.5547637939s, input_fired_time: 1.8571066856, output_fired_time: 0.0000000000, propagate_forward_time: 98.1131286621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5845260620
validation[          , genome 18264] predictions:    9908/  10000 (99.08%), best:    9911/10000 (99.11%), error:       305.49551, best error:       299.73126 on epoch:    60, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 1346.3232421875s, input_fired_time: 20.8904495239, output_fired_time: 16.7352352142, propagate_forward_time: 501.5394897461, propagate_backward_time: 788.8563232422, weight_update_time: 0.8409445882, other_time: 18.3016967773
epoch time: 104.5486526489s, input_fired_time: 3.8300230503, output_fired_time: 0.0000000000, propagate_forward_time: 97.1837463379, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5348815918
validation[          , genome 18264] predictions:    9904/  10000 (99.04%), best:    9911/10000 (99.11%), error:       313.59015, best error:       299.73126 on epoch:    60, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 1351.7695312500s, input_fired_time: 23.2802391052, output_fired_time: 17.6926002502, propagate_forward_time: 494.9921875000, propagate_backward_time: 798.1580810547, weight_update_time: 0.8429234028, other_time: 17.6463623047
epoch time: 105.2386245728s, input_fired_time: 1.8758647442, output_fired_time: 0.0000000000, propagate_forward_time: 100.9238510132, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4389114380
validation[          , genome 18264] predictions:    9907/  10000 (99.07%), best:    9911/10000 (99.11%), error:       314.62564, best error:       299.73126 on epoch:    60, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 1343.2639160156s, input_fired_time: 19.0818099976, output_fired_time: 20.8613929749, propagate_forward_time: 501.1100769043, propagate_backward_time: 785.9227905273, weight_update_time: 0.8389744759, other_time: 16.2877807617
epoch time: 111.2869110107s, input_fired_time: 1.8873342276, output_fired_time: 0.0000000000, propagate_forward_time: 105.9367218018, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4628524780
validation[          , genome 18264] predictions:    9920/  10000 (99.20%), best:    9920/10000 (99.20%), error:       276.73938, best error:       276.73938 on epoch:    69, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 1342.9835205078s, input_fired_time: 15.9794425964, output_fired_time: 19.7753372192, propagate_forward_time: 503.6113281250, propagate_backward_time: 789.3217773438, weight_update_time: 0.8457150459, other_time: 14.2955322266
epoch time: 103.6648101807s, input_fired_time: 2.9274072647, output_fired_time: 0.0000000000, propagate_forward_time: 95.2275009155, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5099029541
validation[          , genome 18264] predictions:    9905/  10000 (99.05%), best:    9920/10000 (99.20%), error:       299.29221, best error:       276.73938 on epoch:    69, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 1342.1400146484s, input_fired_time: 21.0332450867, output_fired_time: 21.0778007507, propagate_forward_time: 492.5079956055, propagate_backward_time: 791.0661010742, weight_update_time: 0.8375946283, other_time: 16.4549560547
epoch time: 104.5451049805s, input_fired_time: 2.9500746727, output_fired_time: 0.0000000000, propagate_forward_time: 96.9309005737, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6641311646
validation[          , genome 18264] predictions:    9911/  10000 (99.11%), best:    9920/10000 (99.20%), error:       307.56082, best error:       276.73938 on epoch:    69, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 1337.6840820313s, input_fired_time: 23.1084098816, output_fired_time: 19.7810668945, propagate_forward_time: 486.9681091309, propagate_backward_time: 791.3212890625, weight_update_time: 0.8415333629, other_time: 16.5052490234
epoch time: 104.9399490356s, input_fired_time: 1.8563330173, output_fired_time: 0.0000000000, propagate_forward_time: 100.6245956421, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4590225220
validation[          , genome 18264] predictions:    9912/  10000 (99.12%), best:    9920/10000 (99.20%), error:       290.56580, best error:       276.73938 on epoch:    69, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 1338.2659912109s, input_fired_time: 17.1498546600, output_fired_time: 19.8801364899, propagate_forward_time: 491.1434326172, propagate_backward_time: 786.6613769531, weight_update_time: 1.8239725828, other_time: 23.4311523438
epoch time: 103.5123748779s, input_fired_time: 2.9585971832, output_fired_time: 0.0000000000, propagate_forward_time: 98.0835494995, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4702301025
validation[          , genome 18264] predictions:    9899/  10000 (98.99%), best:    9920/10000 (99.20%), error:       345.73560, best error:       276.73938 on epoch:    69, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 1337.4105224609s, input_fired_time: 16.9412860870, output_fired_time: 21.7896480560, propagate_forward_time: 493.1747131348, propagate_backward_time: 790.0859375000, weight_update_time: 0.8414672017, other_time: 15.4189453125
epoch time: 104.9244918823s, input_fired_time: 1.8582688570, output_fired_time: 0.0000000000, propagate_forward_time: 99.6326751709, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4335479736
validation[          , genome 18264] predictions:    9917/  10000 (99.17%), best:    9920/10000 (99.20%), error:       296.65237, best error:       276.73938 on epoch:    69, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 1339.6745605469s, input_fired_time: 20.0280246735, output_fired_time: 17.7531623840, propagate_forward_time: 493.1525878906, propagate_backward_time: 790.4528198242, weight_update_time: 1.8253736496, other_time: 18.2879028320
epoch time: 102.3498229980s, input_fired_time: 1.8659830093, output_fired_time: 0.0000000000, propagate_forward_time: 96.0419921875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4418487549
validation[          , genome 18264] predictions:    9915/  10000 (99.15%), best:    9920/10000 (99.20%), error:       281.10559, best error:       276.73938 on epoch:    69, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 1336.4698486328s, input_fired_time: 20.8457851410, output_fired_time: 19.7226333618, propagate_forward_time: 485.2972412109, propagate_backward_time: 793.3442993164, weight_update_time: 1.8261851072, other_time: 17.2598266602
epoch time: 104.6180877686s, input_fired_time: 1.8791378736, output_fired_time: 0.0000000000, propagate_forward_time: 100.2384490967, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5005035400
validation[          , genome 18264] predictions:    9909/  10000 (99.09%), best:    9920/10000 (99.20%), error:       312.94748, best error:       276.73938 on epoch:    69, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 1346.5239257813s, input_fired_time: 17.9841442108, output_fired_time: 19.7714462280, propagate_forward_time: 492.1097106934, propagate_backward_time: 797.2305297852, weight_update_time: 0.8417869210, other_time: 19.4280395508
epoch time: 104.3111572266s, input_fired_time: 1.8604263067, output_fired_time: 0.0000000000, propagate_forward_time: 98.9964828491, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4542465210
validation[          , genome 18264] predictions:    9911/  10000 (99.11%), best:    9920/10000 (99.20%), error:       292.99323, best error:       276.73938 on epoch:    69, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 1343.9522705078s, input_fired_time: 22.0654926300, output_fired_time: 17.8579788208, propagate_forward_time: 490.8001098633, propagate_backward_time: 796.9850463867, weight_update_time: 0.8363273144, other_time: 16.2435302734
epoch time: 104.7227935791s, input_fired_time: 1.8747276068, output_fired_time: 0.0000000000, propagate_forward_time: 99.2929916382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5550765991
validation[          , genome 18264] predictions:    9903/  10000 (99.03%), best:    9920/10000 (99.20%), error:       322.62665, best error:       276.73938 on epoch:    69, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 1342.9199218750s, input_fired_time: 17.9830608368, output_fired_time: 16.7087802887, propagate_forward_time: 492.1252441406, propagate_backward_time: 796.6757202148, weight_update_time: 0.8420308828, other_time: 19.4271850586
epoch time: 105.2421112061s, input_fired_time: 1.8693984747, output_fired_time: 0.0000000000, propagate_forward_time: 100.9344558716, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4382553101
validation[          , genome 18264] predictions:    9908/  10000 (99.08%), best:    9920/10000 (99.20%), error:       319.87466, best error:       276.73938 on epoch:    69, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1347.2061767578s, input_fired_time: 18.3119258881, output_fired_time: 20.7453365326, propagate_forward_time: 498.1669616699, propagate_backward_time: 791.7794799805, weight_update_time: 0.8378542066, other_time: 18.2024536133
epoch time: 105.0222778320s, input_fired_time: 1.8804657459, output_fired_time: 0.0000000000, propagate_forward_time: 99.7038803101, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4379348755
validation[          , genome 18264] predictions:    9909/  10000 (99.09%), best:    9920/10000 (99.20%), error:       304.29407, best error:       276.73938 on epoch:    69, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1350.7534179688s, input_fired_time: 21.3100395203, output_fired_time: 19.7470817566, propagate_forward_time: 497.1333007813, propagate_backward_time: 796.0909423828, weight_update_time: 0.8352772593, other_time: 16.4720458984
epoch time: 104.7584152222s, input_fired_time: 1.8726716042, output_fired_time: 0.0000000000, propagate_forward_time: 96.2778091431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6079330444
validation[          , genome 18264] predictions:    9921/  10000 (99.21%), best:    9920/10000 (99.20%), error:       288.24207, best error:       276.73938 on epoch:    69, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1344.3605957031s, input_fired_time: 17.1249256134, output_fired_time: 21.8146800995, propagate_forward_time: 494.5193176270, propagate_backward_time: 792.4368286133, weight_update_time: 1.9328899384, other_time: 18.4649047852
epoch time: 103.3108291626s, input_fired_time: 2.8545517921, output_fired_time: 0.0000000000, propagate_forward_time: 96.9076538086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5486221313
validation[          , genome 18264] predictions:    9913/  10000 (99.13%), best:    9920/10000 (99.20%), error:       284.63721, best error:       276.73938 on epoch:    69, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 1340.3653564453s, input_fired_time: 17.0856761932, output_fired_time: 18.7079696655, propagate_forward_time: 494.9371643066, propagate_backward_time: 789.2051391602, weight_update_time: 1.9302234650, other_time: 20.4293823242
epoch time: 111.7487030029s, input_fired_time: 1.8661954403, output_fired_time: 0.0000000000, propagate_forward_time: 105.4565048218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4260025024
validation[          , genome 18264] predictions:    9915/  10000 (99.15%), best:    9920/10000 (99.20%), error:       286.79630, best error:       276.73938 on epoch:    69, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 1343.1772460938s, input_fired_time: 18.0299949646, output_fired_time: 19.4357070923, propagate_forward_time: 485.8217468262, propagate_backward_time: 800.6759643555, weight_update_time: 0.8375599384, other_time: 19.2138061523
epoch time: 105.4346160889s, input_fired_time: 1.8717417717, output_fired_time: 0.0000000000, propagate_forward_time: 101.0872879028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4755859375
validation[          , genome 18264] predictions:    9903/  10000 (99.03%), best:    9920/10000 (99.20%), error:       336.37354, best error:       276.73938 on epoch:    69, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 1349.3048095703s, input_fired_time: 19.2129230499, output_fired_time: 21.6020660400, propagate_forward_time: 492.5549011230, propagate_backward_time: 799.3657836914, weight_update_time: 0.8406443596, other_time: 16.5691528320
epoch time: 105.0801010132s, input_fired_time: 1.8573588133, output_fired_time: 0.0000000000, propagate_forward_time: 100.7903900146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4323501587
validation[          , genome 18264] predictions:    9903/  10000 (99.03%), best:    9920/10000 (99.20%), error:       323.14740, best error:       276.73938 on epoch:    69, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 1350.9378662109s, input_fired_time: 18.0981292725, output_fired_time: 20.6239814758, propagate_forward_time: 506.1105651855, propagate_backward_time: 789.8131103516, weight_update_time: 0.8404232264, other_time: 16.2919921875
epoch time: 105.8590850830s, input_fired_time: 2.8677015305, output_fired_time: 0.0000000000, propagate_forward_time: 98.4421768188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5492095947
validation[          , genome 18264] predictions:    9918/  10000 (99.18%), best:    9920/10000 (99.20%), error:       290.09100, best error:       276.73938 on epoch:    69, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 1354.1685791016s, input_fired_time: 20.2087020874, output_fired_time: 15.7119455338, propagate_forward_time: 497.7335510254, propagate_backward_time: 802.2765502930, weight_update_time: 0.8400784135, other_time: 18.2378540039
epoch time: 110.4704055786s, input_fired_time: 2.5718839169, output_fired_time: 0.0000000000, propagate_forward_time: 105.4075546265, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4909667969
validation[          , genome 18264] predictions:    9905/  10000 (99.05%), best:    9920/10000 (99.20%), error:       314.98035, best error:       276.73938 on epoch:    69, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 1337.6048583984s, input_fired_time: 25.1028099060, output_fired_time: 17.6095542908, propagate_forward_time: 495.8418273926, propagate_backward_time: 779.8591308594, weight_update_time: 1.8347114325, other_time: 19.1916503906
epoch time: 106.0521926880s, input_fired_time: 2.9823257923, output_fired_time: 0.0000000000, propagate_forward_time: 99.6181945801, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4516754150
validation[          , genome 18264] predictions:    9911/  10000 (99.11%), best:    9920/10000 (99.20%), error:       305.47644, best error:       276.73938 on epoch:    69, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1348.2426757813s, input_fired_time: 23.1364402771, output_fired_time: 18.6703033447, propagate_forward_time: 496.8989562988, propagate_backward_time: 794.2404174805, weight_update_time: 0.8407623172, other_time: 15.2965698242
epoch time: 104.9455871582s, input_fired_time: 2.8462786674, output_fired_time: 0.0000000000, propagate_forward_time: 99.6286392212, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4706726074
validation[          , genome 18264] predictions:    9918/  10000 (99.18%), best:    9920/10000 (99.20%), error:       299.86432, best error:       276.73938 on epoch:    69, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1351.0437011719s, input_fired_time: 23.1610279083, output_fired_time: 20.5478229523, propagate_forward_time: 489.5047607422, propagate_backward_time: 802.5120849609, weight_update_time: 0.8378161788, other_time: 15.3179931641
epoch time: 104.0196228027s, input_fired_time: 1.8856282234, output_fired_time: 0.0000000000, propagate_forward_time: 99.6858062744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4481887817
validation[          , genome 18264] predictions:    9923/  10000 (99.23%), best:    9920/10000 (99.20%), error:       277.31735, best error:       276.73938 on epoch:    69, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 1339.5638427734s, input_fired_time: 21.8960037231, output_fired_time: 19.6384277344, propagate_forward_time: 490.8677673340, propagate_backward_time: 786.9074096680, weight_update_time: 0.8348885775, other_time: 20.2542114258
epoch time: 105.4446411133s, input_fired_time: 2.9728617668, output_fired_time: 0.0000000000, propagate_forward_time: 100.0139923096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4577865601
validation[          , genome 18264] predictions:    9913/  10000 (99.13%), best:    9920/10000 (99.20%), error:       285.25647, best error:       276.73938 on epoch:    69, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1341.1392822266s, input_fired_time: 16.0056190491, output_fired_time: 18.6151294708, propagate_forward_time: 493.4434814453, propagate_backward_time: 798.8250732422, weight_update_time: 0.8343977332, other_time: 14.2500000000
epoch time: 106.9653778076s, input_fired_time: 2.9031345844, output_fired_time: 0.0000000000, propagate_forward_time: 101.4396438599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6225967407
validation[          , genome 18264] predictions:    9912/  10000 (99.12%), best:    9920/10000 (99.20%), error:       306.43198, best error:       276.73938 on epoch:    69, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1346.2120361328s, input_fired_time: 21.0903720856, output_fired_time: 15.7676925659, propagate_forward_time: 494.9626159668, propagate_backward_time: 797.0549926758, weight_update_time: 0.8364054561, other_time: 17.3363647461
epoch time: 104.7902984619s, input_fired_time: 1.8778727055, output_fired_time: 0.0000000000, propagate_forward_time: 100.4577865601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4546356201
validation[          , genome 18264] predictions:    9914/  10000 (99.14%), best:    9920/10000 (99.20%), error:       289.77356, best error:       276.73938 on epoch:    69, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1346.7933349609s, input_fired_time: 19.2639408112, output_fired_time: 20.7549743652, propagate_forward_time: 496.8549499512, propagate_backward_time: 793.5729370117, weight_update_time: 0.8405602574, other_time: 16.3464965820
epoch time: 105.2563095093s, input_fired_time: 1.8832316399, output_fired_time: 0.0000000000, propagate_forward_time: 96.9665222168, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.4065551758
validation[          , genome 18264] predictions:    9921/  10000 (99.21%), best:    9920/10000 (99.20%), error:       290.28003, best error:       276.73938 on epoch:    69, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1347.7570800781s, input_fired_time: 19.0785675049, output_fired_time: 16.7080039978, propagate_forward_time: 504.8921508789, propagate_backward_time: 792.7555541992, weight_update_time: 0.8401097059, other_time: 14.3227539063
epoch time: 104.4116668701s, input_fired_time: 1.8750076294, output_fired_time: 0.0000000000, propagate_forward_time: 100.1011276245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4355316162
validation[          , genome 18264] predictions:    9918/  10000 (99.18%), best:    9920/10000 (99.20%), error:       283.12012, best error:       276.73938 on epoch:    69, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1351.2795410156s, input_fired_time: 21.1302795410, output_fired_time: 18.6615200043, propagate_forward_time: 502.6829223633, propagate_backward_time: 791.5678710938, weight_update_time: 0.8371999264, other_time: 17.2369995117
epoch time: 104.0899047852s, input_fired_time: 1.8835717440, output_fired_time: 0.0000000000, propagate_forward_time: 98.6524124146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5539169312
validation[          , genome 18264] predictions:    9906/  10000 (99.06%), best:    9920/10000 (99.20%), error:       312.74130, best error:       276.73938 on epoch:    69, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1341.5805664063s, input_fired_time: 21.0372524261, output_fired_time: 18.6354274750, propagate_forward_time: 489.3398132324, propagate_backward_time: 792.2797241211, weight_update_time: 1.8211585283, other_time: 20.2883911133
epoch time: 104.8204956055s, input_fired_time: 2.8583436012, output_fired_time: 0.0000000000, propagate_forward_time: 98.5219650269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4401855469
validation[          , genome 18264] predictions:    9921/  10000 (99.21%), best:    9920/10000 (99.20%), error:       277.87506, best error:       276.73938 on epoch:    69, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1346.2259521484s, input_fired_time: 18.1040649414, output_fired_time: 18.6837501526, propagate_forward_time: 497.4930419922, propagate_backward_time: 793.6961669922, weight_update_time: 0.8352651596, other_time: 18.2489013672
epoch time: 103.0654144287s, input_fired_time: 1.8717525005, output_fired_time: 0.0000000000, propagate_forward_time: 97.7348480225, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4588165283
validation[          , genome 18264] predictions:    9925/  10000 (99.25%), best:    9920/10000 (99.20%), error:       285.60239, best error:       276.73938 on epoch:    69, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1345.1741943359s, input_fired_time: 17.2136497498, output_fired_time: 20.6220569611, propagate_forward_time: 491.4380187988, propagate_backward_time: 798.5374755859, weight_update_time: 0.8392021656, other_time: 17.3630371094
epoch time: 104.5116882324s, input_fired_time: 2.8656034470, output_fired_time: 0.0000000000, propagate_forward_time: 97.2065429688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4395446777
validation[          , genome 18264] predictions:    9906/  10000 (99.06%), best:    9920/10000 (99.20%), error:       317.52682, best error:       276.73938 on epoch:    69, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1342.1601562500s, input_fired_time: 19.1197624207, output_fired_time: 21.7456722260, propagate_forward_time: 491.2758483887, propagate_backward_time: 792.7506713867, weight_update_time: 0.8396086097, other_time: 17.2681274414
epoch time: 104.9016036987s, input_fired_time: 2.8611133099, output_fired_time: 0.0000000000, propagate_forward_time: 98.5859146118, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4545745850
validation[          , genome 18264] predictions:    9916/  10000 (99.16%), best:    9920/10000 (99.20%), error:       299.57187, best error:       276.73938 on epoch:    69, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 530.1533813477s, input_fired_time: 12.3041210175, output_fired_time: 0.0000000000, propagate_forward_time: 504.4031677246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.4460754395
best training[          , genome 18264] predictions:   49983/  50000 (99.97%), best:    9920/10000 (99.20%), error:       216.77028, best error:       276.73938 on epoch:    69, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 103.7901000977s, input_fired_time: 3.8220672607, output_fired_time: 0.0000000000, propagate_forward_time: 95.5577774048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4102554321
   testing[          , genome 18264] predictions:    9912/  10000 (99.12%), best:    9920/10000 (99.20%), error:       271.85315, best error:       276.73938 on epoch:    69, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
06:21:47 (7576): called boinc_finish(0)

</stderr_txt>
]]>