Nameexact_genome_1540746903_184_5336_1
Workunit4075239
Created28 Oct 2018, 19:40:28 UTC
Sent28 Oct 2018, 20:13:03 UTC
Report deadline26 Jan 2019, 17:04:33 UTC
Received10 Dec 2018, 11:09:22 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time1 days 21 hours 52 min 15 sec
CPU time1 days 21 hours 10 min 30 sec
Validate stateValid
Credit22,467.28
Device peak FLOPS3.80 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size526.22 MB
Peak swap size545.76 MB
Peak disk usage9.86 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
e for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1665.05126953125s, input_fired_time: 18.2049255371094, output_fired_time: 15.5587358474731, propagate_forward_time: 613.8095703125, propagate_backward_time: 980.524597167969, weight_update_time: 2.03177428245544, other_time: 36.9534301757813
epoch time: 133.642807006836s, input_fired_time: 2.75354242324829, output_fired_time: 0, propagate_forward_time: 123.739250183105, propagate_backward_time: 0, weight_update_time: 0, other_time: 7.15001678466797
validation[          , genome  5336] predictions:    5660/  10000 (56.60%), best:    5660/10000 (56.60%), error:     13381.43945, best error:     13381.43945 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 1688.4073486328s, input_fired_time: 18.6536006927, output_fired_time: 15.6511650085, propagate_forward_time: 621.8348999023, propagate_backward_time: 993.7357177734, weight_update_time: 2.0361347198, other_time: 38.5321044922
epoch time: 129.0963439941s, input_fired_time: 1.9164409637, output_fired_time: 0.0000000000, propagate_forward_time: 122.4683990479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7115020752
validation[          , genome  5336] predictions:    5410/  10000 (54.10%), best:    5660/10000 (56.60%), error:     14001.88086, best error:     13381.43945 on epoch:    25, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 1637.8564453125s, input_fired_time: 14.3120708466, output_fired_time: 12.6226091385, propagate_forward_time: 609.5874633789, propagate_backward_time: 972.6901245117, weight_update_time: 1.6561148167, other_time: 28.6442871094
epoch time: 128.5852508545s, input_fired_time: 1.7055667639, output_fired_time: 0.0000000000, propagate_forward_time: 122.4924316406, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3872528076
validation[          , genome  5336] predictions:    5321/  10000 (53.21%), best:    5660/10000 (56.60%), error:     14357.62793, best error:     13381.43945 on epoch:    25, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 1613.7346191406s, input_fired_time: 12.8562507629, output_fired_time: 11.5249109268, propagate_forward_time: 604.3217163086, propagate_backward_time: 960.9111328125, weight_update_time: 1.5198161602, other_time: 24.1206665039
epoch time: 121.9183273315s, input_fired_time: 1.5424309969, output_fired_time: 0.0000000000, propagate_forward_time: 116.4758224487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9000701904
validation[          , genome  5336] predictions:    5565/  10000 (55.65%), best:    5660/10000 (56.60%), error:     13548.69336, best error:     13381.43945 on epoch:    25, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 1558.7132568359s, input_fired_time: 12.0970878601, output_fired_time: 10.9688100815, propagate_forward_time: 581.5737304688, propagate_backward_time: 932.2475585938, weight_update_time: 1.4407199621, other_time: 21.8261718750
epoch time: 121.6567306519s, input_fired_time: 1.5457993746, output_fired_time: 0.0000000000, propagate_forward_time: 116.0844039917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0265274048
validation[          , genome  5336] predictions:    5591/  10000 (55.91%), best:    5660/10000 (56.60%), error:     13447.06250, best error:     13381.43945 on epoch:    25, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 1561.6052246094s, input_fired_time: 12.1393756866, output_fired_time: 11.0062894821, propagate_forward_time: 583.7789916992, propagate_backward_time: 933.2025756836, weight_update_time: 1.4336655140, other_time: 21.4779052734
epoch time: 124.3816223145s, input_fired_time: 1.5970801115, output_fired_time: 0.0000000000, propagate_forward_time: 118.7102279663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0743179321
validation[          , genome  5336] predictions:    5716/  10000 (57.16%), best:    5716/10000 (57.16%), error:     12751.45313, best error:     12751.45313 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1575.0839843750s, input_fired_time: 12.1390743256, output_fired_time: 11.0697002411, propagate_forward_time: 589.5004272461, propagate_backward_time: 941.0381469727, weight_update_time: 1.4414422512, other_time: 21.3366699219
epoch time: 123.3182373047s, input_fired_time: 1.4896950722, output_fired_time: 0.0000000000, propagate_forward_time: 118.3654098511, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4631347656
validation[          , genome  5336] predictions:    5592/  10000 (55.92%), best:    5716/10000 (57.16%), error:     13560.16504, best error:     12751.45313 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1588.3072509766s, input_fired_time: 11.8523731232, output_fired_time: 10.9323253632, propagate_forward_time: 597.4730224609, propagate_backward_time: 948.7566528320, weight_update_time: 1.3863819838, other_time: 19.2927856445
epoch time: 122.2951507568s, input_fired_time: 1.4762432575, output_fired_time: 0.0000000000, propagate_forward_time: 117.4662170410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3526916504
validation[          , genome  5336] predictions:    5593/  10000 (55.93%), best:    5716/10000 (57.16%), error:     13155.98340, best error:     12751.45313 on epoch:    30, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 1546.3905029297s, input_fired_time: 11.6618633270, output_fired_time: 10.7239036560, propagate_forward_time: 578.1884765625, propagate_backward_time: 926.3092041016, weight_update_time: 1.3818043470, other_time: 19.5070800781
epoch time: 120.5797119141s, input_fired_time: 1.4743077755, output_fired_time: 0.0000000000, propagate_forward_time: 115.5830841064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.5223236084
validation[          , genome  5336] predictions:    5785/  10000 (57.85%), best:    5785/10000 (57.85%), error:     12716.29004, best error:     12716.29004 on epoch:    33, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1575.8454589844s, input_fired_time: 11.6670026779, output_fired_time: 10.7548694611, propagate_forward_time: 594.2695312500, propagate_backward_time: 941.2333374023, weight_update_time: 1.3585239649, other_time: 17.9207153320
epoch time: 125.6489944458s, input_fired_time: 1.4670978785, output_fired_time: 0.0000000000, propagate_forward_time: 121.0153656006, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1665344238
validation[          , genome  5336] predictions:    5707/  10000 (57.07%), best:    5785/10000 (57.85%), error:     13113.41113, best error:     12716.29004 on epoch:    33, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1574.5222167969s, input_fired_time: 11.5155181885, output_fired_time: 10.6456489563, propagate_forward_time: 594.7665405273, propagate_backward_time: 940.8895874023, weight_update_time: 1.3384627104, other_time: 16.7049560547
epoch time: 120.2686386108s, input_fired_time: 1.4178978205, output_fired_time: 0.0000000000, propagate_forward_time: 116.0689163208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7818222046
validation[          , genome  5336] predictions:    5680/  10000 (56.80%), best:    5785/10000 (57.85%), error:     13048.45313, best error:     12716.29004 on epoch:    33, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1533.5531005859s, input_fired_time: 11.1932268143, output_fired_time: 10.2125005722, propagate_forward_time: 579.1505737305, propagate_backward_time: 917.8123779297, weight_update_time: 1.2932423353, other_time: 15.1843872070
epoch time: 121.1578826904s, input_fired_time: 1.4194688797, output_fired_time: 0.0000000000, propagate_forward_time: 117.1068038940, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6316070557
validation[          , genome  5336] predictions:    5630/  10000 (56.30%), best:    5785/10000 (57.85%), error:     13029.01660, best error:     12716.29004 on epoch:    33, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1549.5166015625s, input_fired_time: 11.2218971252, output_fired_time: 10.3094444275, propagate_forward_time: 584.5706176758, propagate_backward_time: 928.3678588867, weight_update_time: 1.2996580601, other_time: 15.0467529297
epoch time: 121.2659835815s, input_fired_time: 1.4240589142, output_fired_time: 0.0000000000, propagate_forward_time: 117.1679306030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6739959717
validation[          , genome  5336] predictions:    5757/  10000 (57.57%), best:    5785/10000 (57.85%), error:     12871.10156, best error:     12716.29004 on epoch:    33, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 1502.4210205078s, input_fired_time: 11.0073623657, output_fired_time: 9.9949550629, propagate_forward_time: 565.0662841797, propagate_backward_time: 901.7803955078, weight_update_time: 1.2680821419, other_time: 14.5720214844
epoch time: 116.3599166870s, input_fired_time: 1.3803665638, output_fired_time: 0.0000000000, propagate_forward_time: 112.4671936035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5123596191
validation[          , genome  5336] predictions:    5788/  10000 (57.88%), best:    5785/10000 (57.85%), error:     12718.12500, best error:     12716.29004 on epoch:    33, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 1453.2779541016s, input_fired_time: 10.7585563660, output_fired_time: 9.6518831253, propagate_forward_time: 544.9052124023, propagate_backward_time: 873.6894531250, weight_update_time: 1.2495857477, other_time: 14.2728881836
epoch time: 111.5629730225s, input_fired_time: 1.3384456635, output_fired_time: 0.0000000000, propagate_forward_time: 107.7238693237, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5006561279
validation[          , genome  5336] predictions:    5471/  10000 (54.71%), best:    5785/10000 (57.85%), error:     13785.38477, best error:     12716.29004 on epoch:    33, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 1384.9998779297s, input_fired_time: 10.4815406799, output_fired_time: 9.2272367477, propagate_forward_time: 519.1056518555, propagate_backward_time: 832.7288208008, weight_update_time: 1.1951917410, other_time: 13.4565429688
epoch time: 105.0051574707s, input_fired_time: 1.2880020142, output_fired_time: 0.0000000000, propagate_forward_time: 101.3295211792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3876342773
validation[          , genome  5336] predictions:    5652/  10000 (56.52%), best:    5785/10000 (57.85%), error:     13031.06934, best error:     12716.29004 on epoch:    33, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 1363.1378173828s, input_fired_time: 10.4028902054, output_fired_time: 9.1064252853, propagate_forward_time: 510.7075500488, propagate_backward_time: 819.5620727539, weight_update_time: 1.1862270832, other_time: 13.3589477539
epoch time: 100.0490875244s, input_fired_time: 1.2522187233, output_fired_time: 0.0000000000, propagate_forward_time: 96.5090789795, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2877883911
validation[          , genome  5336] predictions:    5810/  10000 (58.10%), best:    5785/10000 (57.85%), error:     12859.06055, best error:     12716.29004 on epoch:    33, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 1339.7556152344s, input_fired_time: 10.3129816055, output_fired_time: 8.9744796753, propagate_forward_time: 500.3940429688, propagate_backward_time: 806.8928222656, weight_update_time: 1.1750067472, other_time: 13.1812744141
epoch time: 99.6703796387s, input_fired_time: 1.2471666336, output_fired_time: 0.0000000000, propagate_forward_time: 96.1102981567, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3129119873
validation[          , genome  5336] predictions:    5751/  10000 (57.51%), best:    5785/10000 (57.85%), error:     12778.79102, best error:     12716.29004 on epoch:    33, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 1359.6503906250s, input_fired_time: 10.3803920746, output_fired_time: 9.0601005554, propagate_forward_time: 507.8117370605, propagate_backward_time: 819.1102294922, weight_update_time: 1.1837646961, other_time: 13.2879638672
epoch time: 104.2604675293s, input_fired_time: 1.2877299786, output_fired_time: 0.0000000000, propagate_forward_time: 100.6303482056, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3423919678
validation[          , genome  5336] predictions:    5869/  10000 (58.69%), best:    5869/10000 (58.69%), error:     12504.99414, best error:     12504.99414 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 1312.1202392578s, input_fired_time: 10.2158727646, output_fired_time: 8.8243541718, propagate_forward_time: 486.7164001465, propagate_backward_time: 793.1953125000, weight_update_time: 1.1638969183, other_time: 13.1683349609
epoch time: 92.9039993286s, input_fired_time: 1.1943165064, output_fired_time: 0.0000000000, propagate_forward_time: 89.4981460571, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2115402222
validation[          , genome  5336] predictions:    5731/  10000 (57.31%), best:    5869/10000 (58.69%), error:     13098.00195, best error:     12504.99414 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 1293.6217041016s, input_fired_time: 10.1753187180, output_fired_time: 8.7529973984, propagate_forward_time: 480.6344909668, propagate_backward_time: 781.1123046875, weight_update_time: 1.1424899101, other_time: 12.9465332031
epoch time: 96.3844451904s, input_fired_time: 1.2312028408, output_fired_time: 0.0000000000, propagate_forward_time: 92.8345565796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3186874390
validation[          , genome  5336] predictions:    5787/  10000 (57.87%), best:    5869/10000 (58.69%), error:     12732.19238, best error:     12504.99414 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 1304.4516601563s, input_fired_time: 10.2248811722, output_fired_time: 8.8667755127, propagate_forward_time: 482.8077392578, propagate_backward_time: 789.4098510742, weight_update_time: 1.1532099247, other_time: 13.1423950195
epoch time: 94.6643142700s, input_fired_time: 1.2248839140, output_fired_time: 0.0000000000, propagate_forward_time: 91.1636428833, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2757873535
validation[          , genome  5336] predictions:    5779/  10000 (57.79%), best:    5869/10000 (58.69%), error:     12604.90527, best error:     12504.99414 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 1320.8214111328s, input_fired_time: 10.2930898666, output_fired_time: 8.9078330994, propagate_forward_time: 491.6839599609, propagate_backward_time: 796.8432006836, weight_update_time: 1.1611846685, other_time: 13.0933227539
epoch time: 102.3603744507s, input_fired_time: 1.2797302008, output_fired_time: 0.0000000000, propagate_forward_time: 98.7176055908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3630371094
validation[          , genome  5336] predictions:    5849/  10000 (58.49%), best:    5869/10000 (58.69%), error:     12528.42871, best error:     12504.99414 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1348.7481689453s, input_fired_time: 10.4202890396, output_fired_time: 9.0069160461, propagate_forward_time: 503.2887878418, propagate_backward_time: 812.4678344727, weight_update_time: 1.1915242672, other_time: 13.5642700195
epoch time: 107.4447555542s, input_fired_time: 1.3284014463, output_fired_time: 0.0000000000, propagate_forward_time: 103.6434173584, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4729385376
validation[          , genome  5336] predictions:    5855/  10000 (58.55%), best:    5855/10000 (58.55%), error:     12392.87500, best error:     12392.87500 on epoch:    48, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1376.1567382813s, input_fired_time: 10.5552186966, output_fired_time: 9.1966543198, propagate_forward_time: 512.8275756836, propagate_backward_time: 830.0941772461, weight_update_time: 1.1938569546, other_time: 13.4831542969
epoch time: 102.6914367676s, input_fired_time: 1.2859302759, output_fired_time: 0.0000000000, propagate_forward_time: 99.0945205688, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3109893799
validation[          , genome  5336] predictions:    5880/  10000 (58.80%), best:    5880/10000 (58.80%), error:     12358.01953, best error:     12358.01953 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 1354.4284667969s, input_fired_time: 10.4316778183, output_fired_time: 9.0190505981, propagate_forward_time: 504.6849365234, propagate_backward_time: 817.1166381836, weight_update_time: 1.1808149815, other_time: 13.1762084961
epoch time: 101.0088729858s, input_fired_time: 1.2755315304, output_fired_time: 0.0000000000, propagate_forward_time: 97.4243240356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3090209961
validation[          , genome  5336] predictions:    5862/  10000 (58.62%), best:    5880/10000 (58.80%), error:     12361.08691, best error:     12358.01953 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 1360.0593261719s, input_fired_time: 10.4776258469, output_fired_time: 9.0554962158, propagate_forward_time: 508.2471008301, propagate_backward_time: 818.9617919922, weight_update_time: 1.1891623735, other_time: 13.3172607422
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_184_5336.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1540746903_184_5336_1_r491222428_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.954182
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.000913721
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 3.65488e-05
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 51
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 49
read number_validation_images: 10000
read best_validation_predictions: 5880
read best_validation_error: 12358
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5336
read normal distribution: '1 -1.1645975112915 0.486778825521469'
generator_str: '126078085'
read generator: 126078085
read generated_by_map:
1 merge_node 1
reading 79 nodes.
reading 270 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1549.47900390625s, input_fired_time: 37.9796295166016, output_fired_time: 33.3940849304199, propagate_forward_time: 512.923583984375, propagate_backward_time: 880.4912109375, weight_update_time: 3.991623878479, other_time: 84.6905517578125
epoch time: 126.333740234375s, input_fired_time: 6.13665294647217, output_fired_time: 0, propagate_forward_time: 104.029167175293, propagate_backward_time: 0, weight_update_time: 0, other_time: 16.1679229736328
validation[          , genome  5336] predictions:    5932/  10000 (59.32%), best:    5932/10000 (59.32%), error:     12326.88086, best error:     12326.88086 on epoch:    51, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 1521.0670166016s, input_fired_time: 37.0154800415, output_fired_time: 32.7694206238, propagate_forward_time: 499.8241577148, propagate_backward_time: 866.1245117188, weight_update_time: 3.9925487041, other_time: 85.3334350586
epoch time: 118.2927551270s, input_fired_time: 5.9471492767, output_fired_time: 0.0000000000, propagate_forward_time: 97.3333511353, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.0122528076
validation[          , genome  5336] predictions:    5815/  10000 (58.15%), best:    5932/10000 (59.32%), error:     12490.02539, best error:     12326.88086 on epoch:    51, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 1472.5192871094s, input_fired_time: 37.2955360413, output_fired_time: 32.7747116089, propagate_forward_time: 486.4097595215, propagate_backward_time: 833.7861938477, weight_update_time: 3.9302332401, other_time: 82.2531127930
epoch time: 111.1662979126s, input_fired_time: 5.6530427933, output_fired_time: 0.0000000000, propagate_forward_time: 91.5664825439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.9467697144
validation[          , genome  5336] predictions:    5934/  10000 (59.34%), best:    5932/10000 (59.32%), error:     12346.78906, best error:     12326.88086 on epoch:    51, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 1523.1203613281s, input_fired_time: 37.9384460449, output_fired_time: 33.3188285828, propagate_forward_time: 501.9223937988, propagate_backward_time: 864.7292480469, weight_update_time: 4.0365185738, other_time: 85.2114257813
epoch time: 117.4539718628s, input_fired_time: 5.8111610413, output_fired_time: 0.0000000000, propagate_forward_time: 96.9025268555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.7402801514
validation[          , genome  5336] predictions:    5850/  10000 (58.50%), best:    5932/10000 (59.32%), error:     12628.27051, best error:     12326.88086 on epoch:    51, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 1509.1551513672s, input_fired_time: 37.9577140808, output_fired_time: 33.5812759399, propagate_forward_time: 496.3707275391, propagate_backward_time: 854.8135375977, weight_update_time: 4.0196533203, other_time: 86.4318237305
epoch time: 107.4211959839s, input_fired_time: 5.4631414413, output_fired_time: 0.0000000000, propagate_forward_time: 88.7691421509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.1889114380
validation[          , genome  5336] predictions:    5910/  10000 (59.10%), best:    5932/10000 (59.32%), error:     12490.54492, best error:     12326.88086 on epoch:    51, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 1479.8448486328s, input_fired_time: 37.8214912415, output_fired_time: 33.1874122620, propagate_forward_time: 489.7047729492, propagate_backward_time: 835.6763305664, weight_update_time: 3.9867379665, other_time: 83.4548339844
epoch time: 112.0127792358s, input_fired_time: 5.3543119431, output_fired_time: 0.0000000000, propagate_forward_time: 93.7193069458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.9391632080
validation[          , genome  5336] predictions:    5989/  10000 (59.89%), best:    5989/10000 (59.89%), error:     12239.07324, best error:     12239.07324 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 1443.7783203125s, input_fired_time: 37.1809120178, output_fired_time: 32.7811660767, propagate_forward_time: 475.3767700195, propagate_backward_time: 815.7191162109, weight_update_time: 3.9386384487, other_time: 82.7203979492
epoch time: 117.8269424438s, input_fired_time: 5.9459314346, output_fired_time: 0.0000000000, propagate_forward_time: 96.5503921509, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.3306198120
validation[          , genome  5336] predictions:    5968/  10000 (59.68%), best:    5968/10000 (59.68%), error:     12198.02734, best error:     12198.02734 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 1491.3919677734s, input_fired_time: 37.4812278748, output_fired_time: 32.6897621155, propagate_forward_time: 496.4088134766, propagate_backward_time: 841.5728149414, weight_update_time: 3.9349210262, other_time: 83.2393188477
epoch time: 112.2974853516s, input_fired_time: 5.4292793274, output_fired_time: 0.0000000000, propagate_forward_time: 93.3617706299, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.5064392090
validation[          , genome  5336] predictions:    5913/  10000 (59.13%), best:    5968/10000 (59.68%), error:     12346.93359, best error:     12198.02734 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 1523.8782958984s, input_fired_time: 37.6363792419, output_fired_time: 32.5529632568, propagate_forward_time: 510.3713073730, propagate_backward_time: 858.8159179688, weight_update_time: 3.9767992496, other_time: 84.5017089844
epoch time: 125.4145278931s, input_fired_time: 5.9199018478, output_fired_time: 0.0000000000, propagate_forward_time: 103.6117858887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.8828430176
validation[          , genome  5336] predictions:    5908/  10000 (59.08%), best:    5968/10000 (59.68%), error:     12305.20117, best error:     12198.02734 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 1521.7979736328s, input_fired_time: 37.8882713318, output_fired_time: 33.1428375244, propagate_forward_time: 508.5513000488, propagate_backward_time: 858.6295166016, weight_update_time: 3.9572997093, other_time: 83.5860595703
epoch time: 119.5002593994s, input_fired_time: 5.8550271988, output_fired_time: 0.0000000000, propagate_forward_time: 98.7475128174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.8977203369
validation[          , genome  5336] predictions:    5986/  10000 (59.86%), best:    5986/10000 (59.86%), error:     12047.77637, best error:     12047.77637 on epoch:    60, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 1542.7019042969s, input_fired_time: 38.1898460388, output_fired_time: 33.0557365417, propagate_forward_time: 512.9149780273, propagate_backward_time: 871.5481567383, weight_update_time: 4.0886693001, other_time: 86.9931640625
epoch time: 119.0005950928s, input_fired_time: 5.8124742508, output_fired_time: 0.0000000000, propagate_forward_time: 98.7493438721, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.4387741089
validation[          , genome  5336] predictions:    5782/  10000 (57.82%), best:    5986/10000 (59.86%), error:     12941.13281, best error:     12047.77637 on epoch:    60, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 1550.7053222656s, input_fired_time: 38.1746444702, output_fired_time: 33.3556747437, propagate_forward_time: 515.0678100586, propagate_backward_time: 878.8754882813, weight_update_time: 4.0262532234, other_time: 85.2316284180
epoch time: 127.0660781860s, input_fired_time: 6.1369948387, output_fired_time: 0.0000000000, propagate_forward_time: 104.9997711182, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.9293136597
validation[          , genome  5336] predictions:    5959/  10000 (59.59%), best:    5986/10000 (59.86%), error:     12188.89160, best error:     12047.77637 on epoch:    60, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 1591.9670410156s, input_fired_time: 38.9960212708, output_fired_time: 33.7792968750, propagate_forward_time: 532.5339965820, propagate_backward_time: 897.8415527344, weight_update_time: 4.1522727013, other_time: 88.8162231445
epoch time: 130.3945007324s, input_fired_time: 6.1252479553, output_fired_time: 0.0000000000, propagate_forward_time: 108.3710784912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.8981781006
validation[          , genome  5336] predictions:    6068/  10000 (60.68%), best:    6068/10000 (60.68%), error:     11905.28320, best error:     11905.28320 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 1652.0623779297s, input_fired_time: 39.3421478271, output_fired_time: 34.3226661682, propagate_forward_time: 549.5379028320, propagate_backward_time: 941.0851440430, weight_update_time: 4.2255492210, other_time: 87.7744750977
epoch time: 135.8819580078s, input_fired_time: 6.2724604607, output_fired_time: 0.0000000000, propagate_forward_time: 113.2374191284, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.3720779419
validation[          , genome  5336] predictions:    5979/  10000 (59.79%), best:    6068/10000 (60.68%), error:     12195.44629, best error:     11905.28320 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 1681.1367187500s, input_fired_time: 40.1373023987, output_fired_time: 34.6037979126, propagate_forward_time: 565.9601440430, propagate_backward_time: 951.8162231445, weight_update_time: 4.2257771492, other_time: 88.6193237305
epoch time: 139.2533874512s, input_fired_time: 6.4791235924, output_fired_time: 0.0000000000, propagate_forward_time: 116.2922821045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.4819793701
validation[          , genome  5336] predictions:    6037/  10000 (60.37%), best:    6068/10000 (60.68%), error:     11915.54785, best error:     11905.28320 on epoch:    63, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 1701.0318603516s, input_fired_time: 40.0718307495, output_fired_time: 34.6946754456, propagate_forward_time: 572.1519775391, propagate_backward_time: 966.5240478516, weight_update_time: 4.2017593384, other_time: 87.5893554688
epoch time: 134.5942535400s, input_fired_time: 6.2590446472, output_fired_time: 0.0000000000, propagate_forward_time: 111.7954254150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.5397796631
validation[          , genome  5336] predictions:    6061/  10000 (60.61%), best:    6068/10000 (60.68%), error:     12074.33203, best error:     11905.28320 on epoch:    63, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 1664.7475585938s, input_fired_time: 39.8580093384, output_fired_time: 34.2699966431, propagate_forward_time: 555.5604858398, propagate_backward_time: 946.2905273438, weight_update_time: 4.2144618034, other_time: 88.7685546875
epoch time: 132.9293365479s, input_fired_time: 6.1820082664, output_fired_time: 0.0000000000, propagate_forward_time: 110.7909317017, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.9563980103
validation[          , genome  5336] predictions:    6063/  10000 (60.63%), best:    6063/10000 (60.63%), error:     11868.14844, best error:     11868.14844 on epoch:    67, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 1652.4194335938s, input_fired_time: 39.3767204285, output_fired_time: 33.9667625427, propagate_forward_time: 556.3817749023, propagate_backward_time: 937.5626220703, weight_update_time: 4.0848436356, other_time: 85.1315307617
epoch time: 137.2396545410s, input_fired_time: 6.3020529747, output_fired_time: 0.0000000000, propagate_forward_time: 114.7943115234, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.1432952881
validation[          , genome  5336] predictions:    6073/  10000 (60.73%), best:    6063/10000 (60.63%), error:     12129.82031, best error:     11868.14844 on epoch:    67, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 1668.5743408203s, input_fired_time: 39.3896522522, output_fired_time: 33.8685340881, propagate_forward_time: 561.8672485352, propagate_backward_time: 946.3902587891, weight_update_time: 4.1864914894, other_time: 87.0587158203
epoch time: 123.1852493286s, input_fired_time: 5.8815169334, output_fired_time: 0.0000000000, propagate_forward_time: 102.2390975952, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.0646362305
validation[          , genome  5336] predictions:    5952/  10000 (59.52%), best:    6063/10000 (60.63%), error:     12185.59180, best error:     11868.14844 on epoch:    67, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 1529.8995361328s, input_fired_time: 37.8521919250, output_fired_time: 33.0396881104, propagate_forward_time: 508.7301635742, propagate_backward_time: 865.9390258789, weight_update_time: 3.9835820198, other_time: 84.3385009766
epoch time: 123.3729934692s, input_fired_time: 6.0783047676, output_fired_time: 0.0000000000, propagate_forward_time: 101.8563232422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.4383621216
validation[          , genome  5336] predictions:    6043/  10000 (60.43%), best:    6063/10000 (60.63%), error:     12077.83789, best error:     11868.14844 on epoch:    67, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 1563.1080322266s, input_fired_time: 38.5898208618, output_fired_time: 33.2185401917, propagate_forward_time: 522.7457885742, propagate_backward_time: 883.8467407227, weight_update_time: 4.0799655914, other_time: 84.7071533203
epoch time: 127.2826004028s, input_fired_time: 6.1288418770, output_fired_time: 0.0000000000, propagate_forward_time: 104.9229736328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.2307815552
validation[          , genome  5336] predictions:    5995/  10000 (59.95%), best:    6063/10000 (60.63%), error:     12098.43457, best error:     11868.14844 on epoch:    67, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 1522.3428955078s, input_fired_time: 37.9420547485, output_fired_time: 33.3792190552, propagate_forward_time: 503.4662780762, propagate_backward_time: 863.2512207031, weight_update_time: 3.9950647354, other_time: 84.3040771484
epoch time: 116.2110366821s, input_fired_time: 5.7828049660, output_fired_time: 0.0000000000, propagate_forward_time: 95.8266220093, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.6016082764
validation[          , genome  5336] predictions:    5999/  10000 (59.99%), best:    6063/10000 (60.63%), error:     11944.99316, best error:     11868.14844 on epoch:    67, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 1519.9575195313s, input_fired_time: 37.8838043213, output_fired_time: 33.0526695251, propagate_forward_time: 505.0901489258, propagate_backward_time: 860.0037231445, weight_update_time: 3.9589054585, other_time: 83.9272460938
epoch time: 123.4359817505s, input_fired_time: 5.8857712746, output_fired_time: 0.0000000000, propagate_forward_time: 102.9810104370, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.5691986084
validation[          , genome  5336] predictions:    6081/  10000 (60.81%), best:    6081/10000 (60.81%), error:     11796.40332, best error:     11796.40332 on epoch:    73, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 1550.6968994141s, input_fired_time: 38.0391769409, output_fired_time: 33.1100769043, propagate_forward_time: 514.8943481445, propagate_backward_time: 880.7848510742, weight_update_time: 3.9775767326, other_time: 83.8684082031
epoch time: 123.1200256348s, input_fired_time: 5.8852591515, output_fired_time: 0.0000000000, propagate_forward_time: 102.0545349121, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.1802291870
validation[          , genome  5336] predictions:    6064/  10000 (60.64%), best:    6081/10000 (60.81%), error:     11869.82422, best error:     11796.40332 on epoch:    73, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 1481.1179199219s, input_fired_time: 37.2238807678, output_fired_time: 32.6758308411, propagate_forward_time: 491.3007812500, propagate_backward_time: 839.8159790039, weight_update_time: 3.9079005718, other_time: 80.1015014648
epoch time: 119.5750732422s, input_fired_time: 5.8344192505, output_fired_time: 0.0000000000, propagate_forward_time: 98.7154159546, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.0252380371
validation[          , genome  5336] predictions:    6003/  10000 (60.03%), best:    6081/10000 (60.81%), error:     12074.34375, best error:     11796.40332 on epoch:    73, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 1568.1748046875s, input_fired_time: 39.1931419373, output_fired_time: 33.8190078735, propagate_forward_time: 526.2612304688, propagate_backward_time: 883.2813720703, weight_update_time: 4.0506763458, other_time: 85.6201171875
epoch time: 132.8943176270s, input_fired_time: 6.3318390846, output_fired_time: 0.0000000000, propagate_forward_time: 110.5291671753, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.0333099365
validation[          , genome  5336] predictions:    6072/  10000 (60.72%), best:    6081/10000 (60.81%), error:     11974.01758, best error:     11796.40332 on epoch:    73, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 1649.1724853516s, input_fired_time: 40.0974731445, output_fired_time: 34.8570594788, propagate_forward_time: 555.1243896484, propagate_backward_time: 933.1508178711, weight_update_time: 4.1613063812, other_time: 85.9426879883
epoch time: 131.8018646240s, input_fired_time: 6.3505625725, output_fired_time: 0.0000000000, propagate_forward_time: 110.1140289307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.3372726440
validation[          , genome  5336] predictions:    6058/  10000 (60.58%), best:    6081/10000 (60.81%), error:     12027.97559, best error:     11796.40332 on epoch:    73, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 1654.6566162109s, input_fired_time: 40.2281875610, output_fired_time: 34.4788284302, propagate_forward_time: 552.8490600586, propagate_backward_time: 938.0651245117, weight_update_time: 4.2625756264, other_time: 89.0354614258
epoch time: 132.6873931885s, input_fired_time: 6.3222885132, output_fired_time: 0.0000000000, propagate_forward_time: 110.0965728760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 16.2685317993
validation[          , genome  5336] predictions:    6060/  10000 (60.60%), best:    6081/10000 (60.81%), error:     11929.20996, best error:     11796.40332 on epoch:    73, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 1816.0452880859s, input_fired_time: 39.2749099731, output_fired_time: 33.7411193848, propagate_forward_time: 625.4301147461, propagate_backward_time: 1032.7855224609, weight_update_time: 4.1252284050, other_time: 84.8135986328
epoch time: 156.8093872070s, input_fired_time: 5.7057704926, output_fired_time: 0.0000000000, propagate_forward_time: 138.7957153320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.3079071045
validation[          , genome  5336] predictions:    6062/  10000 (60.62%), best:    6081/10000 (60.81%), error:     11823.54004, best error:     11796.40332 on epoch:    73, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1861.8366699219s, input_fired_time: 39.3371543884, output_fired_time: 33.3145523071, propagate_forward_time: 650.4248046875, propagate_backward_time: 1058.1311035156, weight_update_time: 3.9665122032, other_time: 80.6290283203
epoch time: 148.1911926270s, input_fired_time: 5.9542798996, output_fired_time: 0.0000000000, propagate_forward_time: 128.3083343506, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.9285736084
validation[          , genome  5336] predictions:    6109/  10000 (61.09%), best:    6081/10000 (60.81%), error:     11823.84668, best error:     11796.40332 on epoch:    73, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1818.9338378906s, input_fired_time: 36.3920173645, output_fired_time: 31.5203056335, propagate_forward_time: 638.0611572266, propagate_backward_time: 1036.8131103516, weight_update_time: 3.8455386162, other_time: 76.1473388672
epoch time: 144.8435821533s, input_fired_time: 5.6525177956, output_fired_time: 0.0000000000, propagate_forward_time: 126.5502471924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.6408233643
validation[          , genome  5336] predictions:    6095/  10000 (60.95%), best:    6095/10000 (60.95%), error:     11739.24316, best error:     11739.24316 on epoch:    81, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1863.6928710938s, input_fired_time: 39.8415298462, output_fired_time: 34.0370292664, propagate_forward_time: 646.2214965820, propagate_backward_time: 1059.2171630859, weight_update_time: 4.0667362213, other_time: 84.3756103516
epoch time: 160.2551269531s, input_fired_time: 7.0539674759, output_fired_time: 0.0000000000, propagate_forward_time: 134.3389129639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 18.8622436523
validation[          , genome  5336] predictions:    6057/  10000 (60.57%), best:    6095/10000 (60.95%), error:     11889.24414, best error:     11739.24316 on epoch:    81, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 1747.9201660156s, input_fired_time: 31.6746826172, output_fired_time: 28.0821914673, propagate_forward_time: 625.9198608398, propagate_backward_time: 1003.1675415039, weight_update_time: 3.2731580734, other_time: 59.0758666992
epoch time: 151.9238281250s, input_fired_time: 5.9508495331, output_fired_time: 0.0000000000, propagate_forward_time: 131.6271972656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.3457794189
validation[          , genome  5336] predictions:    6097/  10000 (60.97%), best:    6095/10000 (60.95%), error:     12030.11035, best error:     11739.24316 on epoch:    81, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 1826.6384277344s, input_fired_time: 36.4187126160, output_fired_time: 30.7838611603, propagate_forward_time: 640.7022094727, propagate_backward_time: 1041.9711914063, weight_update_time: 3.7488362789, other_time: 76.7624511719
epoch time: 145.0639190674s, input_fired_time: 5.6711821556, output_fired_time: 0.0000000000, propagate_forward_time: 125.3504180908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 14.0423126221
validation[          , genome  5336] predictions:    6075/  10000 (60.75%), best:    6095/10000 (60.95%), error:     11984.53223, best error:     11739.24316 on epoch:    81, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 1773.1638183594s, input_fired_time: 33.8035507202, output_fired_time: 28.4079341888, propagate_forward_time: 626.5671997070, propagate_backward_time: 1017.9941406250, weight_update_time: 3.4175536633, other_time: 66.3908691406
epoch time: 144.4170227051s, input_fired_time: 5.0916843414, output_fired_time: 0.0000000000, propagate_forward_time: 126.8579025269, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.4674301147
validation[          , genome  5336] predictions:    6085/  10000 (60.85%), best:    6095/10000 (60.95%), error:     11905.72656, best error:     11739.24316 on epoch:    81, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 1785.1662597656s, input_fired_time: 32.3099212646, output_fired_time: 27.1565761566, propagate_forward_time: 632.7451782227, propagate_backward_time: 1024.9779052734, weight_update_time: 3.3854453564, other_time: 67.9766845703
epoch time: 138.2733917236s, input_fired_time: 4.2490258217, output_fired_time: 0.0000000000, propagate_forward_time: 123.9989700317, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.0253982544
validation[          , genome  5336] predictions:    6054/  10000 (60.54%), best:    6095/10000 (60.95%), error:     11949.99121, best error:     11739.24316 on epoch:    81, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 1803.5803222656s, input_fired_time: 32.4158935547, output_fired_time: 27.4505710602, propagate_forward_time: 639.5750122070, propagate_backward_time: 1037.3049316406, weight_update_time: 3.3592629433, other_time: 66.8339843750
epoch time: 151.8527984619s, input_fired_time: 5.6941933632, output_fired_time: 0.0000000000, propagate_forward_time: 130.8815917969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 15.2770080566
validation[          , genome  5336] predictions:    6049/  10000 (60.49%), best:    6095/10000 (60.95%), error:     12024.51855, best error:     11739.24316 on epoch:    81, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 1631.9941406250s, input_fired_time: 18.7788372040, output_fired_time: 15.8794527054, propagate_forward_time: 599.1427001953, propagate_backward_time: 962.1023559570, weight_update_time: 2.0422012806, other_time: 36.0908813477
epoch time: 123.9035186768s, input_fired_time: 1.5737518072, output_fired_time: 0.0000000000, propagate_forward_time: 118.6826629639, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.6471023560
validation[          , genome  5336] predictions:    6093/  10000 (60.93%), best:    6095/10000 (60.95%), error:     11831.48730, best error:     11739.24316 on epoch:    81, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1582.5733642578s, input_fired_time: 12.1729869843, output_fired_time: 10.8132238388, propagate_forward_time: 593.3002929688, propagate_backward_time: 945.5311889648, weight_update_time: 1.3986146450, other_time: 20.7556762695
epoch time: 124.5818481445s, input_fired_time: 1.5866686106, output_fired_time: 0.0000000000, propagate_forward_time: 119.1801452637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8150329590
validation[          , genome  5336] predictions:    6074/  10000 (60.74%), best:    6095/10000 (60.95%), error:     11886.21777, best error:     11739.24316 on epoch:    81, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1559.3028564453s, input_fired_time: 12.0577688217, output_fired_time: 10.6412715912, propagate_forward_time: 584.9939575195, propagate_backward_time: 931.3144531250, weight_update_time: 1.3862340450, other_time: 20.2954711914
epoch time: 118.8424606323s, input_fired_time: 1.5385497808, output_fired_time: 0.0000000000, propagate_forward_time: 113.5697784424, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7341308594
validation[          , genome  5336] predictions:    6073/  10000 (60.73%), best:    6095/10000 (60.95%), error:     11832.10645, best error:     11739.24316 on epoch:    81, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 1554.7078857422s, input_fired_time: 11.8305196762, output_fired_time: 10.5181550980, propagate_forward_time: 584.3838500977, propagate_backward_time: 930.3266601563, weight_update_time: 1.3337886333, other_time: 17.6486206055
epoch time: 110.9341812134s, input_fired_time: 1.3870337009, output_fired_time: 0.0000000000, propagate_forward_time: 107.2412109375, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3059387207
validation[          , genome  5336] predictions:    6099/  10000 (60.99%), best:    6095/10000 (60.95%), error:     11792.02148, best error:     11739.24316 on epoch:    81, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1415.7353515625s, input_fired_time: 10.7570075989, output_fired_time: 9.2125549316, propagate_forward_time: 530.5689697266, propagate_backward_time: 852.2391357422, weight_update_time: 1.1942603588, other_time: 12.9577636719
epoch time: 106.5997009277s, input_fired_time: 1.3492866755, output_fired_time: 0.0000000000, propagate_forward_time: 103.0070419312, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2433700562
validation[          , genome  5336] predictions:    6090/  10000 (60.90%), best:    6095/10000 (60.95%), error:     11908.84277, best error:     11739.24316 on epoch:    81, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1401.8730468750s, input_fired_time: 10.7461423874, output_fired_time: 9.1095237732, propagate_forward_time: 527.4628295898, propagate_backward_time: 841.6099243164, weight_update_time: 1.1903223991, other_time: 12.9447021484
epoch time: 107.3914184570s, input_fired_time: 1.3638975620, output_fired_time: 0.0000000000, propagate_forward_time: 103.7412872314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2862319946
validation[          , genome  5336] predictions:    6074/  10000 (60.74%), best:    6095/10000 (60.95%), error:     11937.64941, best error:     11739.24316 on epoch:    81, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1445.1574707031s, input_fired_time: 10.9157171249, output_fired_time: 9.3586740494, propagate_forward_time: 544.4056396484, propagate_backward_time: 867.3509521484, weight_update_time: 1.2129604816, other_time: 13.1264648438
epoch time: 113.9403991699s, input_fired_time: 1.4141989946, output_fired_time: 0.0000000000, propagate_forward_time: 110.1781539917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3480453491
validation[          , genome  5336] predictions:    6083/  10000 (60.83%), best:    6095/10000 (60.95%), error:     11850.51953, best error:     11739.24316 on epoch:    81, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1457.8524169922s, input_fired_time: 10.9726181030, output_fired_time: 9.4488649368, propagate_forward_time: 548.0308837891, propagate_backward_time: 876.1628417969, weight_update_time: 1.2234598398, other_time: 13.2371826172
epoch time: 113.0256500244s, input_fired_time: 1.4103655815, output_fired_time: 0.0000000000, propagate_forward_time: 109.2990188599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3162689209
validation[          , genome  5336] predictions:    6090/  10000 (60.90%), best:    6095/10000 (60.95%), error:     11855.55664, best error:     11739.24316 on epoch:    81, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1442.4149169922s, input_fired_time: 10.8903875351, output_fired_time: 9.3499479294, propagate_forward_time: 541.5298461914, propagate_backward_time: 867.5738525391, weight_update_time: 1.2089295387, other_time: 13.0708618164
epoch time: 110.1985321045s, input_fired_time: 1.3810617924, output_fired_time: 0.0000000000, propagate_forward_time: 106.5344848633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2829818726
validation[          , genome  5336] predictions:    6115/  10000 (61.15%), best:    6095/10000 (60.95%), error:     11884.42969, best error:     11739.24316 on epoch:    81, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1432.0980224609s, input_fired_time: 10.8392391205, output_fired_time: 9.2162275314, propagate_forward_time: 537.7130126953, propagate_backward_time: 861.3568115234, weight_update_time: 1.1982945204, other_time: 12.9727783203
epoch time: 105.8910064697s, input_fired_time: 1.3473536968, output_fired_time: 0.0000000000, propagate_forward_time: 102.3234634399, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2201919556
validation[          , genome  5336] predictions:    6120/  10000 (61.20%), best:    6095/10000 (60.95%), error:     11923.05957, best error:     11739.24316 on epoch:    81, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1376.7064208984s, input_fired_time: 10.6525392532, output_fired_time: 8.9369583130, propagate_forward_time: 516.5498046875, propagate_backward_time: 827.8400878906, weight_update_time: 1.1689609289, other_time: 12.7269287109
epoch time: 109.2134399414s, input_fired_time: 1.3739547729, output_fired_time: 0.0000000000, propagate_forward_time: 105.5718688965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2676162720
validation[          , genome  5336] predictions:    6074/  10000 (60.74%), best:    6095/10000 (60.95%), error:     11859.44043, best error:     11739.24316 on epoch:    81, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1380.9417724609s, input_fired_time: 10.6615428925, output_fired_time: 8.9656877518, propagate_forward_time: 518.1603393555, propagate_backward_time: 830.3243408203, weight_update_time: 1.1810878515, other_time: 12.8298950195
epoch time: 106.6930999756s, input_fired_time: 1.3561563492, output_fired_time: 0.0000000000, propagate_forward_time: 103.1053848267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2315597534
validation[          , genome  5336] predictions:    6081/  10000 (60.81%), best:    6095/10000 (60.95%), error:     11893.93652, best error:     11739.24316 on epoch:    81, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1356.6553955078s, input_fired_time: 10.6106958389, output_fired_time: 8.8866977692, propagate_forward_time: 508.4136352539, propagate_backward_time: 815.9190673828, weight_update_time: 1.1726647615, other_time: 12.8252563477
epoch time: 103.6056442261s, input_fired_time: 1.3409999609, output_fired_time: 0.0000000000, propagate_forward_time: 100.0259552002, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2386856079
validation[          , genome  5336] predictions:    6094/  10000 (60.94%), best:    6095/10000 (60.95%), error:     11871.21387, best error:     11739.24316 on epoch:    81, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 542.6911010742s, input_fired_time: 6.8404412270, output_fired_time: 0.0000000000, propagate_forward_time: 524.3373413086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.5133056641
best training[          , genome  5336] predictions:   39576/  50000 (79.15%), best:    6095/10000 (60.95%), error:     31325.03125, best error:     11739.24316 on epoch:    81, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 105.1037979126s, input_fired_time: 1.3406523466, output_fired_time: 0.0000000000, propagate_forward_time: 101.5127868652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2503585815
   testing[          , genome  5336] predictions:    6095/  10000 (60.95%), best:    6095/10000 (60.95%), error:     11739.24316, best error:     11739.24316 on epoch:    81, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
11:18:17 (13824): called boinc_finish(0)

</stderr_txt>
]]>