Nameexact_genome_1530269703_162_7537_0
Workunit3834755
Created30 Jun 2018, 10:58:50 UTC
Sent30 Jun 2018, 11:58:50 UTC
Report deadline9 Nov 2018, 20:11:27 UTC
Received5 Jul 2018, 17:58:02 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID65660
Run time2 days 14 hours 37 min 14 sec
CPU time2 days 6 hours 43 min 6 sec
Validate stateInitial
Credit0.00
Device peak FLOPS4.71 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size573.55 MB
Peak swap size593.23 MB
Peak disk usage13.30 MB

Stderr output

<core_client_version>7.10.2</core_client_version>
<![CDATA[
<stderr_txt>
.0000000000, other_time: 2.5042877197
validation[          , genome  7537] predictions:    6571/  10000 (65.71%), best:    6627/10000 (66.27%), error:     10095.61035, best error:      9926.38379 on epoch:    55, epoch:   56/100, mu: 0.9585766792, learning_rate: 0.0000178717, weight_decay: 0.0000244225

epoch time: 1950.0952148438s, input_fired_time: 26.4341506958, output_fired_time: 13.0993480682, propagate_forward_time: 786.0139160156, propagate_backward_time: 1110.1512451172, weight_update_time: 0.4975567162, other_time: 14.3964843750
epoch time: 156.4155578613s, input_fired_time: 2.0480577946, output_fired_time: 0.0000000000, propagate_forward_time: 151.8525695801, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5149230957
validation[          , genome  7537] predictions:    6592/  10000 (65.92%), best:    6627/10000 (66.27%), error:     10087.93359, best error:      9926.38379 on epoch:    55, epoch:   57/100, mu: 0.9600608349, learning_rate: 0.0000166048, weight_decay: 0.0000230890

epoch time: 1882.5112304688s, input_fired_time: 25.8183708191, output_fired_time: 12.7336711884, propagate_forward_time: 734.4270019531, propagate_backward_time: 1095.4449462891, weight_update_time: 0.5102292895, other_time: 14.0872802734
epoch time: 147.3820190430s, input_fired_time: 1.9238630533, output_fired_time: 0.0000000000, propagate_forward_time: 143.0625305176, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3956298828
validation[          , genome  7537] predictions:    6440/  10000 (64.40%), best:    6627/10000 (66.27%), error:     10349.86621, best error:      9926.38379 on epoch:    55, epoch:   58/100, mu: 0.9614748955, learning_rate: 0.0000154276, weight_decay: 0.0000218282

epoch time: 1910.1009521484s, input_fired_time: 26.4581432343, output_fired_time: 12.9710626602, propagate_forward_time: 745.5220336914, propagate_backward_time: 1110.9788818359, weight_update_time: 0.4995745122, other_time: 14.1707763672
epoch time: 156.2245025635s, input_fired_time: 1.9945449829, output_fired_time: 0.0000000000, propagate_forward_time: 151.7507629395, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4791870117
validation[          , genome  7537] predictions:    6570/  10000 (65.70%), best:    6627/10000 (66.27%), error:     10068.16113, best error:      9926.38379 on epoch:    55, epoch:   59/100, mu: 0.9628221989, learning_rate: 0.0000143339, weight_decay: 0.0000206364

epoch time: 2178.1789550781s, input_fired_time: 28.8030185699, output_fired_time: 14.1111097336, propagate_forward_time: 861.2635498047, propagate_backward_time: 1258.5750732422, weight_update_time: 0.4972097278, other_time: 15.4262695313
epoch time: 168.6510009766s, input_fired_time: 2.2051167488, output_fired_time: 0.0000000000, propagate_forward_time: 163.6985168457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7473602295
validation[          , genome  7537] predictions:    6580/  10000 (65.80%), best:    6627/10000 (66.27%), error:     10079.76270, best error:      9926.38379 on epoch:    55, epoch:   60/100, mu: 0.9641058445, learning_rate: 0.0000133177, weight_decay: 0.0000195096

epoch time: 2104.3974609375s, input_fired_time: 28.7190551758, output_fired_time: 14.3008775711, propagate_forward_time: 814.7869262695, propagate_backward_time: 1230.9173583984, weight_update_time: 0.5520262718, other_time: 15.6734619141
epoch time: 151.8941345215s, input_fired_time: 1.9670729637, output_fired_time: 0.0000000000, propagate_forward_time: 147.4762420654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4508209229
validation[          , genome  7537] predictions:    6568/  10000 (65.68%), best:    6627/10000 (66.27%), error:     10112.30859, best error:      9926.38379 on epoch:    55, epoch:   61/100, mu: 0.9653288722, learning_rate: 0.0000123736, weight_decay: 0.0000184443

epoch time: 1898.0627441406s, input_fired_time: 26.0372142792, output_fired_time: 12.9558992386, propagate_forward_time: 740.3765258789, propagate_backward_time: 1104.4093017578, weight_update_time: 0.4909893572, other_time: 14.2838134766
epoch time: 153.4425506592s, input_fired_time: 1.9943642616, output_fired_time: 0.0000000000, propagate_forward_time: 148.9514160156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4967651367
validation[          , genome  7537] predictions:    6618/  10000 (66.18%), best:    6627/10000 (66.27%), error:     10100.55273, best error:      9926.38379 on epoch:    55, epoch:   62/100, mu: 0.9664941430, learning_rate: 0.0000114964, weight_decay: 0.0000174372

epoch time: 2038.3590087891s, input_fired_time: 27.2004470825, output_fired_time: 13.3882112503, propagate_forward_time: 762.5781860352, propagate_backward_time: 1220.6893310547, weight_update_time: 0.4928260446, other_time: 14.5028076172
epoch time: 166.1829986572s, input_fired_time: 2.1411406994, output_fired_time: 0.0000000000, propagate_forward_time: 161.2690124512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7728424072
validation[          , genome  7537] predictions:    6624/  10000 (66.24%), best:    6627/10000 (66.27%), error:      9943.89844, best error:      9926.38379 on epoch:    55, epoch:   63/100, mu: 0.9676043391, learning_rate: 0.0000106814, weight_decay: 0.0000164850

epoch time: 1969.2404785156s, input_fired_time: 27.3087043762, output_fired_time: 13.4829587936, propagate_forward_time: 769.6973266602, propagate_backward_time: 1144.0722656250, weight_update_time: 0.5131641030, other_time: 14.6791992188
epoch time: 151.4557342529s, input_fired_time: 1.9618082047, output_fired_time: 0.0000000000, propagate_forward_time: 147.1083221436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3856048584
validation[          , genome  7537] predictions:    6644/  10000 (66.44%), best:    6644/10000 (66.44%), error:      9919.46387, best error:      9919.46387 on epoch:    64, epoch:   64/100, mu: 0.9686621428, learning_rate: 0.0000099241, weight_decay: 0.0000155849

epoch time: 1953.8614501953s, input_fired_time: 26.9383773804, output_fired_time: 13.3520250320, propagate_forward_time: 765.1022338867, propagate_backward_time: 1133.8298339844, weight_update_time: 0.5396780968, other_time: 14.6389160156
epoch time: 160.9478607178s, input_fired_time: 2.1339454651, output_fired_time: 0.0000000000, propagate_forward_time: 156.1605529785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6533660889
validation[          , genome  7537] predictions:    6648/  10000 (66.48%), best:    6648/10000 (66.48%), error:      9866.20801, best error:      9866.20801 on epoch:    65, epoch:   65/100, mu: 0.9696699381, learning_rate: 0.0000092206, weight_decay: 0.0000147339

epoch time: 1927.2301025391s, input_fired_time: 26.6178321838, output_fired_time: 13.0457859039, propagate_forward_time: 756.7878417969, propagate_backward_time: 1116.3496093750, weight_update_time: 0.5112334490, other_time: 14.4290771484
epoch time: 159.1532745361s, input_fired_time: 2.0639827251, output_fired_time: 0.0000000000, propagate_forward_time: 154.5613403320, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5279541016
validation[          , genome  7537] predictions:    6649/  10000 (66.49%), best:    6649/10000 (66.49%), error:      9855.65820, best error:      9855.65820 on epoch:    66, epoch:   66/100, mu: 0.9706301689, learning_rate: 0.0000085669, weight_decay: 0.0000139294

epoch time: 2051.4672851563s, input_fired_time: 27.2653007507, output_fired_time: 13.3167295456, propagate_forward_time: 859.1987915039, propagate_backward_time: 1137.1517333984, weight_update_time: 0.5430334210, other_time: 14.5347900391
epoch time: 153.8565673828s, input_fired_time: 2.0435166359, output_fired_time: 0.0000000000, propagate_forward_time: 149.4344940186, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3785552979
validation[          , genome  7537] predictions:    6606/  10000 (66.06%), best:    6649/10000 (66.49%), error:      9970.91016, best error:      9855.65820 on epoch:    66, epoch:   67/100, mu: 0.9715450406, learning_rate: 0.0000079596, weight_decay: 0.0000131688

epoch time: 1940.2894287109s, input_fired_time: 26.8633537292, output_fired_time: 13.2569456100, propagate_forward_time: 758.9071655273, propagate_backward_time: 1126.7935791016, weight_update_time: 0.5595593452, other_time: 14.4683837891
epoch time: 157.9607543945s, input_fired_time: 2.0582644939, output_fired_time: 0.0000000000, propagate_forward_time: 153.4202575684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4822387695
validation[          , genome  7537] predictions:    6664/  10000 (66.64%), best:    6664/10000 (66.64%), error:      9847.48828, best error:      9847.48828 on epoch:    68, epoch:   68/100, mu: 0.9724166989, learning_rate: 0.0000073953, weight_decay: 0.0000124498

epoch time: 1913.9473876953s, input_fired_time: 26.4635028839, output_fired_time: 12.9909954071, propagate_forward_time: 749.6490478516, propagate_backward_time: 1110.5870361328, weight_update_time: 0.5032403469, other_time: 14.2568359375
epoch time: 154.1963500977s, input_fired_time: 2.0049545765, output_fired_time: 0.0000000000, propagate_forward_time: 149.7333068848, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4580841064
validation[          , genome  7537] predictions:    6621/  10000 (66.21%), best:    6664/10000 (66.64%), error:      9996.92383, best error:      9847.48828 on epoch:    68, epoch:   69/100, mu: 0.9732471704, learning_rate: 0.0000068710, weight_decay: 0.0000117700

epoch time: 2009.8631591797s, input_fired_time: 27.2346496582, output_fired_time: 13.4740924835, propagate_forward_time: 816.4583740234, propagate_backward_time: 1138.0532226563, weight_update_time: 0.4920982122, other_time: 14.6428222656
epoch time: 153.8106536865s, input_fired_time: 2.0632681847, output_fired_time: 0.0000000000, propagate_forward_time: 149.2973327637, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4500579834
validation[          , genome  7537] predictions:    6603/  10000 (66.03%), best:    6664/10000 (66.64%), error:      9987.46777, best error:      9847.48828 on epoch:    68, epoch:   70/100, mu: 0.9740384221, learning_rate: 0.0000063839, weight_decay: 0.0000111273

epoch time: 1944.4157714844s, input_fired_time: 26.8712253571, output_fired_time: 13.3788146973, propagate_forward_time: 758.2174072266, propagate_backward_time: 1131.4626464844, weight_update_time: 0.5175534487, other_time: 14.4857177734
epoch time: 159.3525543213s, input_fired_time: 2.1271772385, output_fired_time: 0.0000000000, propagate_forward_time: 154.5481719971, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6772003174
validation[          , genome  7537] predictions:    6688/  10000 (66.88%), best:    6664/10000 (66.64%), error:      9861.36035, best error:      9847.48828 on epoch:    68, epoch:   71/100, mu: 0.9747923017, learning_rate: 0.0000059313, weight_decay: 0.0000105197

epoch time: 1944.3326416016s, input_fired_time: 26.9049224854, output_fired_time: 13.0888519287, propagate_forward_time: 758.6090087891, propagate_backward_time: 1131.0747070313, weight_update_time: 0.5280213356, other_time: 14.6551513672
epoch time: 154.5014648438s, input_fired_time: 2.0331900120, output_fired_time: 0.0000000000, propagate_forward_time: 150.0331420898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4351348877
validation[          , genome  7537] predictions:    6654/  10000 (66.54%), best:    6664/10000 (66.64%), error:      9872.62109, best error:      9847.48828 on epoch:    68, epoch:   72/100, mu: 0.9755105972, learning_rate: 0.0000055108, weight_decay: 0.0000099453

epoch time: 1930.2965087891s, input_fired_time: 26.6820392609, output_fired_time: 13.2765417099, propagate_forward_time: 753.2407836914, propagate_backward_time: 1122.8637695313, weight_update_time: 0.5248405933, other_time: 14.2333984375
epoch time: 196.8319702148s, input_fired_time: 2.0464403629, output_fired_time: 0.0000000000, propagate_forward_time: 192.2023773193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5831451416
validation[          , genome  7537] predictions:    6635/  10000 (66.35%), best:    6664/10000 (66.64%), error:      9858.99219, best error:      9847.48828 on epoch:    68, epoch:   73/100, mu: 0.9761949778, learning_rate: 0.0000051202, weight_decay: 0.0000094023

epoch time: 1979.5568847656s, input_fired_time: 26.8547458649, output_fired_time: 13.2097587585, propagate_forward_time: 756.8034667969, propagate_backward_time: 1168.2299804688, weight_update_time: 0.5288692713, other_time: 14.4589843750
epoch time: 149.6200256348s, input_fired_time: 1.9763764143, output_fired_time: 0.0000000000, propagate_forward_time: 145.2754669189, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3681793213
validation[          , genome  7537] predictions:    6635/  10000 (66.35%), best:    6635/10000 (66.35%), error:      9846.34961, best error:      9846.34961 on epoch:    74, epoch:   74/100, mu: 0.9768469930, learning_rate: 0.0000047572, weight_decay: 0.0000088889

epoch time: 1926.5305175781s, input_fired_time: 26.7127323151, output_fired_time: 13.3097457886, propagate_forward_time: 756.3371582031, propagate_backward_time: 1115.8707275391, weight_update_time: 0.5119069219, other_time: 14.3001708984
epoch time: 150.0713806152s, input_fired_time: 1.9708073139, output_fired_time: 0.0000000000, propagate_forward_time: 145.7314300537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3691406250
validation[          , genome  7537] predictions:    6704/  10000 (67.04%), best:    6704/10000 (67.04%), error:      9837.55273, best error:      9837.55273 on epoch:    75, epoch:   75/100, mu: 0.9774682522, learning_rate: 0.0000044199, weight_decay: 0.0000084035

epoch time: 1912.8590087891s, input_fired_time: 26.5806407928, output_fired_time: 13.1832551956, propagate_forward_time: 749.3576049805, propagate_backward_time: 1109.6158447266, weight_update_time: 0.5147573352, other_time: 14.1217041016
epoch time: 158.1180419922s, input_fired_time: 2.0604243279, output_fired_time: 0.0000000000, propagate_forward_time: 153.5719146729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4857025146
validation[          , genome  7537] predictions:    6675/  10000 (66.75%), best:    6675/10000 (66.75%), error:      9788.15332, best error:      9788.15332 on epoch:    76, epoch:   76/100, mu: 0.9780601263, learning_rate: 0.0000041066, weight_decay: 0.0000079447

epoch time: 2049.3808593750s, input_fired_time: 27.2167758942, output_fired_time: 13.4615230560, propagate_forward_time: 767.2329101563, propagate_backward_time: 1226.8728027344, weight_update_time: 0.5410248637, other_time: 14.5968017578
epoch time: 151.0774078369s, input_fired_time: 1.9737768173, output_fired_time: 0.0000000000, propagate_forward_time: 146.7156524658, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3879852295
validation[          , genome  7537] predictions:    6691/  10000 (66.91%), best:    6691/10000 (66.91%), error:      9752.79102, best error:      9752.79102 on epoch:    77, epoch:   77/100, mu: 0.9786240458, learning_rate: 0.0000038155, weight_decay: 0.0000075109

epoch time: 1928.4470214844s, input_fired_time: 26.6938686371, output_fired_time: 13.2079010010, propagate_forward_time: 755.9809570313, propagate_backward_time: 1118.4362792969, weight_update_time: 0.5348155499, other_time: 14.1280517578
epoch time: 154.6850280762s, input_fired_time: 2.0401496887, output_fired_time: 0.0000000000, propagate_forward_time: 150.1573791504, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4875030518
validation[          , genome  7537] predictions:    6707/  10000 (67.07%), best:    6691/10000 (66.91%), error:      9769.89551, best error:      9752.79102 on epoch:    77, epoch:   78/100, mu: 0.9791613221, learning_rate: 0.0000035450, weight_decay: 0.0000071007

epoch time: 1917.2397460938s, input_fired_time: 26.3905410767, output_fired_time: 12.9860115051, propagate_forward_time: 751.4134521484, propagate_backward_time: 1112.2784423828, weight_update_time: 0.5197983980, other_time: 14.1713867188
epoch time: 156.3646697998s, input_fired_time: 1.9825978279, output_fired_time: 0.0000000000, propagate_forward_time: 151.9065093994, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4755554199
validation[          , genome  7537] predictions:    6707/  10000 (67.07%), best:    6691/10000 (66.91%), error:      9755.01855, best error:      9752.79102 on epoch:    77, epoch:   79/100, mu: 0.9796732664, learning_rate: 0.0000032937, weight_decay: 0.0000067130

epoch time: 2010.0207519531s, input_fired_time: 26.7761688232, output_fired_time: 13.1670761108, propagate_forward_time: 794.2556152344, propagate_backward_time: 1161.6353759766, weight_update_time: 0.5141910911, other_time: 14.1865234375
epoch time: 159.7610168457s, input_fired_time: 2.1552784443, output_fired_time: 0.0000000000, propagate_forward_time: 155.0499725342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5557708740
validation[          , genome  7537] predictions:    6662/  10000 (66.62%), best:    6691/10000 (66.91%), error:      9798.64258, best error:      9752.79102 on epoch:    77, epoch:   80/100, mu: 0.9801610112, learning_rate: 0.0000030602, weight_decay: 0.0000063465

epoch time: 1943.2053222656s, input_fired_time: 26.8259296417, output_fired_time: 13.3334074020, propagate_forward_time: 760.9988403320, propagate_backward_time: 1127.5570068359, weight_update_time: 0.5582947135, other_time: 14.4901123047
epoch time: 154.4945831299s, input_fired_time: 2.1301074028, output_fired_time: 0.0000000000, propagate_forward_time: 149.8545227051, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5099487305
validation[          , genome  7537] predictions:    6694/  10000 (66.94%), best:    6694/10000 (66.94%), error:      9747.94336, best error:      9747.94336 on epoch:    81, epoch:   81/100, mu: 0.9806257486, learning_rate: 0.0000028432, weight_decay: 0.0000059999

epoch time: 1926.8256835938s, input_fired_time: 26.8600521088, output_fired_time: 13.0350227356, propagate_forward_time: 755.3057250977, propagate_backward_time: 1117.4482421875, weight_update_time: 0.5866433382, other_time: 14.1765136719
epoch time: 155.6936035156s, input_fired_time: 2.0789685249, output_fired_time: 0.0000000000, propagate_forward_time: 151.0528259277, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5618133545
validation[          , genome  7537] predictions:    6643/  10000 (66.43%), best:    6694/10000 (66.94%), error:      9866.01465, best error:      9747.94336 on epoch:    81, epoch:   82/100, mu: 0.9810684919, learning_rate: 0.0000026417, weight_decay: 0.0000056723

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537_0_r2044053396_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.517984
read mu: 0.98149
read mu_delta: 0.952769
read initial_learning_rate: 0.0010977
read learning_rate: 2.45438e-06
read learning_rate_delta: 0.929107
read initial_weight_decay: 0.000566751
read weight_decay: 5.3626e-06
read weight_decay_delta: 0.945397
read batch_size: 92
read epsilon: 1e-07
read alpha: 0.0817144
read input_dropout_probability: 0.00121663
read hidden_dropout_probability: 0.101387
read velocity_reset: 1928
read epoch: 83
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 81
read number_validation_images: 10000
read best_validation_predictions: 6694
read best_validation_error: 9747.94
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7537
read normal distribution: '1 -0.0377054288983345 -1.56978046894073'
generator_str: '1681559058'
read generator: 1681559058
read generated_by_map:
1 split_edge 1
reading 115 nodes.
reading 420 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2159.20654296875s, input_fired_time: 28.7084827423096, output_fired_time: 13.5967636108398, propagate_forward_time: 851.603576660156, propagate_backward_time: 1249.53625488281, weight_update_time: 0.530531466007233, other_time: 15.7615966796875
epoch time: 169.331405639648s, input_fired_time: 2.2223961353302, output_fired_time: 0, propagate_forward_time: 164.355224609375, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.7537841796875
validation[          , genome  7537] predictions:    6645/  10000 (66.45%), best:    6694/10000 (66.94%), error:      9836.11035, best error:      9747.94336 on epoch:    81, epoch:   83/100, mu: 0.9814903140, learning_rate: 0.0000024544, weight_decay: 0.0000053626

epoch time: 2021.3494873047s, input_fired_time: 27.9770202637, output_fired_time: 13.9241304398, propagate_forward_time: 789.8783569336, propagate_backward_time: 1174.1350097656, weight_update_time: 0.5754668713, other_time: 15.4350585938
epoch time: 167.0724945068s, input_fired_time: 2.3008620739, output_fired_time: 0.0000000000, propagate_forward_time: 161.9042663574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8673706055
validation[          , genome  7537] predictions:    6736/  10000 (67.36%), best:    6736/10000 (67.36%), error:      9693.14648, best error:      9693.14648 on epoch:    84, epoch:   84/100, mu: 0.9818922281, learning_rate: 0.0000022804, weight_decay: 0.0000050698

epoch time: 1985.2978515625s, input_fired_time: 27.3949756622, output_fired_time: 13.4998922348, propagate_forward_time: 776.8368530273, propagate_backward_time: 1152.4849853516, weight_update_time: 0.5564025640, other_time: 15.0811767578
epoch time: 151.5022583008s, input_fired_time: 2.0108401775, output_fired_time: 0.0000000000, propagate_forward_time: 147.0928802490, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3985443115
validation[          , genome  7537] predictions:    6713/  10000 (67.13%), best:    6736/10000 (67.36%), error:      9748.20313, best error:      9693.14648 on epoch:    84, epoch:   85/100, mu: 0.9822751880, learning_rate: 0.0000021187, weight_decay: 0.0000047930

epoch time: 1941.5612792969s, input_fired_time: 26.8907279968, output_fired_time: 13.2415056229, propagate_forward_time: 759.3093261719, propagate_backward_time: 1127.3374023438, weight_update_time: 0.5712431669, other_time: 14.7823486328
epoch time: 147.0612182617s, input_fired_time: 1.9406154156, output_fired_time: 0.0000000000, propagate_forward_time: 142.7471618652, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3734436035
validation[          , genome  7537] predictions:    6692/  10000 (66.92%), best:    6736/10000 (67.36%), error:      9762.59180, best error:      9693.14648 on epoch:    84, epoch:   86/100, mu: 0.9826400280, learning_rate: 0.0000019685, weight_decay: 0.0000045312

epoch time: 1971.5100097656s, input_fired_time: 26.9772529602, output_fired_time: 13.2198200226, propagate_forward_time: 758.8388671875, propagate_backward_time: 1158.1138916016, weight_update_time: 0.5179674625, other_time: 14.3601074219
epoch time: 160.0704650879s, input_fired_time: 2.0936672688, output_fired_time: 0.0000000000, propagate_forward_time: 155.4038848877, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5729064941
validation[          , genome  7537] predictions:    6678/  10000 (66.78%), best:    6736/10000 (67.36%), error:      9704.62793, best error:      9693.14648 on epoch:    84, epoch:   87/100, mu: 0.9829876423, learning_rate: 0.0000018290, weight_decay: 0.0000042838

epoch time: 1930.8812255859s, input_fired_time: 26.7650146484, output_fired_time: 13.2878170013, propagate_forward_time: 754.7205810547, propagate_backward_time: 1121.6783447266, weight_update_time: 0.5333024263, other_time: 14.4294433594
epoch time: 164.3280181885s, input_fired_time: 2.2787871361, output_fired_time: 0.0000000000, propagate_forward_time: 159.4076843262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6415405273
validation[          , genome  7537] predictions:    6737/  10000 (67.37%), best:    6737/10000 (67.37%), error:      9658.52246, best error:      9658.52246 on epoch:    88, epoch:   88/100, mu: 0.9833188653, learning_rate: 0.0000016993, weight_decay: 0.0000040499

epoch time: 1951.9019775391s, input_fired_time: 27.3517570496, output_fired_time: 13.4348373413, propagate_forward_time: 763.9525756836, propagate_backward_time: 1132.4992675781, weight_update_time: 0.5475877523, other_time: 14.6635742188
epoch time: 156.6734619141s, input_fired_time: 2.0694026947, output_fired_time: 0.0000000000, propagate_forward_time: 152.1238098145, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4802551270
validation[          , genome  7537] predictions:    6735/  10000 (67.35%), best:    6737/10000 (67.37%), error:      9691.20410, best error:      9658.52246 on epoch:    88, epoch:   89/100, mu: 0.9836344123, learning_rate: 0.0000015788, weight_decay: 0.0000038288

epoch time: 2025.8177490234s, input_fired_time: 26.6530399323, output_fired_time: 13.3201436996, propagate_forward_time: 756.5140380859, propagate_backward_time: 1214.6899414063, weight_update_time: 0.5269889235, other_time: 14.6405029297
epoch time: 153.0419311523s, input_fired_time: 2.0139753819, output_fired_time: 0.0000000000, propagate_forward_time: 148.5689239502, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4590301514
validation[          , genome  7537] predictions:    6699/  10000 (66.99%), best:    6737/10000 (67.37%), error:      9732.76855, best error:      9658.52246 on epoch:    88, epoch:   90/100, mu: 0.9839350581, learning_rate: 0.0000014669, weight_decay: 0.0000036197

epoch time: 1922.1507568359s, input_fired_time: 26.6598682404, output_fired_time: 13.1418008804, propagate_forward_time: 752.1295166016, propagate_backward_time: 1115.8255615234, weight_update_time: 0.5456795096, other_time: 14.3939208984
epoch time: 159.3823242188s, input_fired_time: 2.1623818874, output_fired_time: 0.0000000000, propagate_forward_time: 154.5758361816, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6441040039
validation[          , genome  7537] predictions:    6743/  10000 (67.43%), best:    6737/10000 (67.37%), error:      9680.84570, best error:      9658.52246 on epoch:    88, epoch:   91/100, mu: 0.9842215180, learning_rate: 0.0000013629, weight_decay: 0.0000034221

epoch time: 1972.1182861328s, input_fired_time: 27.2754135132, output_fired_time: 13.3267240524, propagate_forward_time: 770.1518554688, propagate_backward_time: 1146.3647460938, weight_update_time: 0.5578563809, other_time: 14.9995117188
epoch time: 164.1530456543s, input_fired_time: 2.2361114025, output_fired_time: 0.0000000000, propagate_forward_time: 159.2787170410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6382141113
validation[          , genome  7537] predictions:    6729/  10000 (67.29%), best:    6737/10000 (67.37%), error:      9699.48926, best error:      9658.52246 on epoch:    88, epoch:   92/100, mu: 0.9844944477, learning_rate: 0.0000012663, weight_decay: 0.0000032352

epoch time: 2003.2093505859s, input_fired_time: 27.0088939667, output_fired_time: 13.3566684723, propagate_forward_time: 804.3340454102, propagate_backward_time: 1143.7579345703, weight_update_time: 0.5346560478, other_time: 14.7518310547
epoch time: 207.9698944092s, input_fired_time: 2.0357050896, output_fired_time: 0.0000000000, propagate_forward_time: 203.3888092041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5453796387
validation[          , genome  7537] predictions:    6697/  10000 (66.97%), best:    6737/10000 (67.37%), error:      9695.50684, best error:      9658.52246 on epoch:    88, epoch:   93/100, mu: 0.9847545028, learning_rate: 0.0000011765, weight_decay: 0.0000030586

epoch time: 1947.4891357422s, input_fired_time: 26.9963932037, output_fired_time: 13.1476154327, propagate_forward_time: 768.8555908203, propagate_backward_time: 1123.8854980469, weight_update_time: 0.5941508412, other_time: 14.6041259766
epoch time: 155.3789672852s, input_fired_time: 2.1062045097, output_fired_time: 0.0000000000, propagate_forward_time: 150.8119354248, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4608306885
validation[          , genome  7537] predictions:    6743/  10000 (67.43%), best:    6737/10000 (67.37%), error:      9691.57617, best error:      9658.52246 on epoch:    88, epoch:   94/100, mu: 0.9850022793, learning_rate: 0.0000010931, weight_decay: 0.0000028916

epoch time: 1924.1960449219s, input_fired_time: 26.7409000397, output_fired_time: 13.1346521378, propagate_forward_time: 752.8254394531, propagate_backward_time: 1117.0653076172, weight_update_time: 0.5476826429, other_time: 14.4298095703
epoch time: 150.4953765869s, input_fired_time: 1.9776077271, output_fired_time: 0.0000000000, propagate_forward_time: 146.0463867188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4713745117
validation[          , genome  7537] predictions:    6715/  10000 (67.15%), best:    6737/10000 (67.37%), error:      9702.88574, best error:      9658.52246 on epoch:    88, epoch:   95/100, mu: 0.9852383137, learning_rate: 0.0000010156, weight_decay: 0.0000027337

epoch time: 1954.6469726563s, input_fired_time: 26.9263591766, output_fired_time: 13.3302326202, propagate_forward_time: 761.9305419922, propagate_backward_time: 1137.7746582031, weight_update_time: 0.5424501896, other_time: 14.6851806641
epoch time: 167.1047058105s, input_fired_time: 2.2155623436, output_fired_time: 0.0000000000, propagate_forward_time: 162.2808532715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6082916260
validation[          , genome  7537] predictions:    6738/  10000 (67.38%), best:    6738/10000 (67.38%), error:      9657.10254, best error:      9657.10254 on epoch:    96, epoch:   96/100, mu: 0.9854632020, learning_rate: 0.0000009436, weight_decay: 0.0000025844

epoch time: 2072.8432617188s, input_fired_time: 27.2561683655, output_fired_time: 13.8105106354, propagate_forward_time: 779.1582641602, propagate_backward_time: 1237.8632812500, weight_update_time: 0.5717245936, other_time: 14.7548828125
epoch time: 152.0121307373s, input_fired_time: 2.0190472603, output_fired_time: 0.0000000000, propagate_forward_time: 147.5247192383, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4683685303
validation[          , genome  7537] predictions:    6735/  10000 (67.35%), best:    6738/10000 (67.38%), error:      9665.34375, best error:      9657.10254 on epoch:    96, epoch:   97/100, mu: 0.9856774807, learning_rate: 0.0000008767, weight_decay: 0.0000024433

epoch time: 1944.1446533203s, input_fired_time: 26.8218288422, output_fired_time: 13.2692899704, propagate_forward_time: 760.4436035156, propagate_backward_time: 1129.0625000000, weight_update_time: 0.5692325234, other_time: 14.5474853516
epoch time: 146.5974731445s, input_fired_time: 1.9577429295, output_fired_time: 0.0000000000, propagate_forward_time: 142.2279052734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4118194580
validation[          , genome  7537] predictions:    6722/  10000 (67.22%), best:    6738/10000 (67.38%), error:      9706.19043, best error:      9657.10254 on epoch:    96, epoch:   98/100, mu: 0.9858816266, learning_rate: 0.0000008146, weight_decay: 0.0000023099

epoch time: 1942.3284912109s, input_fired_time: 27.1495418549, output_fired_time: 13.2347459793, propagate_forward_time: 756.4070434570, propagate_backward_time: 1130.7602539063, weight_update_time: 0.6059703827, other_time: 14.7768554688
epoch time: 169.1427459717s, input_fired_time: 2.2686991692, output_fired_time: 0.0000000000, propagate_forward_time: 164.0640869141, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8099670410
validation[          , genome  7537] predictions:    6768/  10000 (67.68%), best:    6738/10000 (67.38%), error:      9657.79102, best error:      9657.10254 on epoch:    96, epoch:   99/100, mu: 0.9860761166, learning_rate: 0.0000007568, weight_decay: 0.0000021838

epoch time: 2222.9470214844s, input_fired_time: 29.6836013794, output_fired_time: 14.4427633286, propagate_forward_time: 928.6415405273, propagate_backward_time: 1234.0842285156, weight_update_time: 0.5710114241, other_time: 16.0947265625
epoch time: 171.6237792969s, input_fired_time: 2.2048020363, output_fired_time: 0.0000000000, propagate_forward_time: 166.6492156982, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7697601318
validation[          , genome  7537] predictions:    6728/  10000 (67.28%), best:    6728/10000 (67.28%), error:      9645.48340, best error:      9645.48340 on epoch:   100, epoch:  100/100, mu: 0.9862614274, learning_rate: 0.0000007032, weight_decay: 0.0000020645

evaluating best weights on full training data.
evaluting training set with running mean/variance:
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537_0_r2044053396_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.517984
read mu: 0.986438
read mu_delta: 0.952769
read initial_learning_rate: 0.0010977
read learning_rate: 6.53318e-07
read learning_rate_delta: 0.929107
read initial_weight_decay: 0.000566751
read weight_decay: 1.95178e-06
read weight_decay_delta: 0.945397
read batch_size: 92
read epsilon: 1e-07
read alpha: 0.0817144
read input_dropout_probability: 0.00121663
read hidden_dropout_probability: 0.101387
read velocity_reset: 1928
read epoch: 101
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 100
read number_validation_images: 10000
read best_validation_predictions: 6728
read best_validation_error: 9645.48
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7537
read normal distribution: '1 -0.0377054288983345 -1.56978046894073'
generator_str: '1342082261'
read generator: 1342082261
read generated_by_map:
1 split_edge 1
reading 115 nodes.
reading 420 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537_0_r2044053396_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.517984
read mu: 0.986438
read mu_delta: 0.952769
read initial_learning_rate: 0.0010977
read learning_rate: 6.53318e-07
read learning_rate_delta: 0.929107
read initial_weight_decay: 0.000566751
read weight_decay: 1.95178e-06
read weight_decay_delta: 0.945397
read batch_size: 92
read epsilon: 1e-07
read alpha: 0.0817144
read input_dropout_probability: 0.00121663
read hidden_dropout_probability: 0.101387
read velocity_reset: 1928
read epoch: 101
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 100
read number_validation_images: 10000
read best_validation_predictions: 6728
read best_validation_error: 9645.48
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7537
read normal distribution: '1 -0.0377054288983345 -1.56978046894073'
generator_str: '1342082261'
read generator: 1342082261
read generated_by_map:
1 split_edge 1
reading 115 nodes.
reading 420 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537_0_r2044053396_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.517984
read mu: 0.986438
read mu_delta: 0.952769
read initial_learning_rate: 0.0010977
read learning_rate: 6.53318e-07
read learning_rate_delta: 0.929107
read initial_weight_decay: 0.000566751
read weight_decay: 1.95178e-06
read weight_decay_delta: 0.945397
read batch_size: 92
read epsilon: 1e-07
read alpha: 0.0817144
read input_dropout_probability: 0.00121663
read hidden_dropout_probability: 0.101387
read velocity_reset: 1928
read epoch: 101
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 100
read number_validation_images: 10000
read best_validation_predictions: 6728
read best_validation_error: 9645.48
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7537
read normal distribution: '1 -0.0377054288983345 -1.56978046894073'
generator_str: '1342082261'
read generator: 1342082261
read generated_by_map:
1 split_edge 1
reading 115 nodes.
reading 420 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537_0_r2044053396_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.517984
read mu: 0.986438
read mu_delta: 0.952769
read initial_learning_rate: 0.0010977
read learning_rate: 6.53318e-07
read learning_rate_delta: 0.929107
read initial_weight_decay: 0.000566751
read weight_decay: 1.95178e-06
read weight_decay_delta: 0.945397
read batch_size: 92
read epsilon: 1e-07
read alpha: 0.0817144
read input_dropout_probability: 0.00121663
read hidden_dropout_probability: 0.101387
read velocity_reset: 1928
read epoch: 101
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 100
read number_validation_images: 10000
read best_validation_predictions: 6728
read best_validation_error: 9645.48
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7537
read normal distribution: '1 -0.0377054288983345 -1.56978046894073'
generator_str: '1342082261'
read generator: 1342082261
read generated_by_map:
1 split_edge 1
reading 115 nodes.
reading 420 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1530269703_162_7537_0_r2044053396_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.517984
read mu: 0.986438
read mu_delta: 0.952769
read initial_learning_rate: 0.0010977
read learning_rate: 6.53318e-07
read learning_rate_delta: 0.929107
read initial_weight_decay: 0.000566751
read weight_decay: 1.95178e-06
read weight_decay_delta: 0.945397
read batch_size: 92
read epsilon: 1e-07
read alpha: 0.0817144
read input_dropout_probability: 0.00121663
read hidden_dropout_probability: 0.101387
read velocity_reset: 1928
read epoch: 101
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 100
read number_validation_images: 10000
read best_validation_predictions: 6728
read best_validation_error: 9645.48
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 7537
read normal distribution: '1 -0.0377054288983345 -1.56978046894073'
generator_str: '1342082261'
read generator: 1342082261
read generated_by_map:
1 split_edge 1
reading 115 nodes.
reading 420 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1971.95776367188s, input_fired_time: 26.9631195068359, output_fired_time: 13.2471742630005, propagate_forward_time: 765.112243652344, propagate_backward_time: 1151.15844726563, weight_update_time: 0.619255304336548, other_time: 15.476806640625
epoch time: 162.392501831055s, input_fired_time: 2.19361519813538, output_fired_time: 0, propagate_forward_time: 157.534957885742, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.66392517089844
validation[          , genome  7537] predictions:    6720/  10000 (67.20%), best:    6728/10000 (67.28%), error:      9679.16992, best error:      9645.48340 on epoch:   100, epoch:  101/100, mu: 0.9864379764, learning_rate: 0.0000006533, weight_decay: 0.0000019518

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 745.5500488281s, input_fired_time: 10.1257457733, output_fired_time: 0.0000000000, propagate_forward_time: 723.0984497070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.3258666992
best training[          , genome  7537] predictions:   36714/  50000 (73.43%), best:    6728/10000 (67.28%), error:     41240.41797, best error:      9645.48340 on epoch:   100, epoch:  102/100, mu: 0.9866062403, learning_rate: 0.0000006070, weight_decay: 0.0000018452
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 146.8184204102s, input_fired_time: 1.9803948402, output_fired_time: 0.0000000000, propagate_forward_time: 142.4349975586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4030303955
   testing[          , genome  7537] predictions:    6728/  10000 (67.28%), best:    6728/10000 (67.28%), error:      9645.48340, best error:      9645.48340 on epoch:   100, epoch:  102/100, mu: 0.9866062403, learning_rate: 0.0000006070, weight_decay: 0.0000018452
backpropagation finished successfully!
12:56:32 (2940): called boinc_finish(0)

</stderr_txt>
]]>