Nameexact_genome_1542031203_178_5599_1
Workunit4081708
Created12 Nov 2018, 19:24:07 UTC
Sent12 Nov 2018, 19:30:17 UTC
Report deadline17 Jan 2019, 14:30:44 UTC
Received22 Dec 2018, 8:50:10 UTC
Server stateOver
OutcomeComputation error
Client stateCompute error
Exit status194 (0xc2) EXIT_ABORTED_BY_CLIENT
Computer ID64195
Run time1 days 0 hours 29 min 52 sec
CPU time23 hours 41 min 29 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS3.83 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size565.19 MB
Peak swap size584.82 MB
Peak disk usage14.35 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
5, output_fired_time: 8.4764795303, propagate_forward_time: 709.0927734375, propagate_backward_time: 1102.1319580078, weight_update_time: 0.4221663177, other_time: 12.2631835938
epoch time: 174.4234771729s, input_fired_time: 1.5609742403, output_fired_time: 0.0000000000, propagate_forward_time: 170.6101074219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2523956299
validation[          , genome  5599] predictions:    5898/  10000 (58.98%), best:    5898/10000 (58.98%), error:     11817.37891, best error:     11817.37891 on epoch:     6, epoch:    6/50, mu: 0.6295016408, learning_rate: 0.0014851638, weight_decay: 0.0003960870

epoch time: 1900.6088867188s, input_fired_time: 20.1297454834, output_fired_time: 8.5618305206, propagate_forward_time: 729.9442749023, propagate_backward_time: 1129.6286621094, weight_update_time: 0.4297856092, other_time: 12.3442382813
epoch time: 146.5110168457s, input_fired_time: 1.3755367994, output_fired_time: 0.0000000000, propagate_forward_time: 143.0746002197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0608825684
validation[          , genome  5599] predictions:    5821/  10000 (58.21%), best:    5898/10000 (58.98%), error:     11817.57324, best error:     11817.37891 on epoch:     6, epoch:    7/50, mu: 0.6487119198, learning_rate: 0.0013591396, weight_decay: 0.0003662395

epoch time: 1924.5820312500s, input_fired_time: 20.2465705872, output_fired_time: 8.7144823074, propagate_forward_time: 734.4041748047, propagate_backward_time: 1148.7395019531, weight_update_time: 0.4352671802, other_time: 12.4772949219
epoch time: 133.9382324219s, input_fired_time: 1.2967560291, output_fired_time: 0.0000000000, propagate_forward_time: 130.6213531494, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0201263428
validation[          , genome  5599] predictions:    5809/  10000 (58.09%), best:    5898/10000 (58.98%), error:     12144.41797, best error:     11817.37891 on epoch:     6, epoch:    8/50, mu: 0.6668984890, learning_rate: 0.0012438092, weight_decay: 0.0003386411

epoch time: 1856.7740478516s, input_fired_time: 20.0235271454, output_fired_time: 8.3629875183, propagate_forward_time: 713.8005371094, propagate_backward_time: 1102.3524169922, weight_update_time: 0.4247255623, other_time: 12.2344970703
epoch time: 138.7318878174s, input_fired_time: 1.3185019493, output_fired_time: 0.0000000000, propagate_forward_time: 135.4154052734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9979858398
validation[          , genome  5599] predictions:    5961/  10000 (59.61%), best:    5898/10000 (58.98%), error:     11842.13477, best error:     11817.37891 on epoch:     6, epoch:    9/50, mu: 0.6841159463, learning_rate: 0.0011382652, weight_decay: 0.0003131225

epoch time: 1865.7410888672s, input_fired_time: 20.0876140594, output_fired_time: 8.5261354446, propagate_forward_time: 710.9211425781, propagate_backward_time: 1113.9215087891, weight_update_time: 0.4243801236, other_time: 12.2846679688
epoch time: 148.0404052734s, input_fired_time: 1.3957097530, output_fired_time: 0.0000000000, propagate_forward_time: 144.5525512695, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0921478271
validation[          , genome  5599] predictions:    6202/  10000 (62.02%), best:    6202/10000 (62.02%), error:     11175.45996, best error:     11175.45996 on epoch:    10, epoch:   10/50, mu: 0.7004159093, learning_rate: 0.0010416772, weight_decay: 0.0002895269

epoch time: 1887.7142333984s, input_fired_time: 20.1103725433, output_fired_time: 8.4687719345, propagate_forward_time: 718.0651245117, propagate_backward_time: 1128.7274169922, weight_update_time: 0.4316901565, other_time: 12.3426513672
epoch time: 155.5829925537s, input_fired_time: 1.4513807297, output_fired_time: 0.0000000000, propagate_forward_time: 151.9877166748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1438903809
validation[          , genome  5599] predictions:    6066/  10000 (60.66%), best:    6202/10000 (62.02%), error:     11304.06348, best error:     11175.45996 on epoch:    10, epoch:   11/50, mu: 0.7158472538, learning_rate: 0.0009532852, weight_decay: 0.0002677093

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_178_5599.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_178_5599_1_r1429471362_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.489279
read mu: 0.730456
read mu_delta: 0.946712
read initial_learning_rate: 0.00252834
read learning_rate: 0.000872394
read learning_rate_delta: 0.915145
read initial_weight_decay: 0.000633787
read weight_decay: 0.000247536
read weight_decay_delta: 0.924644
read batch_size: 111
read epsilon: 1e-07
read alpha: 0.072246
read input_dropout_probability: 0.00112267
read hidden_dropout_probability: 0.111303
read velocity_reset: 2288
read epoch: 12
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 10
read number_validation_images: 10000
read best_validation_predictions: 6202
read best_validation_error: 11175.5
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5599
read normal distribution: '1 0 0'
generator_str: '851912457'
read generator: 851912457
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 525 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2139.20922851563s, input_fired_time: 29.3465366363525, output_fired_time: 14.7197017669678, propagate_forward_time: 803.797180175781, propagate_backward_time: 1253.04345703125, weight_update_time: 1.09368252754211, other_time: 38.302490234375
epoch time: 173.377700805664s, input_fired_time: 2.56838846206665, output_fired_time: 0, propagate_forward_time: 164.218505859375, propagate_backward_time: 0, weight_update_time: 0, other_time: 6.59080505371094
validation[          , genome  5599] predictions:    6205/  10000 (62.05%), best:    6205/10000 (62.05%), error:     11123.09668, best error:     11123.09668 on epoch:    12, epoch:   12/50, mu: 0.7304562926, learning_rate: 0.0008723938, weight_decay: 0.0002475358

epoch time: 2172.0209960938s, input_fired_time: 29.1777286530, output_fired_time: 14.8421249390, propagate_forward_time: 813.5183105469, propagate_backward_time: 1277.4240722656, weight_update_time: 1.0513160229, other_time: 37.0588378906
epoch time: 168.4367370605s, input_fired_time: 2.6985824108, output_fired_time: 0.0000000000, propagate_forward_time: 158.7654418945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.9727172852
validation[          , genome  5599] predictions:    6118/  10000 (61.18%), best:    6205/10000 (62.05%), error:     11312.49902, best error:     11123.09668 on epoch:    12, epoch:   13/50, mu: 0.7442868948, learning_rate: 0.0007983664, weight_decay: 0.0002288825

epoch time: 2067.5437011719s, input_fired_time: 25.6899948120, output_fired_time: 11.9085283279, propagate_forward_time: 776.0865478516, propagate_backward_time: 1225.2330322266, weight_update_time: 0.8063652515, other_time: 28.6256103516
epoch time: 156.3154754639s, input_fired_time: 1.6497023106, output_fired_time: 0.0000000000, propagate_forward_time: 150.7819213867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8838500977
validation[          , genome  5599] predictions:    6056/  10000 (60.56%), best:    6205/10000 (62.05%), error:     11281.34863, best error:     11123.09668 on epoch:    12, epoch:   14/50, mu: 0.7573804855, learning_rate: 0.0007306207, weight_decay: 0.0002116349

epoch time: 1960.2335205078s, input_fired_time: 22.8063011169, output_fired_time: 9.9842061996, propagate_forward_time: 736.0207519531, propagate_backward_time: 1170.4997558594, weight_update_time: 0.6037316918, other_time: 20.9224853516
epoch time: 149.2829284668s, input_fired_time: 1.5795811415, output_fired_time: 0.0000000000, propagate_forward_time: 144.3161315918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3872222900
validation[          , genome  5599] predictions:    6025/  10000 (60.25%), best:    6205/10000 (62.05%), error:     11439.99414, best error:     11123.09668 on epoch:    12, epoch:   15/50, mu: 0.7697763443, learning_rate: 0.0006686235, weight_decay: 0.0001956869

epoch time: 1828.5612792969s, input_fired_time: 21.4112682343, output_fired_time: 9.0197401047, propagate_forward_time: 687.4440917969, propagate_backward_time: 1093.9320068359, weight_update_time: 0.5000982285, other_time: 16.7541503906
epoch time: 125.9058456421s, input_fired_time: 1.2662003040, output_fired_time: 0.0000000000, propagate_forward_time: 122.7030334473, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9366149902
validation[          , genome  5599] predictions:    6229/  10000 (62.29%), best:    6229/10000 (62.29%), error:     10859.47461, best error:     10859.47461 on epoch:    16, epoch:   16/50, mu: 0.7815116048, learning_rate: 0.0006118872, weight_decay: 0.0001809408

epoch time: 1365.9829101563s, input_fired_time: 18.5724601746, output_fired_time: 6.5915660858, propagate_forward_time: 507.1120300293, propagate_backward_time: 822.9281005859, weight_update_time: 0.3409129381, other_time: 10.7786865234
epoch time: 103.3977203369s, input_fired_time: 1.1307126284, output_fired_time: 0.0000000000, propagate_forward_time: 100.4685897827, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7984161377
validation[          , genome  5599] predictions:    6199/  10000 (61.99%), best:    6229/10000 (62.29%), error:     10977.63770, best error:     10859.47461 on epoch:    16, epoch:   17/50, mu: 0.7926215529, learning_rate: 0.0005599653, weight_decay: 0.0001673058

epoch time: 1360.1353759766s, input_fired_time: 18.5828742981, output_fired_time: 6.6039977074, propagate_forward_time: 503.5043334961, propagate_backward_time: 820.6302490234, weight_update_time: 0.3430287540, other_time: 10.8139038086
epoch time: 97.3925323486s, input_fired_time: 1.0847043991, output_fired_time: 0.0000000000, propagate_forward_time: 94.5488967896, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7589340210
validation[          , genome  5599] predictions:    6213/  10000 (62.13%), best:    6213/10000 (62.13%), error:     10848.72461, best error:     10848.72461 on epoch:    18, epoch:   18/50, mu: 0.8031394482, learning_rate: 0.0005124492, weight_decay: 0.0001546983

epoch time: 1297.6437988281s, input_fired_time: 18.3733425140, output_fired_time: 6.3659653664, propagate_forward_time: 477.0223999023, propagate_backward_time: 785.3216552734, weight_update_time: 0.3282911479, other_time: 10.5604858398
epoch time: 104.9327163696s, input_fired_time: 1.1382107735, output_fired_time: 0.0000000000, propagate_forward_time: 101.9945983887, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7999038696
validation[          , genome  5599] predictions:    6374/  10000 (63.74%), best:    6374/10000 (63.74%), error:     10573.06055, best error:     10573.06055 on epoch:    19, epoch:   19/50, mu: 0.8130968809, learning_rate: 0.0004689651, weight_decay: 0.0001430409

epoch time: 1294.3245849609s, input_fired_time: 18.3625411987, output_fired_time: 6.3302979469, propagate_forward_time: 476.4049987793, propagate_backward_time: 782.6851806641, weight_update_time: 0.3294515014, other_time: 10.5415039063
epoch time: 94.1356277466s, input_fired_time: 1.0682289600, output_fired_time: 0.0000000000, propagate_forward_time: 91.3388671875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7285308838
validation[          , genome  5599] predictions:    6303/  10000 (63.03%), best:    6374/10000 (63.74%), error:     10755.81055, best error:     10573.06055 on epoch:    19, epoch:   20/50, mu: 0.8225237131, learning_rate: 0.0004291708, weight_decay: 0.0001322619

epoch time: 1374.7655029297s, input_fired_time: 18.6580181122, output_fired_time: 6.6614737511, propagate_forward_time: 509.1666564941, propagate_backward_time: 829.4538574219, weight_update_time: 0.3449034989, other_time: 10.8255615234
epoch time: 105.8707885742s, input_fired_time: 1.1415798664, output_fired_time: 0.0000000000, propagate_forward_time: 102.9351501465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7940597534
validation[          , genome  5599] predictions:    6332/  10000 (63.32%), best:    6374/10000 (63.74%), error:     10710.78809, best error:     10573.06055 on epoch:    19, epoch:   21/50, mu: 0.8314481974, learning_rate: 0.0003927534, weight_decay: 0.0001222952

epoch time: 1268.5917968750s, input_fired_time: 18.2966346741, output_fired_time: 6.2499508858, propagate_forward_time: 465.3059692383, propagate_backward_time: 768.2393188477, weight_update_time: 0.3234114051, other_time: 10.4998779297
epoch time: 94.0746459961s, input_fired_time: 1.0646784306, output_fired_time: 0.0000000000, propagate_forward_time: 91.2892913818, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7206726074
validation[          , genome  5599] predictions:    6168/  10000 (61.68%), best:    6374/10000 (63.74%), error:     11076.42773, best error:     10573.06055 on epoch:    19, epoch:   22/50, mu: 0.8398970962, learning_rate: 0.0003594261, weight_decay: 0.0001130795

epoch time: 1283.3259277344s, input_fired_time: 18.3532257080, output_fired_time: 6.3008375168, propagate_forward_time: 472.4414367676, propagate_backward_time: 775.7391967773, weight_update_time: 0.3271629512, other_time: 10.4912719727
epoch time: 116.7591705322s, input_fired_time: 1.2181288004, output_fired_time: 0.0000000000, propagate_forward_time: 113.6830596924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8579788208
validation[          , genome  5599] predictions:    6095/  10000 (60.95%), best:    6374/10000 (63.74%), error:     11175.52441, best error:     10573.06055 on epoch:    19, epoch:   23/50, mu: 0.8478958011, learning_rate: 0.0003289268, weight_decay: 0.0001045583

epoch time: 1430.0163574219s, input_fired_time: 18.8459472656, output_fired_time: 6.8488297462, propagate_forward_time: 532.4490966797, propagate_backward_time: 860.9121704102, weight_update_time: 0.3544282019, other_time: 10.9602661133
epoch time: 126.8563461304s, input_fired_time: 1.3193190098, output_fired_time: 0.0000000000, propagate_forward_time: 123.5391540527, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9978713989
validation[          , genome  5599] predictions:    6355/  10000 (63.55%), best:    6355/10000 (63.55%), error:     10570.54590, best error:     10570.54590 on epoch:    24, epoch:   24/50, mu: 0.8554682732, learning_rate: 0.0003010156, weight_decay: 0.0000966792

epoch time: 1449.3370361328s, input_fired_time: 18.9293403625, output_fired_time: 6.9255018234, propagate_forward_time: 540.3114624023, propagate_backward_time: 872.1231689453, weight_update_time: 0.3551689088, other_time: 11.0475463867
epoch time: 95.0502319336s, input_fired_time: 1.0796896219, output_fired_time: 0.0000000000, propagate_forward_time: 92.2422943115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7282485962
validation[          , genome  5599] predictions:    6272/  10000 (62.72%), best:    6355/10000 (63.55%), error:     10716.03027, best error:     10570.54590 on epoch:    24, epoch:   25/50, mu: 0.8626372218, learning_rate: 0.0002754728, weight_decay: 0.0000893938

epoch time: 1379.0477294922s, input_fired_time: 18.7065143585, output_fired_time: 6.6592006683, propagate_forward_time: 510.0570678711, propagate_backward_time: 832.8110961914, weight_update_time: 0.3427475691, other_time: 10.8138427734
epoch time: 136.3150329590s, input_fired_time: 1.3773970604, output_fired_time: 0.0000000000, propagate_forward_time: 132.8735504150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0640869141
validation[          , genome  5599] predictions:    6387/  10000 (63.87%), best:    6387/10000 (63.87%), error:     10454.03027, best error:     10454.03027 on epoch:    26, epoch:   26/50, mu: 0.8694241643, learning_rate: 0.0002520974, weight_decay: 0.0000826575

epoch time: 1475.1087646484s, input_fired_time: 19.0059986115, output_fired_time: 6.9756450653, propagate_forward_time: 551.0478515625, propagate_backward_time: 887.0304565430, weight_update_time: 0.3586550355, other_time: 11.0488891602
epoch time: 120.9028701782s, input_fired_time: 1.2658994198, output_fired_time: 0.0000000000, propagate_forward_time: 117.6982421875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9387283325
validation[          , genome  5599] predictions:    6431/  10000 (64.31%), best:    6431/10000 (64.31%), error:     10331.40039, best error:     10331.40039 on epoch:    27, epoch:   27/50, mu: 0.8758494258, learning_rate: 0.0002307056, weight_decay: 0.0000764287

epoch time: 1458.0114746094s, input_fired_time: 18.9622421265, output_fired_time: 6.9378180504, propagate_forward_time: 544.3296508789, propagate_backward_time: 876.7644042969, weight_update_time: 0.3558435738, other_time: 11.0172729492
epoch time: 146.2551727295s, input_fired_time: 1.4232776165, output_fired_time: 0.0000000000, propagate_forward_time: 142.7799987793, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0518951416
validation[          , genome  5599] predictions:    6289/  10000 (62.89%), best:    6431/10000 (64.31%), error:     10646.40332, best error:     10331.40039 on epoch:    27, epoch:   28/50, mu: 0.8819322586, learning_rate: 0.0002111290, weight_decay: 0.0000706694

epoch time: 1566.0454101563s, input_fired_time: 19.2825717926, output_fired_time: 7.3202824593, propagate_forward_time: 589.6505737305, propagate_backward_time: 938.5305786133, weight_update_time: 0.3737686276, other_time: 11.2613525391
epoch time: 114.4099044800s, input_fired_time: 1.2050423622, output_fired_time: 0.0000000000, propagate_forward_time: 111.3609542847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8439102173
validation[          , genome  5599] predictions:    6294/  10000 (62.94%), best:    6431/10000 (64.31%), error:     10682.41699, best error:     10331.40039 on epoch:    27, epoch:   29/50, mu: 0.8876909614, learning_rate: 0.0001932135, weight_decay: 0.0000653440

epoch time: 1582.3037109375s, input_fired_time: 19.3324184418, output_fired_time: 7.3596429825, propagate_forward_time: 594.8187255859, propagate_backward_time: 949.4517822266, weight_update_time: 0.3774678707, other_time: 11.3411865234
epoch time: 126.9793243408s, input_fired_time: 1.2938470840, output_fired_time: 0.0000000000, propagate_forward_time: 123.7802276611, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9052505493
validation[          , genome  5599] predictions:    6448/  10000 (64.48%), best:    6448/10000 (64.48%), error:     10287.06641, best error:     10287.06641 on epoch:    30, epoch:   30/50, mu: 0.8931428194, learning_rate: 0.0001768183, weight_decay: 0.0000604200

epoch time: 1458.9426269531s, input_fired_time: 18.9513263702, output_fired_time: 6.9227547646, propagate_forward_time: 544.1359252930, propagate_backward_time: 877.9780883789, weight_update_time: 0.3537633717, other_time: 10.9545898438
epoch time: 131.8292999268s, input_fired_time: 1.3221786022, output_fired_time: 0.0000000000, propagate_forward_time: 128.5623931885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9447326660
validation[          , genome  5599] predictions:    6453/  10000 (64.53%), best:    6448/10000 (64.48%), error:     10288.83105, best error:     10287.06641 on epoch:    30, epoch:   31/50, mu: 0.8983041644, learning_rate: 0.0001618143, weight_decay: 0.0000558670

epoch time: 1780.0192871094s, input_fired_time: 19.9792499542, output_fired_time: 8.0618820190, propagate_forward_time: 676.9073486328, propagate_backward_time: 1063.1171875000, weight_update_time: 0.4105847180, other_time: 11.9536132813
epoch time: 152.6300964355s, input_fired_time: 1.4710953236, output_fired_time: 0.0000000000, propagate_forward_time: 149.0532379150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1057586670
validation[          , genome  5599] predictions:    6357/  10000 (63.57%), best:    6448/10000 (64.48%), error:     10505.44336, best error:     10287.06641 on epoch:    30, epoch:   32/50, mu: 0.9031904340, learning_rate: 0.0001480835, weight_decay: 0.0000516571

epoch time: 1872.8204345703s, input_fired_time: 20.2903862000, output_fired_time: 8.3956098557, propagate_forward_time: 718.1965942383, propagate_backward_time: 1113.8220214844, weight_update_time: 0.4239246249, other_time: 12.1157226563
epoch time: 125.6769256592s, input_fired_time: 1.2989281416, output_fired_time: 0.0000000000, propagate_forward_time: 122.4718704224, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9061279297
validation[          , genome  5599] predictions:    6561/  10000 (65.61%), best:    6561/10000 (65.61%), error:     10142.35059, best error:     10142.35059 on epoch:    33, epoch:   33/50, mu: 0.9078163505, learning_rate: 0.0001355178, weight_decay: 0.0000477644

epoch time: 1737.1579589844s, input_fired_time: 19.8758678436, output_fired_time: 7.9522495270, propagate_forward_time: 659.0916748047, propagate_backward_time: 1038.4262695313, weight_update_time: 0.4018282592, other_time: 11.8118896484
epoch time: 103.5709075928s, input_fired_time: 1.1582341194, output_fired_time: 0.0000000000, propagate_forward_time: 100.6269149780, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7857589722
validation[          , genome  5599] predictions:    6528/  10000 (65.28%), best:    6528/10000 (65.28%), error:     10079.82227, best error:     10079.82227 on epoch:    34, epoch:   34/50, mu: 0.9121957421, learning_rate: 0.0001240184, weight_decay: 0.0000441651

epoch time: 1740.4249267578s, input_fired_time: 19.8752975464, output_fired_time: 7.9313406944, propagate_forward_time: 659.7179565430, propagate_backward_time: 1041.1413574219, weight_update_time: 0.4010010958, other_time: 11.7590332031
epoch time: 136.2898864746s, input_fired_time: 1.3796496391, output_fired_time: 0.0000000000, propagate_forward_time: 132.9271392822, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9830932617
validation[          , genome  5599] predictions:    6447/  10000 (64.47%), best:    6528/10000 (65.28%), error:     10260.48242, best error:     10079.82227 on epoch:    34, epoch:   35/50, mu: 0.9163417816, learning_rate: 0.0001134947, weight_decay: 0.0000408370

epoch time: 1644.7894287109s, input_fired_time: 19.5893478394, output_fired_time: 7.5636010170, propagate_forward_time: 624.2636718750, propagate_backward_time: 981.9014892578, weight_update_time: 0.3856176436, other_time: 11.4713134766
epoch time: 149.3515777588s, input_fired_time: 1.4557929039, output_fired_time: 0.0000000000, propagate_forward_time: 145.8277130127, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0680694580
validation[          , genome  5599] predictions:    6493/  10000 (64.93%), best:    6528/10000 (65.28%), error:     10229.02148, best error:     10079.82227 on epoch:    34, epoch:   36/50, mu: 0.9202668667, learning_rate: 0.0001038641, weight_decay: 0.0000377597

epoch time: 1926.7944335938s, input_fired_time: 20.4521274567, output_fired_time: 8.5825796127, propagate_forward_time: 733.2668457031, propagate_backward_time: 1152.1157226563, weight_update_time: 0.4370316565, other_time: 12.3771972656
epoch time: 158.2216186523s, input_fired_time: 1.5099534988, output_fired_time: 0.0000000000, propagate_forward_time: 154.5865478516, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1251220703
validation[          , genome  5599] predictions:    6544/  10000 (65.44%), best:    6544/10000 (65.44%), error:     10075.22754, best error:     10075.22754 on epoch:    37, epoch:   37/50, mu: 0.9239827991, learning_rate: 0.0000950507, weight_decay: 0.0000349142

epoch time: 1938.1906738281s, input_fired_time: 20.5902462006, output_fired_time: 8.6473455429, propagate_forward_time: 743.8771972656, propagate_backward_time: 1152.6611328125, weight_update_time: 0.4346009195, other_time: 12.4147949219
epoch time: 148.3062133789s, input_fired_time: 1.4618029594, output_fired_time: 0.0000000000, propagate_forward_time: 144.7515411377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0928649902
validation[          , genome  5599] predictions:    6535/  10000 (65.35%), best:    6544/10000 (65.44%), error:     10125.36426, best error:     10075.22754 on epoch:    37, epoch:   38/50, mu: 0.9275007248, learning_rate: 0.0000869851, weight_decay: 0.0000322832

epoch time: 1928.9617919922s, input_fired_time: 20.5084495544, output_fired_time: 8.5684928894, propagate_forward_time: 735.6599731445, propagate_backward_time: 1151.8654785156, weight_update_time: 0.4352637529, other_time: 12.3593750000
epoch time: 147.2271270752s, input_fired_time: 1.4500802755, output_fired_time: 0.0000000000, propagate_forward_time: 143.7120819092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0649719238
validation[          , genome  5599] predictions:    6528/  10000 (65.28%), best:    6544/10000 (65.44%), error:     10219.85840, best error:     10075.22754 on epoch:    37, epoch:   39/50, mu: 0.9308311939, learning_rate: 0.0000796039, weight_decay: 0.0000298505

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_178_5599.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_178_5599_1_r1429471362_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.489279
read mu: 0.933984
read mu_delta: 0.946712
read initial_learning_rate: 0.00252834
read learning_rate: 7.28491e-05
read learning_rate_delta: 0.915145
read initial_weight_decay: 0.000633787
read weight_decay: 2.76011e-05
read weight_decay_delta: 0.924644
read batch_size: 111
read epsilon: 1e-07
read alpha: 0.072246
read input_dropout_probability: 0.00112267
read hidden_dropout_probability: 0.111303
read velocity_reset: 2288
read epoch: 40
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 37
read number_validation_images: 10000
read best_validation_predictions: 6544
read best_validation_error: 10075.2
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5599
read normal distribution: '1 0 0'
generator_str: '1523811758'
read generator: 1523811758
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 525 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1683.82775878906s, input_fired_time: 19.7777194976807, output_fired_time: 7.97727680206299, propagate_forward_time: 641.173034667969, propagate_backward_time: 1002.69055175781, weight_update_time: 0.4056376516819, other_time: 12.2091674804688
epoch time: 132.450225830078s, input_fired_time: 1.39314925670624, output_fired_time: 0, propagate_forward_time: 128.954177856445, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.1029052734375
validation[          , genome  5599] predictions:    6492/  10000 (64.92%), best:    6544/10000 (65.44%), error:     10176.97266, best error:     10075.22754 on epoch:    37, epoch:   40/50, mu: 0.9339841604, learning_rate: 0.0000728491, weight_decay: 0.0000276011

epoch time: 1566.6030273438s, input_fired_time: 19.3092498779, output_fired_time: 7.4604887962, propagate_forward_time: 591.3159790039, propagate_backward_time: 936.6912231445, weight_update_time: 0.3856205940, other_time: 11.8261718750
epoch time: 114.2536392212s, input_fired_time: 1.2466633320, output_fired_time: 0.0000000000, propagate_forward_time: 111.0742416382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9327316284
validation[          , genome  5599] predictions:    6488/  10000 (64.88%), best:    6544/10000 (65.44%), error:     10127.94336, best error:     10075.22754 on epoch:    37, epoch:   41/50, mu: 0.9369691610, learning_rate: 0.0000666675, weight_decay: 0.0000255212

epoch time: 1606.8551025391s, input_fired_time: 19.4515132904, output_fired_time: 7.6538691521, propagate_forward_time: 609.3278808594, propagate_backward_time: 958.5273437500, weight_update_time: 0.3909717798, other_time: 11.8945312500
epoch time: 116.1474227905s, input_fired_time: 1.2638458014, output_fired_time: 0.0000000000, propagate_forward_time: 112.9348602295, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9487152100
validation[          , genome  5599] predictions:    6618/  10000 (66.18%), best:    6618/10000 (66.18%), error:      9954.00684, best error:      9954.00684 on epoch:    42, epoch:   42/50, mu: 0.9397950768, learning_rate: 0.0000610104, weight_decay: 0.0000235980

epoch time: 1567.8160400391s, input_fired_time: 19.5281887054, output_fired_time: 7.5407867432, propagate_forward_time: 589.7328491211, propagate_backward_time: 939.1636352539, weight_update_time: 0.4406483769, other_time: 11.8505859375
epoch time: 298.6188659668s, input_fired_time: 2.6821880341, output_fired_time: 0.0000000000, propagate_forward_time: 292.1725158691, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.7641601563
validation[          , genome  5599] predictions:    6572/  10000 (65.72%), best:    6618/10000 (66.18%), error:      9968.55078, best error:      9954.00684 on epoch:    42, epoch:   43/50, mu: 0.9424703717, learning_rate: 0.0000558333, weight_decay: 0.0000218198

epoch time: 3835.9013671875s, input_fired_time: 36.8176765442, output_fired_time: 16.3834381104, propagate_forward_time: 1486.3133544922, propagate_backward_time: 2273.2050781250, weight_update_time: 0.8743762374, other_time: 23.1816406250
epoch time: 324.3009948730s, input_fired_time: 2.7898590565, output_fired_time: 0.0000000000, propagate_forward_time: 317.4033203125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1078186035
validation[          , genome  5599] predictions:    6589/  10000 (65.89%), best:    6589/10000 (65.89%), error:      9867.22070, best error:      9867.22070 on epoch:    44, epoch:   44/50, mu: 0.9450031519, learning_rate: 0.0000510955, weight_decay: 0.0000201755

epoch time: 3157.1633300781s, input_fired_time: 31.2676124573, output_fired_time: 13.3843116760, propagate_forward_time: 1221.3262939453, propagate_backward_time: 1872.1018066406, weight_update_time: 0.8136014938, other_time: 19.0833740234
epoch time: 93.9111557007s, input_fired_time: 1.1102067232, output_fired_time: 0.0000000000, propagate_forward_time: 91.0443649292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7565841675
validation[          , genome  5599] predictions:    6599/  10000 (65.99%), best:    6589/10000 (65.89%), error:      9890.73828, best error:      9867.22070 on epoch:    44, epoch:   45/50, mu: 0.9474009275, learning_rate: 0.0000467598, weight_decay: 0.0000186552

epoch time: 1417.6228027344s, input_fired_time: 18.3665065765, output_fired_time: 6.8511719704, propagate_forward_time: 531.4814453125, propagate_backward_time: 849.8725585938, weight_update_time: 0.3538740575, other_time: 11.0511474609
epoch time: 78.3704452515s, input_fired_time: 0.9281594157, output_fired_time: 0.0000000000, propagate_forward_time: 75.9645690918, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4777145386
validation[          , genome  5599] predictions:    6620/  10000 (66.20%), best:    6589/10000 (65.89%), error:      9890.32910, best error:      9867.22070 on epoch:    44, epoch:   46/50, mu: 0.9496709704, learning_rate: 0.0000427920, weight_decay: 0.0000172494

epoch time: 1030.1687011719s, input_fired_time: 15.3225460052, output_fired_time: 5.1036543846, propagate_forward_time: 376.5576477051, propagate_backward_time: 624.2136840820, weight_update_time: 0.2706963718, other_time: 8.9711303711
epoch time: 78.2850646973s, input_fired_time: 0.9284641743, output_fired_time: 0.0000000000, propagate_forward_time: 75.8903045654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4662933350
validation[          , genome  5599] predictions:    6615/  10000 (66.15%), best:    6615/10000 (66.15%), error:      9809.95898, best error:      9809.95898 on epoch:    47, epoch:   47/50, mu: 0.9518200159, learning_rate: 0.0000391609, weight_decay: 0.0000159495

epoch time: 1030.1239013672s, input_fired_time: 15.3386430740, output_fired_time: 5.1002058983, propagate_forward_time: 376.5456542969, propagate_backward_time: 624.1633911133, weight_update_time: 0.2691547275, other_time: 8.9760131836
epoch time: 78.3216094971s, input_fired_time: 0.9313094616, output_fired_time: 0.0000000000, propagate_forward_time: 75.9141082764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4761886597
validation[          , genome  5599] predictions:    6590/  10000 (65.90%), best:    6615/10000 (66.15%), error:      9906.97363, best error:      9809.95898 on epoch:    47, epoch:   48/50, mu: 0.9538545609, learning_rate: 0.0000358378, weight_decay: 0.0000147477

epoch time: 1029.1511230469s, input_fired_time: 15.3237457275, output_fired_time: 5.0960993767, propagate_forward_time: 376.1893615723, propagate_backward_time: 623.5930175781, weight_update_time: 0.2700718939, other_time: 8.9489746094
epoch time: 78.2747268677s, input_fired_time: 0.9305681586, output_fired_time: 0.0000000000, propagate_forward_time: 75.8617553711, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4824066162
validation[          , genome  5599] predictions:    6616/  10000 (66.16%), best:    6616/10000 (66.16%), error:      9805.96191, best error:      9805.96191 on epoch:    49, epoch:   49/50, mu: 0.9557806849, learning_rate: 0.0000327968, weight_decay: 0.0000136363

epoch time: 1029.4434814453s, input_fired_time: 15.3328037262, output_fired_time: 5.0976924896, propagate_forward_time: 376.3164062500, propagate_backward_time: 623.7229003906, weight_update_time: 0.2697144449, other_time: 8.9736328125
epoch time: 78.3009796143s, input_fired_time: 0.9290548563, output_fired_time: 0.0000000000, propagate_forward_time: 75.9060287476, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4658966064
validation[          , genome  5599] predictions:    6553/  10000 (65.53%), best:    6616/10000 (66.16%), error:      9901.85254, best error:      9805.96191 on epoch:    49, epoch:   50/50, mu: 0.9576041698, learning_rate: 0.0000300138, weight_decay: 0.0000126088

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 388.3276062012s, input_fired_time: 4.6344485283, output_fired_time: 0.0000000000, propagate_forward_time: 376.2658081055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 7.4273376465
best training[          , genome  5599] predictions:   37657/  50000 (75.31%), best:    6616/10000 (66.16%), error:     37906.83594, best error:      9805.96191 on epoch:    49, epoch:   51/50, mu: 0.9593304992, learning_rate: 0.0000274670, weight_decay: 0.0000116586
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 78.2338027954s, input_fired_time: 0.9279907942, output_fired_time: 0.0000000000, propagate_forward_time: 75.8312149048, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.4745941162
   testing[          , genome  5599] predictions:    6616/  10000 (66.16%), best:    6616/10000 (66.16%), error:      9805.96191, best error:      9805.96191 on epoch:    49, epoch:   51/50, mu: 0.9593304992, learning_rate: 0.0000274670, weight_decay: 0.0000116586
backpropagation finished successfully!
17:42:59 (31172): called boinc_finish(0)
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_178_5599.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542031203_178_5599_1_r1429471362_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.489279
read mu: 0.95933
read mu_delta: 0.946712
read initial_learning_rate: 0.00252834
read learning_rate: 2.7467e-05
read learning_rate_delta: 0.915145
read initial_weight_decay: 0.000633787
read weight_decay: 1.16586e-05
read weight_decay_delta: 0.924644
read batch_size: 111
read epsilon: 1e-07
read alpha: 0.072246
read input_dropout_probability: 0.00112267
read hidden_dropout_probability: 0.111303
read velocity_reset: 2288
read epoch: 51
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 49
read number_validation_images: 10000
read best_validation_predictions: 6616
read best_validation_error: 9805.96
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 5599
read normal distribution: '1 0 0'
generator_str: '1817127921'
read generator: 1817127921
read generated_by_map:
1 crossover 1
reading 102 nodes.
reading 525 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF880C0C5D2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 12/22/18 09:11:25
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\39;C:\ProgramData\BOINC\projects\csgrid.org_csg


ModLoad: 0000000006350000 00000000001da000 C:\ProgramData\BOINC\projects\csgrid.org_csg\exact_client_0.34_windows_x86_64.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : C:\Users\travi\Code\boinc_2015\win_build\Build\x64\Release\exact.pdb

ModLoad: 00000000841b0000 00000000001e1000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000081c20000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.376

ModLoad: 0000000080b60000 0000000000273000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.441) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000083cb0000 0000000000190000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 00000000815f0000 0000000000020000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000083c70000 0000000000028000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.17134.285 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.285

ModLoad: 0000000080770000 0000000000192000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.17134.471 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.471

ModLoad: 00000000805d0000 000000000009f000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.137) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.137 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.137

ModLoad: 0000000080670000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.319 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.319

ModLoad: 0000000081ce0000 00000000000a1000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000083700000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17134.1

ModLoad: 0000000081610000 000000000005b000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000083b30000 0000000000124000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 00000000822c0000 0000000001440000 C:\WINDOWS\System32\SHELL32.dll (6.2.17134.441) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000080e90000 0000000000049000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000083fb0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 00000000837a0000 0000000000322000 C:\WINDOWS\System32\combase.dll (6.2.17134.407) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000080550000 000000000007a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000080ee0000 000000000070d000 C:\WINDOWS\System32\windows.storage.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 00000000816a0000 0000000000051000 C:\WINDOWS\System32\shlwapi.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 00000000804e0000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.17134.112 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.112

ModLoad: 0000000080510000 000000000001f000 C:\WINDOWS\System32\profapi.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000080490000 000000000004c000 C:\WINDOWS\System32\powrprof.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000080500000 000000000000a000 C:\WINDOWS\System32\FLTLIB.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : fltLib.pdb
    File Version          : 10.0.17134.466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.466

ModLoad: 0000000081670000 000000000002d000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000079530000 00000000001c9000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000007aa80000 000000000000a000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 56179, Write: 4912, Other 1018

- I/O Transfers Counters -
Read: 230051155, Write: 5081, Other 41134

- Paged Pool Usage -
QuotaPagedPoolUsage: 157808, QuotaPeakPagedPoolUsage: 157968
QuotaNonPagedPoolUsage: 13320, QuotaPeakNonPagedPoolUsage: 13320

- Virtual Memory Usage -
VirtualSize: 613986304, PeakVirtualSize: 740724736

- Pagefile Usage -
PagefileUsage: 613986304, PeakPagefileUsage: 613986304

- Working Set Size -
WorkingSetSize: 593301504, PeakWorkingSetSize: 593301504, PageFaultCount: 183220

*** Dump of thread ID 10892 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF880C0C5D2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000064a9440 rdx=00000000e54ff1b0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000e54ff1b0 r9=00000000064a9430 r10=0000000000000001 r11=0000000000000fff r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000080c0c5d2 rsp=00000000e54ff188 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
e54ff180 063de421 00000001 e54ff1b0 e54ff1b0 064a9430 KERNELBASE!DebugBreak+0x0 
e54ff5c0 063df820 00000000 00000000 00000000 00000000 exact_client_0.34_windows_x86_6!+0x0 
e54ff820 81c33034 00000000 00000000 00000000 00000000 exact_client_0.34_windows_x86_6!+0x0 
e54ff850 84223691 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
e54ff8a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 32760 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Unknown, , Kernel Time: 30.000000, User Time: 0.000000, Wait Time: 3809243136.000000

- Registers -
rax=0000000000000000 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000000000000 rsp=0000000000000000 rbp=0000000000000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !+0x0 

*** Dump of thread ID 30710221 (state: Unknown): ***

- Information -
Status: Base Priority: Normal, Priority: Unknown, , Kernel Time: 17179869184.000000, User Time: 21474836480.000000, Wait Time: 0.000000

- Registers -
rax=0000000000000000 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000000000000 rsp=0000000000000000 rbp=0000000000000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>