Nameexact_genome_1532344514_155_9424_2
Workunit3880156
Created26 Jul 2018, 11:59:53 UTC
Sent26 Jul 2018, 13:16:45 UTC
Report deadline30 Sep 2018, 16:53:30 UTC
Received3 Aug 2018, 9:47:55 UTC
Server stateOver
OutcomeComputation error
Client stateCompute error
Exit status194 (0xc2) EXIT_ABORTED_BY_CLIENT
Computer ID64195
Run time12 hours 43 min 7 sec
CPU time12 hours 42 min 23 sec
Validate stateInvalid
Credit0.00
Device peak FLOPS3.72 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size564.34 MB
Peak swap size584.01 MB
Peak disk usage15.90 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
oint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1532344514_155_9424.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1532344514_155_9424_2_r1952041758_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512258
read mu: 0.583298
read mu_delta: 0.973525
read initial_learning_rate: 0.000795117
read learning_rate: 0.000483581
read learning_rate_delta: 0.920463
read initial_weight_decay: 0.000258601
read weight_decay: 0.000162137
read weight_decay_delta: 0.925143
read batch_size: 77
read epsilon: 1e-07
read alpha: 0.127087
read input_dropout_probability: 0.00129138
read hidden_dropout_probability: 0.113688
read velocity_reset: 1218
read epoch: 6
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 4
read number_validation_images: 10000
read best_validation_predictions: 6274
read best_validation_error: 10664.7
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 9424
read normal distribution: '1 0 0'
generator_str: '277602527'
read generator: 277602527
read generated_by_map:
1 crossover 1
reading 134 nodes.
reading 602 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 2339.48095703125s, input_fired_time: 31.467586517334, output_fired_time: 15.1278142929077, propagate_forward_time: 892.769775390625, propagate_backward_time: 1380.18432617188, weight_update_time: 1.13943469524384, other_time: 19.931396484375
epoch time: 184.653717041016s, input_fired_time: 2.40906119346619, output_fired_time: 0, propagate_forward_time: 178.790435791016, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.4542236328125
validation[          , genome  9424] predictions:    6081/  10000 (60.81%), best:    6274/10000 (62.74%), error:     11362.45215, best error:     10664.72852 on epoch:     4, epoch:    6/50, mu: 0.5832978487, learning_rate: 0.0004835807, weight_decay: 0.0001621373

epoch time: 2340.1230468750s, input_fired_time: 31.5268192291, output_fired_time: 15.0735759735, propagate_forward_time: 892.8828125000, propagate_backward_time: 1380.6944580078, weight_update_time: 1.1386672258, other_time: 19.9454345703
epoch time: 184.2157745361s, input_fired_time: 2.4013526440, output_fired_time: 0.0000000000, propagate_forward_time: 178.3742675781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4401550293
validation[          , genome  9424] predictions:    5966/  10000 (59.66%), best:    6274/10000 (62.74%), error:     11792.10840, best error:     10664.72852 on epoch:     4, epoch:    7/50, mu: 0.5940652490, learning_rate: 0.0004451182, weight_decay: 0.0001500002

epoch time: 2337.7260742188s, input_fired_time: 31.4948062897, output_fired_time: 15.0999498367, propagate_forward_time: 892.1975708008, propagate_backward_time: 1379.0782470703, weight_update_time: 1.1364282370, other_time: 19.8555908203
epoch time: 185.5567779541s, input_fired_time: 2.4213852882, output_fired_time: 0.0000000000, propagate_forward_time: 179.6662597656, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4691314697
validation[          , genome  9424] predictions:    6300/  10000 (63.00%), best:    6300/10000 (63.00%), error:     10615.33398, best error:     10615.33398 on epoch:     8, epoch:    8/50, mu: 0.6045475602, learning_rate: 0.0004097149, weight_decay: 0.0001387716

epoch time: 2341.8830566406s, input_fired_time: 31.5454559326, output_fired_time: 15.0953407288, propagate_forward_time: 893.5639038086, propagate_backward_time: 1381.7403564453, weight_update_time: 1.1395795345, other_time: 19.9378662109
epoch time: 185.1185607910s, input_fired_time: 2.4252369404, output_fired_time: 0.0000000000, propagate_forward_time: 179.2275238037, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4658050537
validation[          , genome  9424] predictions:    6299/  10000 (62.99%), best:    6300/10000 (63.00%), error:     10687.83789, best error:     10615.33398 on epoch:     8, epoch:    9/50, mu: 0.6147523522, learning_rate: 0.0003771274, weight_decay: 0.0001283836

epoch time: 2339.2214355469s, input_fired_time: 31.5008411407, output_fired_time: 15.0949392319, propagate_forward_time: 892.2874145508, propagate_backward_time: 1380.4216308594, weight_update_time: 1.1378399134, other_time: 19.9167480469
epoch time: 184.3194274902s, input_fired_time: 2.4171419144, output_fired_time: 0.0000000000, propagate_forward_time: 178.4506378174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4516448975
validation[          , genome  9424] predictions:    6295/  10000 (62.95%), best:    6295/10000 (62.95%), error:     10570.92969, best error:     10570.92969 on epoch:    10, epoch:   10/50, mu: 0.6246869564, learning_rate: 0.0003471319, weight_decay: 0.0001187732

epoch time: 2347.4621582031s, input_fired_time: 31.5956802368, output_fired_time: 15.1195993423, propagate_forward_time: 895.0069580078, propagate_backward_time: 1385.7631835938, weight_update_time: 1.1550639868, other_time: 19.9766845703
epoch time: 189.0455627441s, input_fired_time: 2.4659037590, output_fired_time: 0.0000000000, propagate_forward_time: 183.1147003174, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4649658203
validation[          , genome  9424] predictions:    6246/  10000 (62.46%), best:    6295/10000 (62.95%), error:     10837.40234, best error:     10570.92969 on epoch:    10, epoch:   11/50, mu: 0.6343585849, learning_rate: 0.0003195221, weight_decay: 0.0001098822

epoch time: 2328.8095703125s, input_fired_time: 31.4725437164, output_fired_time: 15.0220632553, propagate_forward_time: 887.2363281250, propagate_backward_time: 1375.1922607422, weight_update_time: 1.1346282959, other_time: 19.8863525391
epoch time: 180.5437164307s, input_fired_time: 2.3874952793, output_fired_time: 0.0000000000, propagate_forward_time: 174.7242584229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4319610596
validation[          , genome  9424] predictions:    6388/  10000 (63.88%), best:    6295/10000 (62.95%), error:     10611.07324, best error:     10570.92969 on epoch:    10, epoch:   12/50, mu: 0.6437741518, learning_rate: 0.0002941083, weight_decay: 0.0001016567

epoch time: 2294.0717773438s, input_fired_time: 31.2969875336, output_fired_time: 14.8084993362, propagate_forward_time: 873.1672973633, propagate_backward_time: 1355.0782470703, weight_update_time: 1.1258023977, other_time: 19.7208251953
epoch time: 180.6981048584s, input_fired_time: 2.3800368309, output_fired_time: 0.0000000000, propagate_forward_time: 174.8989257813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4191436768
validation[          , genome  9424] predictions:    6204/  10000 (62.04%), best:    6295/10000 (62.95%), error:     10865.81543, best error:     10570.92969 on epoch:    10, epoch:   13/50, mu: 0.6529404521, learning_rate: 0.0002707158, weight_decay: 0.0000940470

epoch time: 2299.4160156250s, input_fired_time: 31.3162097931, output_fired_time: 14.8538417816, propagate_forward_time: 874.4804077148, propagate_backward_time: 1359.0073242188, weight_update_time: 1.1267151833, other_time: 19.7583007813
epoch time: 180.0480041504s, input_fired_time: 2.3845326900, output_fired_time: 0.0000000000, propagate_forward_time: 174.2514953613, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4119720459
validation[          , genome  9424] predictions:    6463/  10000 (64.63%), best:    6463/10000 (64.63%), error:     10167.73340, best error:     10167.73340 on epoch:    14, epoch:   14/50, mu: 0.6618640423, learning_rate: 0.0002491839, weight_decay: 0.0000870069

epoch time: 2296.1909179688s, input_fired_time: 31.3135356903, output_fired_time: 14.8156261444, propagate_forward_time: 873.5614013672, propagate_backward_time: 1356.8115234375, weight_update_time: 1.1248576641, other_time: 19.6888427734
epoch time: 179.7055969238s, input_fired_time: 2.3838961124, output_fired_time: 0.0000000000, propagate_forward_time: 173.9368591309, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3848419189
validation[          , genome  9424] predictions:    6426/  10000 (64.26%), best:    6463/10000 (64.63%), error:     10334.44336, best error:     10167.73340 on epoch:    14, epoch:   15/50, mu: 0.6705513597, learning_rate: 0.0002293646, weight_decay: 0.0000804938

epoch time: 2297.3168945313s, input_fired_time: 31.3100566864, output_fired_time: 14.8680925369, propagate_forward_time: 873.9259033203, propagate_backward_time: 1357.4567871094, weight_update_time: 1.1282098293, other_time: 19.7559814453
epoch time: 179.8292694092s, input_fired_time: 2.3827354908, output_fired_time: 0.0000000000, propagate_forward_time: 174.0544128418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3921203613
validation[          , genome  9424] predictions:    6407/  10000 (64.07%), best:    6463/10000 (64.63%), error:     10362.99414, best error:     10167.73340 on epoch:    14, epoch:   16/50, mu: 0.6790087223, learning_rate: 0.0002111216, weight_decay: 0.0000744683

epoch time: 2297.7067871094s, input_fired_time: 31.3346195221, output_fired_time: 14.8317708969, propagate_forward_time: 873.7537841797, propagate_backward_time: 1358.0117187500, weight_update_time: 1.1297309399, other_time: 19.7747802734
epoch time: 180.1663513184s, input_fired_time: 2.3920419216, output_fired_time: 0.0000000000, propagate_forward_time: 174.3573760986, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4169311523
validation[          , genome  9424] predictions:    6566/  10000 (65.66%), best:    6566/10000 (65.66%), error:     10026.28027, best error:     10026.28027 on epoch:    17, epoch:   17/50, mu: 0.6872421503, learning_rate: 0.0001943297, weight_decay: 0.0000688938

epoch time: 2329.7517089844s, input_fired_time: 31.5295715332, output_fired_time: 15.0185146332, propagate_forward_time: 887.4934082031, propagate_backward_time: 1375.8710937500, weight_update_time: 1.1339104176, other_time: 19.8391113281
epoch time: 184.0810394287s, input_fired_time: 2.4249751568, output_fired_time: 0.0000000000, propagate_forward_time: 178.2157592773, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4403076172
validation[          , genome  9424] predictions:    6483/  10000 (64.83%), best:    6566/10000 (65.66%), error:     10189.51563, best error:     10026.28027 on epoch:    17, epoch:   18/50, mu: 0.6952576041, learning_rate: 0.0001788733, weight_decay: 0.0000637367

epoch time: 2340.1345214844s, input_fired_time: 31.5890846252, output_fired_time: 15.0670766830, propagate_forward_time: 891.9988403320, propagate_backward_time: 1381.5770263672, weight_update_time: 1.1384584904, other_time: 19.9024658203
epoch time: 180.0808715820s, input_fired_time: 2.3879718781, output_fired_time: 0.0000000000, propagate_forward_time: 174.2922973633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4006042480
validation[          , genome  9424] predictions:    6464/  10000 (64.64%), best:    6566/10000 (65.66%), error:     10269.65918, best error:     10026.28027 on epoch:    17, epoch:   19/50, mu: 0.7030608654, learning_rate: 0.0001646463, weight_decay: 0.0000589655

epoch time: 2296.2580566406s, input_fired_time: 31.3555812836, output_fired_time: 14.8522882462, propagate_forward_time: 872.6716308594, propagate_backward_time: 1357.6401367188, weight_update_time: 1.1241456270, other_time: 19.7385253906
epoch time: 180.5929260254s, input_fired_time: 2.3976247311, output_fired_time: 0.0000000000, propagate_forward_time: 174.7872619629, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.4080352783
validation[          , genome  9424] predictions:    6388/  10000 (63.88%), best:    6566/10000 (65.66%), error:     10316.11719, best error:     10026.28027 on epoch:    17, epoch:   20/50, mu: 0.7106575370, learning_rate: 0.0001515508, weight_decay: 0.0000545515

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1532344514_155_9424.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1532344514_155_9424_2_r1952041758_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512258
read mu: 0.718053
read mu_delta: 0.973525
read initial_learning_rate: 0.000795117
read learning_rate: 0.000139497
read learning_rate_delta: 0.920463
read initial_weight_decay: 0.000258601
read weight_decay: 5.0468e-05
read weight_decay_delta: 0.925143
read batch_size: 77
read epsilon: 1e-07
read alpha: 0.127087
read input_dropout_probability: 0.00129138
read hidden_dropout_probability: 0.113688
read velocity_reset: 1218
read epoch: 21
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 17
read number_validation_images: 10000
read best_validation_predictions: 6566
read best_validation_error: 10026.3
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 9424
read normal distribution: '1 0 0'
generator_str: '188424177'
read generator: 188424177
read generated_by_map:
1 crossover 1
reading 134 nodes.
reading 602 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
10:07:49 (15116): Can't acquire lockfile (32) - waiting 35s
10:08:24 (15116): Can't acquire lockfile (32) - exiting
10:08:24 (15116): Error: Impossibile accedere al file. Il file &#232; utilizzato da un altro processo.

 (0x20)
epoch time: 2412.91943359375s, input_fired_time: 32.8465003967285, output_fired_time: 15.5703067779541, propagate_forward_time: 919.856567382813, propagate_backward_time: 1423.72888183594, weight_update_time: 1.21165990829468, other_time: 20.917236328125
epoch time: 191.794555664063s, input_fired_time: 2.53943490982056, output_fired_time: 0, propagate_forward_time: 185.53630065918, propagate_backward_time: 0, weight_update_time: 0, other_time: 3.71882629394531
validation[          , genome  9424] predictions:    6592/  10000 (65.92%), best:    6592/10000 (65.92%), error:      9869.38574, best error:      9869.38574 on epoch:    21, epoch:   21/50, mu: 0.7180531025, learning_rate: 0.0001394969, weight_decay: 0.0000504680

epoch time: 2343.1213378906s, input_fired_time: 31.6858329773, output_fired_time: 15.1978893280, propagate_forward_time: 891.7324218750, propagate_backward_time: 1384.4608154297, weight_update_time: 1.1318914890, other_time: 20.0443115234
epoch time: 170.0501861572s, input_fired_time: 2.3100230694, output_fired_time: 0.0000000000, propagate_forward_time: 164.4297332764, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3104248047
validation[          , genome  9424] predictions:    6621/  10000 (66.21%), best:    6621/10000 (66.21%), error:      9744.71484, best error:      9744.71484 on epoch:    22, epoch:   22/50, mu: 0.7252528667, learning_rate: 0.0001284018, weight_decay: 0.0000466901

epoch time: 2177.2128906250s, input_fired_time: 30.7879657745, output_fired_time: 14.1903104782, propagate_forward_time: 822.4035644531, propagate_backward_time: 1290.6286621094, weight_update_time: 1.0884050131, other_time: 19.2021484375
epoch time: 171.9807434082s, input_fired_time: 2.3209977150, output_fired_time: 0.0000000000, propagate_forward_time: 166.3363647461, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3233795166
validation[          , genome  9424] predictions:    6632/  10000 (66.32%), best:    6621/10000 (66.21%), error:      9877.65918, best error:      9744.71484 on epoch:    22, epoch:   23/50, mu: 0.7322620153, learning_rate: 0.0001181891, weight_decay: 0.0000431950

epoch time: 2174.9025878906s, input_fired_time: 30.7721843719, output_fired_time: 14.1628370285, propagate_forward_time: 821.4747314453, propagate_backward_time: 1289.1544189453, weight_update_time: 1.0978300571, other_time: 19.3383789063
epoch time: 170.6646575928s, input_fired_time: 2.3057587147, output_fired_time: 0.0000000000, propagate_forward_time: 165.0587158203, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.3001861572
validation[          , genome  9424] predictions:    6673/  10000 (66.73%), best:    6673/10000 (66.73%), error:      9659.23145, best error:      9659.23145 on epoch:    24, epoch:   24/50, mu: 0.7390856147, learning_rate: 0.0001087887, weight_decay: 0.0000399616

epoch time: 2170.2382812500s, input_fired_time: 30.7441844940, output_fired_time: 14.1500959396, propagate_forward_time: 818.8273925781, propagate_backward_time: 1287.3051757813, weight_update_time: 1.0849444866, other_time: 19.2114257813
epoch time: 169.2854156494s, input_fired_time: 2.2936198711, output_fired_time: 0.0000000000, propagate_forward_time: 163.6971588135, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2946319580
validation[          , genome  9424] predictions:    6722/  10000 (67.22%), best:    6722/10000 (67.22%), error:      9597.87891, best error:      9597.87891 on epoch:    25, epoch:   25/50, mu: 0.7457285523, learning_rate: 0.0001001360, weight_decay: 0.0000369702

epoch time: 2151.2297363281s, input_fired_time: 30.6584110260, output_fired_time: 14.0041561127, propagate_forward_time: 811.5988769531, propagate_backward_time: 1275.7606201172, weight_update_time: 1.0832622051, other_time: 19.2076416016
epoch time: 164.3935394287s, input_fired_time: 2.2431070805, output_fired_time: 0.0000000000, propagate_forward_time: 158.8969879150, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.2534484863
validation[          , genome  9424] predictions:    6650/  10000 (66.50%), best:    6722/10000 (67.22%), error:      9790.67871, best error:      9597.87891 on epoch:    25, epoch:   26/50, mu: 0.7521955967, learning_rate: 0.0000921715, weight_decay: 0.0000342027

epoch time: 2094.5830078125s, input_fired_time: 30.3974761963, output_fired_time: 13.6909408569, propagate_forward_time: 788.5445556641, propagate_backward_time: 1243.0429687500, weight_update_time: 1.0705533028, other_time: 18.9071044922
epoch time: 161.3688354492s, input_fired_time: 2.2221086025, output_fired_time: 0.0000000000, propagate_forward_time: 155.9588470459, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1878814697
validation[          , genome  9424] predictions:    6667/  10000 (66.67%), best:    6722/10000 (67.22%), error:      9676.79590, best error:      9597.87891 on epoch:    25, epoch:   27/50, mu: 0.7584914565, learning_rate: 0.0000848404, weight_decay: 0.0000316424

epoch time: 2023.7030029297s, input_fired_time: 30.0846691132, output_fired_time: 13.3448085785, propagate_forward_time: 762.0332641602, propagate_backward_time: 1199.5144042969, weight_update_time: 1.0527586937, other_time: 18.7258300781
epoch time: 150.4558563232s, input_fired_time: 2.0973136425, output_fired_time: 0.0000000000, propagate_forward_time: 145.2316894531, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.1268463135
validation[          , genome  9424] predictions:    6512/  10000 (65.12%), best:    6722/10000 (67.22%), error:      9990.89063, best error:      9597.87891 on epoch:    25, epoch:   28/50, mu: 0.7646206021, learning_rate: 0.0000780925, weight_decay: 0.0000292737

epoch time: 1954.5364990234s, input_fired_time: 29.6517848969, output_fired_time: 12.9673519135, propagate_forward_time: 729.8930053711, propagate_backward_time: 1163.9058837891, weight_update_time: 1.0132176876, other_time: 18.1185302734
epoch time: 145.6860046387s, input_fired_time: 2.0604286194, output_fired_time: 0.0000000000, propagate_forward_time: 140.5984497070, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0271301270
validation[          , genome  9424] predictions:    6680/  10000 (66.80%), best:    6722/10000 (67.22%), error:      9668.85156, best error:      9597.87891 on epoch:    25, epoch:   29/50, mu: 0.7705875039, learning_rate: 0.0000718813, weight_decay: 0.0000270824

epoch time: 1909.3531494141s, input_fired_time: 29.4546985626, output_fired_time: 12.7172470093, propagate_forward_time: 711.1634521484, propagate_backward_time: 1138.1115722656, weight_update_time: 0.9972506166, other_time: 17.9061279297
epoch time: 144.3356323242s, input_fired_time: 2.0510969162, output_fired_time: 0.0000000000, propagate_forward_time: 139.2582550049, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0262756348
validation[          , genome  9424] predictions:    6797/  10000 (67.97%), best:    6797/10000 (67.97%), error:      9356.33691, best error:      9356.33691 on epoch:    30, epoch:   30/50, mu: 0.7763963938, learning_rate: 0.0000661640, weight_decay: 0.0000250551

epoch time: 1792.9990234375s, input_fired_time: 28.8558330536, output_fired_time: 12.1446533203, propagate_forward_time: 661.6934814453, propagate_backward_time: 1073.0155029297, weight_update_time: 0.9625729918, other_time: 17.2895507813
epoch time: 139.4658813477s, input_fired_time: 2.0060644150, output_fired_time: 0.0000000000, propagate_forward_time: 134.4799041748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9799194336
validation[          , genome  9424] predictions:    6747/  10000 (67.47%), best:    6797/10000 (67.97%), error:      9479.63574, best error:      9356.33691 on epoch:    30, epoch:   31/50, mu: 0.7820515037, learning_rate: 0.0000609016, weight_decay: 0.0000231795

epoch time: 1780.5640869141s, input_fired_time: 28.8274860382, output_fired_time: 11.7157382965, propagate_forward_time: 662.9124755859, propagate_backward_time: 1059.9852294922, weight_update_time: 0.9442138672, other_time: 17.1231689453
epoch time: 129.9806060791s, input_fired_time: 1.8944780827, output_fired_time: 0.0000000000, propagate_forward_time: 125.2185745239, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8675460815
validation[          , genome  9424] predictions:    6806/  10000 (68.06%), best:    6797/10000 (67.97%), error:      9409.23047, best error:      9356.33691 on epoch:    30, epoch:   32/50, mu: 0.7875568867, learning_rate: 0.0000560576, weight_decay: 0.0000214444

epoch time: 1699.9766845703s, input_fired_time: 28.4475593567, output_fired_time: 11.3104267120, propagate_forward_time: 627.9492187500, propagate_backward_time: 1015.4609985352, weight_update_time: 0.9273196459, other_time: 16.8085327148
epoch time: 135.3475952148s, input_fired_time: 1.9497668743, output_fired_time: 0.0000000000, propagate_forward_time: 130.5122070313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8856201172
validation[          , genome  9424] predictions:    6801/  10000 (68.01%), best:    6797/10000 (67.97%), error:      9361.92090, best error:      9356.33691 on epoch:    30, epoch:   33/50, mu: 0.7929165363, learning_rate: 0.0000515990, weight_decay: 0.0000198391

epoch time: 1648.9368896484s, input_fired_time: 28.2068977356, output_fired_time: 11.0147209167, propagate_forward_time: 608.3340454102, propagate_backward_time: 984.9948730469, weight_update_time: 0.9041246176, other_time: 16.3862915039
epoch time: 140.2075347900s, input_fired_time: 2.0087084770, output_fired_time: 0.0000000000, propagate_forward_time: 135.2377624512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9610595703
validation[          , genome  9424] predictions:    6787/  10000 (67.87%), best:    6797/10000 (67.97%), error:      9359.87793, best error:      9356.33691 on epoch:    30, epoch:   34/50, mu: 0.7981342673, learning_rate: 0.0000474950, weight_decay: 0.0000183540

epoch time: 1536.0616455078s, input_fired_time: 27.6218185425, output_fired_time: 10.3300075531, propagate_forward_time: 561.5440063477, propagate_backward_time: 920.7001342773, weight_update_time: 0.8696957827, other_time: 15.8657226563
epoch time: 110.6636810303s, input_fired_time: 1.7027035952, output_fired_time: 0.0000000000, propagate_forward_time: 106.3248519897, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6361236572
validation[          , genome  9424] predictions:    6847/  10000 (68.47%), best:    6847/10000 (68.47%), error:      9287.13574, best error:      9287.13574 on epoch:    35, epoch:   35/50, mu: 0.8032138944, learning_rate: 0.0000437174, weight_decay: 0.0000169801

epoch time: 1539.8316650391s, input_fired_time: 27.6827602386, output_fired_time: 10.3909606934, propagate_forward_time: 564.1644897461, propagate_backward_time: 921.6868286133, weight_update_time: 0.8712624311, other_time: 15.9066162109
epoch time: 121.5782012939s, input_fired_time: 1.8206348419, output_fired_time: 0.0000000000, propagate_forward_time: 117.0066680908, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7509002686
validation[          , genome  9424] predictions:    6728/  10000 (67.28%), best:    6847/10000 (68.47%), error:      9567.02148, best error:      9287.13574 on epoch:    35, epoch:   36/50, mu: 0.8081590533, learning_rate: 0.0000402402, weight_decay: 0.0000157090

epoch time: 1577.8756103516s, input_fired_time: 27.8752555847, output_fired_time: 10.6003131866, propagate_forward_time: 580.4493408203, propagate_backward_time: 942.8052978516, weight_update_time: 0.8855125904, other_time: 16.1453857422
epoch time: 146.7407531738s, input_fired_time: 2.0805232525, output_fired_time: 0.0000000000, propagate_forward_time: 141.6455841064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0146484375
validation[          , genome  9424] predictions:    6742/  10000 (67.42%), best:    6847/10000 (68.47%), error:      9371.76270, best error:      9287.13574 on epoch:    35, epoch:   37/50, mu: 0.8129732609, learning_rate: 0.0000370396, weight_decay: 0.0000145331

epoch time: 1503.4913330078s, input_fired_time: 27.4671592712, output_fired_time: 10.1646556854, propagate_forward_time: 547.1385498047, propagate_backward_time: 903.0056762695, weight_update_time: 0.8589961529, other_time: 15.7152709961
epoch time: 127.4723434448s, input_fired_time: 1.8870612383, output_fired_time: 0.0000000000, propagate_forward_time: 122.7652587891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8200225830
validation[          , genome  9424] predictions:    6826/  10000 (68.26%), best:    6847/10000 (68.47%), error:      9287.49805, best error:      9287.13574 on epoch:    35, epoch:   38/50, mu: 0.8176600337, learning_rate: 0.0000340936, weight_decay: 0.0000134452

epoch time: 1496.2891845703s, input_fired_time: 27.4423255920, output_fired_time: 10.1044969559, propagate_forward_time: 544.9808959961, propagate_backward_time: 898.0682373047, weight_update_time: 0.8574646711, other_time: 15.6931762695
epoch time: 108.4737472534s, input_fired_time: 1.6850489378, output_fired_time: 0.0000000000, propagate_forward_time: 104.1804733276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6082229614
validation[          , genome  9424] predictions:    6800/  10000 (68.00%), best:    6847/10000 (68.47%), error:      9363.36816, best error:      9287.13574 on epoch:    35, epoch:   39/50, mu: 0.8222227097, learning_rate: 0.0000313819, weight_decay: 0.0000124387

epoch time: 1467.9334716797s, input_fired_time: 27.3272895813, output_fired_time: 9.9467086792, propagate_forward_time: 534.0945434570, propagate_backward_time: 880.9924926758, weight_update_time: 0.8484632373, other_time: 15.5725097656
epoch time: 123.9264221191s, input_fired_time: 1.8477950096, output_fired_time: 0.0000000000, propagate_forward_time: 119.3014831543, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7771453857
validation[          , genome  9424] predictions:    6870/  10000 (68.70%), best:    6870/10000 (68.70%), error:      9244.97266, best error:      9244.97266 on epoch:    40, epoch:   40/50, mu: 0.8266645670, learning_rate: 0.0000288859, weight_decay: 0.0000115076

epoch time: 1360.3181152344s, input_fired_time: 26.7865562439, output_fired_time: 9.3208875656, propagate_forward_time: 490.8164672852, propagate_backward_time: 818.3466796875, weight_update_time: 0.8125621080, other_time: 15.0475463867
epoch time: 122.3163528442s, input_fired_time: 1.8345365524, output_fired_time: 0.0000000000, propagate_forward_time: 117.7149124146, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7669067383
validation[          , genome  9424] predictions:    6794/  10000 (67.94%), best:    6870/10000 (68.70%), error:      9297.17383, best error:      9244.97266 on epoch:    40, epoch:   41/50, mu: 0.8309888244, learning_rate: 0.0000265884, weight_decay: 0.0000106462

epoch time: 1446.9569091797s, input_fired_time: 27.2214584351, output_fired_time: 9.8107547760, propagate_forward_time: 525.1474609375, propagate_backward_time: 869.3033447266, weight_update_time: 0.8438030481, other_time: 15.4738769531
epoch time: 99.6452865601s, input_fired_time: 1.6037551165, output_fired_time: 0.0000000000, propagate_forward_time: 95.5207290649, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5208053589
validation[          , genome  9424] predictions:    6841/  10000 (68.41%), best:    6870/10000 (68.70%), error:      9257.90820, best error:      9244.97266 on epoch:    40, epoch:   42/50, mu: 0.8351986408, learning_rate: 0.0000244736, weight_decay: 0.0000098492

epoch time: 1389.7866210938s, input_fired_time: 26.9512405396, output_fired_time: 9.5044651031, propagate_forward_time: 502.5820312500, propagate_backward_time: 835.5599365234, weight_update_time: 0.8223092556, other_time: 15.1888427734
epoch time: 94.9472351074s, input_fired_time: 1.5547028780, output_fired_time: 0.0000000000, propagate_forward_time: 90.9419631958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4505691528
validation[          , genome  9424] predictions:    6879/  10000 (68.79%), best:    6879/10000 (68.79%), error:      9143.16992, best error:      9143.16992 on epoch:    43, epoch:   43/50, mu: 0.8392969966, learning_rate: 0.0000225271, weight_decay: 0.0000091119

epoch time: 1275.0437011719s, input_fired_time: 26.3551502228, output_fired_time: 8.8215723038, propagate_forward_time: 454.8058166504, propagate_backward_time: 770.4400634766, weight_update_time: 0.7857043147, other_time: 14.6212158203
epoch time: 94.8553619385s, input_fired_time: 1.5549926758, output_fired_time: 0.0000000000, propagate_forward_time: 90.8498077393, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4505615234
validation[          , genome  9424] predictions:    6876/  10000 (68.76%), best:    6879/10000 (68.79%), error:      9175.08203, best error:      9143.16992 on epoch:    43, epoch:   44/50, mu: 0.8432868123, learning_rate: 0.0000207353, weight_decay: 0.0000084298

epoch time: 1273.7036132813s, input_fired_time: 26.3560199738, output_fired_time: 8.8006391525, propagate_forward_time: 454.3067016602, propagate_backward_time: 769.7026367188, weight_update_time: 0.7833757997, other_time: 14.5375366211
epoch time: 94.8698883057s, input_fired_time: 1.5555018187, output_fired_time: 0.0000000000, propagate_forward_time: 90.8723907471, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4419937134
validation[          , genome  9424] predictions:    6883/  10000 (68.83%), best:    6879/10000 (68.79%), error:      9191.78906, best error:      9143.16992 on epoch:    43, epoch:   45/50, mu: 0.8471710086, learning_rate: 0.0000190861, weight_decay: 0.0000077988

epoch time: 1273.9553222656s, input_fired_time: 26.3697242737, output_fired_time: 8.8020887375, propagate_forward_time: 454.5867309570, propagate_backward_time: 769.6760253906, weight_update_time: 0.7822261453, other_time: 14.5206909180
epoch time: 94.7782058716s, input_fired_time: 1.5549546480, output_fired_time: 0.0000000000, propagate_forward_time: 90.7787094116, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4445419312
validation[          , genome  9424] predictions:    6849/  10000 (68.49%), best:    6879/10000 (68.79%), error:      9191.91406, best error:      9143.16992 on epoch:    43, epoch:   46/50, mu: 0.8509523869, learning_rate: 0.0000175681, weight_decay: 0.0000072150

epoch time: 1274.2033691406s, input_fired_time: 26.3794956207, output_fired_time: 8.8027095795, propagate_forward_time: 454.4181213379, propagate_backward_time: 770.0650024414, weight_update_time: 0.7827484012, other_time: 14.5380249023
epoch time: 94.7741699219s, input_fired_time: 1.5562447309, output_fired_time: 0.0000000000, propagate_forward_time: 90.7760848999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4418411255
validation[          , genome  9424] predictions:    6897/  10000 (68.97%), best:    6879/10000 (68.79%), error:      9191.61914, best error:      9143.16992 on epoch:    43, epoch:   47/50, mu: 0.8546336293, learning_rate: 0.0000161708, weight_decay: 0.0000066749

epoch time: 1274.0610351563s, input_fired_time: 26.3947296143, output_fired_time: 8.8004379272, propagate_forward_time: 454.4777526855, propagate_backward_time: 769.8341064453, weight_update_time: 0.7835839391, other_time: 14.5539550781
epoch time: 94.8096389771s, input_fired_time: 1.5578892231, output_fired_time: 0.0000000000, propagate_forward_time: 90.8145599365, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4371871948
validation[          , genome  9424] predictions:    6930/  10000 (69.30%), best:    6930/10000 (69.30%), error:      9077.77148, best error:      9077.77148 on epoch:    48, epoch:   48/50, mu: 0.8582174182, learning_rate: 0.0000148846, weight_decay: 0.0000061753

epoch time: 1274.1931152344s, input_fired_time: 26.3789787292, output_fired_time: 8.8022346497, propagate_forward_time: 454.5778808594, propagate_backward_time: 769.8804321289, weight_update_time: 0.7845016122, other_time: 14.5535278320
epoch time: 94.8919677734s, input_fired_time: 1.5579574108, output_fired_time: 0.0000000000, propagate_forward_time: 90.8848495483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4491577148
validation[          , genome  9424] predictions:    6902/  10000 (69.02%), best:    6930/10000 (69.30%), error:      9141.72852, best error:      9077.77148 on epoch:    48, epoch:   49/50, mu: 0.8617063165, learning_rate: 0.0000137007, weight_decay: 0.0000057130

epoch time: 1274.0682373047s, input_fired_time: 26.3846092224, output_fired_time: 8.8000984192, propagate_forward_time: 454.4420166016, propagate_backward_time: 769.9151000977, weight_update_time: 0.7830526829, other_time: 14.5264282227
epoch time: 94.9935607910s, input_fired_time: 1.5628726482, output_fired_time: 0.0000000000, propagate_forward_time: 90.9706726074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4600143433
validation[          , genome  9424] predictions:    6893/  10000 (68.93%), best:    6930/10000 (69.30%), error:      9122.94238, best error:      9077.77148 on epoch:    48, epoch:   50/50, mu: 0.8651028872, learning_rate: 0.0000126110, weight_decay: 0.0000052853

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 474.4137878418s, input_fired_time: 7.8058128357, output_fired_time: 0.0000000000, propagate_forward_time: 454.3178405762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.2901306152
best training[          , genome  9424] predictions:   38161/  50000 (76.32%), best:    6930/10000 (69.30%), error:     36646.83203, best error:      9077.77148 on epoch:    48, epoch:   51/50, mu: 0.8684095144, learning_rate: 0.0000116080, weight_decay: 0.0000048897
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 94.7748489380s, input_fired_time: 1.5572139025, output_fired_time: 0.0000000000, propagate_forward_time: 90.7642288208, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4534072876
   testing[          , genome  9424] predictions:    6930/  10000 (69.30%), best:    6930/10000 (69.30%), error:      9077.77148, best error:      9077.77148 on epoch:    48, epoch:   51/50, mu: 0.8684095144, learning_rate: 0.0000116080, weight_decay: 0.0000048897
backpropagation finished successfully!
01:12:19 (19028): called boinc_finish(0)
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1532344514_155_9424.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1532344514_155_9424_2_r1952041758_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.512258
read mu: 0.86841
read mu_delta: 0.973525
read initial_learning_rate: 0.000795117
read learning_rate: 1.1608e-05
read learning_rate_delta: 0.920463
read initial_weight_decay: 0.000258601
read weight_decay: 4.8897e-06
read weight_decay_delta: 0.925143
read batch_size: 77
read epsilon: 1e-07
read alpha: 0.127087
read input_dropout_probability: 0.00129138
read hidden_dropout_probability: 0.113688
read velocity_reset: 1218
read epoch: 51
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 48
read number_validation_images: 10000
read best_validation_predictions: 6930
read best_validation_error: 9077.77
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 9424
read normal distribution: '1 0 0'
generator_str: '76853750'
read generator: 76853750
read generated_by_map:
1 crossover 1
reading 134 nodes.
reading 602 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFB4AD8C902

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 08/03/18 11:03:31
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\11;C:\ProgramData\BOINC\projects\csgrid.org_csg


ModLoad: 0000000026c60000 00000000001da000 C:\ProgramData\BOINC\projects\csgrid.org_csg\exact_client_0.34_windows_x86_64.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : C:\Users\travi\Code\boinc_2015\win_build\Build\x64\Release\exact.pdb

ModLoad: 000000004e7a0000 00000000001e1000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.165) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004e2b0000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004ace0000 0000000000273000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.165) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004e470000 0000000000190000 C:\WINDOWS\System32\USER32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004b170000 0000000000020000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000004c800000 0000000000028000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000004ab40000 0000000000192000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.17134.112 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.112

ModLoad: 000000004b8a0000 000000000009f000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.137) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.137 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.137

ModLoad: 000000004b070000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.191) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.191 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.191

ModLoad: 000000004c280000 00000000000a1000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004c420000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17134.1

ModLoad: 000000004bda0000 000000000005b000 C:\WINDOWS\System32\sechost.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000004c4c0000 0000000000124000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004ce70000 0000000001440000 C:\WINDOWS\System32\SHELL32.dll (6.2.17134.137) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004bb30000 0000000000049000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000004e600000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004bf30000 0000000000323000 C:\WINDOWS\System32\combase.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004bb80000 000000000007a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000004b190000 000000000070d000 C:\WINDOWS\System32\windows.storage.dll (6.2.17134.191) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004e410000 0000000000051000 C:\WINDOWS\System32\shlwapi.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004aad0000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.17134.112 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.112

ModLoad: 000000004aab0000 000000000001f000 C:\WINDOWS\System32\profapi.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000004aaf0000 000000000004c000 C:\WINDOWS\System32\powrprof.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004aa80000 000000000000a000 C:\WINDOWS\System32\FLTLIB.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : fltLib.pdb
    File Version          : 10.0.17134.165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.165

ModLoad: 000000004c7d0000 000000000002d000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000037e90000 00000000001c9000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000456b0000 000000000000a000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 56578, Write: 4907, Other 1032

- I/O Transfers Counters -
Read: 231683254, Write: 5076, Other 41126

- Paged Pool Usage -
QuotaPagedPoolUsage: 157592, QuotaPeakPagedPoolUsage: 157976
QuotaNonPagedPoolUsage: 13456, QuotaPeakNonPagedPoolUsage: 13456

- Virtual Memory Usage -
VirtualSize: 613003264, PeakVirtualSize: 741797888

- Pagefile Usage -
PagefileUsage: 613003264, PeakPagefileUsage: 613003264

- Working Set Size -
WorkingSetSize: 592482304, PeakWorkingSetSize: 592482304, PageFaultCount: 185370

*** Dump of thread ID 14688 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFB4AD8C902

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=0000000026db9440 rdx=00000000d23ff250 rsi=0000000000000000 rdi=0000000000000000
r8=00000000d23ff250 r9=0000000026db9430 r10=0000000000000001 r11=0000000000000fff r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004ad8c902 rsp=00000000d23ff228 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
d23ff220 26cee421 00000001 d23ff250 d23ff250 26db9430 KERNELBASE!DebugBreak+0x0 
d23ff660 26cef820 00000000 00000000 00000000 00000000 exact_client_0.34_windows_x86_6!+0x0 
d23ff8c0 4e2c3034 00000000 00000000 00000000 00000000 exact_client_0.34_windows_x86_6!+0x0 
d23ff8f0 4e811431 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
d23ff940 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 32763 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Unknown, , Kernel Time: 31.000000, User Time: 0.000000, Wait Time: 3450505472.000000

- Registers -
rax=0000000000000000 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000000000000 rsp=0000000000000000 rbp=0000000000000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !+0x0 

*** Dump of thread ID 30681864 (state: Unknown): ***

- Information -
Status: Base Priority: Normal, Priority: Unknown, , Kernel Time: 17179869184.000000, User Time: 21474836480.000000, Wait Time: 0.000000

- Registers -
rax=0000000000000000 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000000000000 rsp=0000000000000000 rbp=0000000000000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>