Nameexact_genome_1542605141_174_6297_1
Workunit4098466
Created19 Nov 2018, 6:40:11 UTC
Sent19 Nov 2018, 7:08:58 UTC
Report deadline29 Dec 2018, 17:58:19 UTC
Received19 Nov 2018, 21:34:47 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID67644
Run time13 hours 31 min 36 sec
CPU time13 hours 31 min 3 sec
Validate stateValid
Credit10,112.74
Device peak FLOPS4.81 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size525.03 MB
Peak swap size544.90 MB
Peak disk usage9.39 MB

Stderr output

<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542605141_174_6297.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542605141_174_6297_1_r52443168_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542605141_174_6297.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.5
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.0125
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.0005
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 0
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6297
read normal distribution: '1 0 0'
generator_str: '1590583966'
read generator: 1590583966
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1068278706
post shuffle 1: 1893629305
epoch time: 823.885864257813s, input_fired_time: 7.18259239196777, output_fired_time: 5.62764930725098, propagate_forward_time: 310.561645507813, propagate_backward_time: 487.962341308594, weight_update_time: 0.49942010641098, other_time: 12.5516357421875
epoch time: 69.3918609619141s, input_fired_time: 0.884745359420776, output_fired_time: 0, propagate_forward_time: 66.1253204345703, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.38179779052734
validation[          , genome  6297] predictions:    4698/  10000 (46.98%), best:    4698/10000 (46.98%), error:     19901.66992, best error:     19901.66992 on epoch:     0, epoch:    0/50, mu: 0.5000000000, learning_rate: 0.0125000002, weight_decay: 0.0005000000

epoch time: 870.4621582031s, input_fired_time: 7.3497519493, output_fired_time: 5.9489011765, propagate_forward_time: 331.8086547852, propagate_backward_time: 513.2705688477, weight_update_time: 0.5137432814, other_time: 12.0842895508
epoch time: 67.4367065430s, input_fired_time: 0.8354836106, output_fired_time: 0.0000000000, propagate_forward_time: 64.3597717285, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2414474487
validation[          , genome  6297] predictions:    4898/  10000 (48.98%), best:    4898/10000 (48.98%), error:     17813.00000, best error:     17813.00000 on epoch:     1, epoch:    1/50, mu: 0.5245000124, learning_rate: 0.0118749999, weight_decay: 0.0004750000

epoch time: 870.6735229492s, input_fired_time: 7.2757439613, output_fired_time: 6.0087552071, propagate_forward_time: 331.9255371094, propagate_backward_time: 513.2650146484, weight_update_time: 0.5189816952, other_time: 12.1984863281
epoch time: 67.9774856567s, input_fired_time: 0.8638534546, output_fired_time: 0.0000000000, propagate_forward_time: 64.7968673706, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3167648315
validation[          , genome  6297] predictions:    4854/  10000 (48.54%), best:    4854/10000 (48.54%), error:     17152.98828, best error:     17152.98828 on epoch:     2, epoch:    2/50, mu: 0.5477750301, learning_rate: 0.0112812500, weight_decay: 0.0004512500

epoch time: 862.4020385742s, input_fired_time: 7.2485675812, output_fired_time: 5.9532852173, propagate_forward_time: 327.7957153320, propagate_backward_time: 509.6607971191, weight_update_time: 0.5103002191, other_time: 11.7436218262
epoch time: 68.2377014160s, input_fired_time: 0.8630990386, output_fired_time: 0.0000000000, propagate_forward_time: 65.1698455811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2047576904
validation[          , genome  6297] predictions:    5366/  10000 (53.66%), best:    5366/10000 (53.66%), error:     14570.37695, best error:     14570.37695 on epoch:     3, epoch:    3/50, mu: 0.5698862672, learning_rate: 0.0107171871, weight_decay: 0.0004286875

epoch time: 860.1814575195s, input_fired_time: 7.2256560326, output_fired_time: 5.9299449921, propagate_forward_time: 328.2060241699, propagate_backward_time: 506.4798583984, weight_update_time: 0.5098116994, other_time: 12.3399658203
epoch time: 71.1736297607s, input_fired_time: 0.8806068301, output_fired_time: 0.0000000000, propagate_forward_time: 68.0906448364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2023773193
validation[          , genome  6297] predictions:    4874/  10000 (48.74%), best:    5366/10000 (53.66%), error:     16156.31055, best error:     14570.37695 on epoch:     3, epoch:    4/50, mu: 0.5908919573, learning_rate: 0.0101813274, weight_decay: 0.0004072531

epoch time: 863.7019042969s, input_fired_time: 7.2207436562, output_fired_time: 5.8833365440, propagate_forward_time: 329.3516845703, propagate_backward_time: 509.5368652344, weight_update_time: 0.5018705726, other_time: 11.7092285156
epoch time: 66.7398223877s, input_fired_time: 0.8420065641, output_fired_time: 0.0000000000, propagate_forward_time: 63.8903236389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0074958801
validation[          , genome  6297] predictions:    5027/  10000 (50.27%), best:    5366/10000 (53.66%), error:     15754.99023, best error:     14570.37695 on epoch:     3, epoch:    5/50, mu: 0.6108473539, learning_rate: 0.0096722608, weight_decay: 0.0003868904

epoch time: 867.1483764648s, input_fired_time: 7.2266831398, output_fired_time: 5.9201397896, propagate_forward_time: 330.2015991211, propagate_backward_time: 512.9542236328, weight_update_time: 0.5137656927, other_time: 10.8457031250
epoch time: 68.1442413330s, input_fired_time: 0.8498650193, output_fired_time: 0.0000000000, propagate_forward_time: 65.1875534058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1068191528
validation[          , genome  6297] predictions:    5149/  10000 (51.49%), best:    5366/10000 (53.66%), error:     15003.00879, best error:     14570.37695 on epoch:     3, epoch:    6/50, mu: 0.6298049688, learning_rate: 0.0091886474, weight_decay: 0.0003675459

epoch time: 870.2306518555s, input_fired_time: 7.2427139282, output_fired_time: 5.9838333130, propagate_forward_time: 331.3173828125, propagate_backward_time: 514.2956542969, weight_update_time: 0.5133437514, other_time: 11.3910522461
epoch time: 67.3167648315s, input_fired_time: 0.8498799205, output_fired_time: 0.0000000000, propagate_forward_time: 64.2315673828, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2353210449
validation[          , genome  6297] predictions:    5277/  10000 (52.77%), best:    5366/10000 (53.66%), error:     14723.65527, best error:     14570.37695 on epoch:     3, epoch:    7/50, mu: 0.6478147507, learning_rate: 0.0087292148, weight_decay: 0.0003491686

epoch time: 860.3222045898s, input_fired_time: 7.2041668892, output_fired_time: 5.8642649651, propagate_forward_time: 327.1265258789, propagate_backward_time: 508.1239624023, weight_update_time: 0.5089108348, other_time: 12.0032958984
epoch time: 68.1777038574s, input_fired_time: 0.8611055017, output_fired_time: 0.0000000000, propagate_forward_time: 65.0439910889, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2726058960
validation[          , genome  6297] predictions:    4948/  10000 (49.48%), best:    5366/10000 (53.66%), error:     16630.58789, best error:     14570.37695 on epoch:     3, epoch:    8/50, mu: 0.6649240255, learning_rate: 0.0082927542, weight_decay: 0.0003317102

epoch time: 872.6644897461s, input_fired_time: 7.3324713707, output_fired_time: 5.9818978310, propagate_forward_time: 333.7626647949, propagate_backward_time: 514.0000000000, weight_update_time: 0.5184384584, other_time: 11.5875244141
epoch time: 67.4625091553s, input_fired_time: 0.8565832376, output_fired_time: 0.0000000000, propagate_forward_time: 64.4727172852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1332092285
validation[          , genome  6297] predictions:    5168/  10000 (51.68%), best:    5366/10000 (53.66%), error:     15266.57422, best error:     14570.37695 on epoch:     3, epoch:    9/50, mu: 0.6811778545, learning_rate: 0.0078781163, weight_decay: 0.0003151247

epoch time: 870.4381713867s, input_fired_time: 7.3436250687, output_fired_time: 5.9754567146, propagate_forward_time: 333.6959838867, propagate_backward_time: 511.9837341309, weight_update_time: 0.5181791782, other_time: 11.4393615723
epoch time: 67.8071517944s, input_fired_time: 0.8544664383, output_fired_time: 0.0000000000, propagate_forward_time: 64.8121719360, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1405105591
validation[          , genome  6297] predictions:    5257/  10000 (52.57%), best:    5366/10000 (53.66%), error:     15533.14160, best error:     14570.37695 on epoch:     3, epoch:   10/50, mu: 0.6966189742, learning_rate: 0.0074842102, weight_decay: 0.0002993684

epoch time: 871.6583251953s, input_fired_time: 7.3175697327, output_fired_time: 6.0453405380, propagate_forward_time: 332.6045532227, propagate_backward_time: 514.2442626953, weight_update_time: 0.5204655528, other_time: 11.4465942383
epoch time: 68.5572586060s, input_fired_time: 0.8709336519, output_fired_time: 0.0000000000, propagate_forward_time: 65.4407424927, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2455825806
validation[          , genome  6297] predictions:    5457/  10000 (54.57%), best:    5457/10000 (54.57%), error:     14003.61328, best error:     14003.61328 on epoch:    11, epoch:   11/50, mu: 0.7112880349, learning_rate: 0.0071099997, weight_decay: 0.0002844000

epoch time: 866.9912719727s, input_fired_time: 7.2948374748, output_fired_time: 5.9954743385, propagate_forward_time: 330.0699462891, propagate_backward_time: 511.6775512695, weight_update_time: 0.5210266113, other_time: 11.9534301758
epoch time: 67.9091720581s, input_fired_time: 0.8552980423, output_fired_time: 0.0000000000, propagate_forward_time: 64.7756576538, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2782135010
validation[          , genome  6297] predictions:    5437/  10000 (54.37%), best:    5457/10000 (54.57%), error:     14269.73047, best error:     14003.61328 on epoch:    11, epoch:   12/50, mu: 0.7252236605, learning_rate: 0.0067544994, weight_decay: 0.0002701800

epoch time: 857.7492675781s, input_fired_time: 7.2410621643, output_fired_time: 5.9023113251, propagate_forward_time: 325.1313476563, propagate_backward_time: 507.6641235352, weight_update_time: 0.5163766742, other_time: 11.8104248047
epoch time: 68.4726791382s, input_fired_time: 0.8617554903, output_fired_time: 0.0000000000, propagate_forward_time: 65.5683441162, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0425796509
validation[          , genome  6297] predictions:    5397/  10000 (53.97%), best:    5397/10000 (53.97%), error:     13930.87207, best error:     13930.87207 on epoch:    13, epoch:   13/50, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 855.1964721680s, input_fired_time: 7.2453842163, output_fired_time: 5.8580260277, propagate_forward_time: 325.1846618652, propagate_backward_time: 505.5690612793, weight_update_time: 0.5138612390, other_time: 11.3393859863
epoch time: 69.5207061768s, input_fired_time: 0.8767836094, output_fired_time: 0.0000000000, propagate_forward_time: 66.5318069458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1121139526
validation[          , genome  6297] predictions:    5527/  10000 (55.27%), best:    5527/10000 (55.27%), error:     13588.80566, best error:     13588.80566 on epoch:    14, epoch:   14/50, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 858.6865234375s, input_fired_time: 7.2813401222, output_fired_time: 5.8796806335, propagate_forward_time: 327.0259094238, propagate_backward_time: 506.8356933594, weight_update_time: 0.5164483786, other_time: 11.6639404297
epoch time: 68.6985931396s, input_fired_time: 0.8770033717, output_fired_time: 0.0000000000, propagate_forward_time: 65.5386734009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2829132080
validation[          , genome  6297] predictions:    5602/  10000 (56.02%), best:    5602/10000 (56.02%), error:     13202.31250, best error:     13202.31250 on epoch:    15, epoch:   15/50, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 865.2049560547s, input_fired_time: 7.3446850777, output_fired_time: 5.9400911331, propagate_forward_time: 330.9238586426, propagate_backward_time: 509.0180664063, weight_update_time: 0.5173591375, other_time: 11.9782714844
epoch time: 70.3625259399s, input_fired_time: 0.8828244805, output_fired_time: 0.0000000000, propagate_forward_time: 67.0522155762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4274826050
validation[          , genome  6297] predictions:    5410/  10000 (54.10%), best:    5602/10000 (56.02%), error:     13987.82031, best error:     13202.31250 on epoch:    15, epoch:   16/50, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 863.1875000000s, input_fired_time: 7.3193478584, output_fired_time: 5.9362659454, propagate_forward_time: 328.6561279297, propagate_backward_time: 509.4314270020, weight_update_time: 0.5164346695, other_time: 11.8443298340
epoch time: 67.9651031494s, input_fired_time: 0.8890085220, output_fired_time: 0.0000000000, propagate_forward_time: 64.9365615845, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1395339966
validation[          , genome  6297] predictions:    5432/  10000 (54.32%), best:    5602/10000 (56.02%), error:     14385.16211, best error:     13202.31250 on epoch:    15, epoch:   17/50, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 859.8186035156s, input_fired_time: 7.3387770653, output_fired_time: 5.8949456215, propagate_forward_time: 327.0262756348, propagate_backward_time: 508.1202087402, weight_update_time: 0.5146204233, other_time: 11.4383850098
epoch time: 68.1178817749s, input_fired_time: 0.8858498335, output_fired_time: 0.0000000000, propagate_forward_time: 65.1060256958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1260070801
validation[          , genome  6297] predictions:    5464/  10000 (54.64%), best:    5602/10000 (56.02%), error:     14130.27051, best error:     13202.31250 on epoch:    15, epoch:   18/50, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 851.9298706055s, input_fired_time: 7.2893381119, output_fired_time: 5.8843250275, propagate_forward_time: 322.1220703125, propagate_backward_time: 504.8835144043, weight_update_time: 0.5112928748, other_time: 11.7505798340
epoch time: 68.9682922363s, input_fired_time: 0.8859800100, output_fired_time: 0.0000000000, propagate_forward_time: 65.8552780151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2270355225
validation[          , genome  6297] predictions:    5507/  10000 (55.07%), best:    5602/10000 (56.02%), error:     13743.34082, best error:     13202.31250 on epoch:    15, epoch:   19/50, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 859.2244873047s, input_fired_time: 7.3479223251, output_fired_time: 5.9485697746, propagate_forward_time: 328.0864868164, propagate_backward_time: 505.9285888672, weight_update_time: 0.5118383765, other_time: 11.9129638672
epoch time: 68.5543823242s, input_fired_time: 0.8754853010, output_fired_time: 0.0000000000, propagate_forward_time: 65.4812011719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1976928711
validation[          , genome  6297] predictions:    5533/  10000 (55.33%), best:    5602/10000 (56.02%), error:     13427.10938, best error:     13202.31250 on epoch:    15, epoch:   20/50, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 864.4222412109s, input_fired_time: 7.3537058830, output_fired_time: 5.9290375710, propagate_forward_time: 328.7946166992, propagate_backward_time: 511.0294494629, weight_update_time: 0.5147997737, other_time: 11.3154602051
epoch time: 66.4958190918s, input_fired_time: 0.8729265332, output_fired_time: 0.0000000000, propagate_forward_time: 63.4793586731, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1435356140
validation[          , genome  6297] predictions:    5633/  10000 (56.33%), best:    5633/10000 (56.33%), error:     12964.23535, best error:     12964.23535 on epoch:    21, epoch:   21/50, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 865.8049316406s, input_fired_time: 7.3568649292, output_fired_time: 5.9560356140, propagate_forward_time: 329.7365417480, propagate_backward_time: 511.6977844238, weight_update_time: 0.5166849494, other_time: 11.0577087402
epoch time: 67.2677230835s, input_fired_time: 0.8615479469, output_fired_time: 0.0000000000, propagate_forward_time: 64.2704238892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1357498169
validation[          , genome  6297] predictions:    5421/  10000 (54.21%), best:    5633/10000 (56.33%), error:     14232.48145, best error:     12964.23535 on epoch:    21, epoch:   22/50, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 858.2666625977s, input_fired_time: 7.3720908165, output_fired_time: 5.8932309151, propagate_forward_time: 327.9134826660, propagate_backward_time: 506.4962768555, weight_update_time: 0.5095229745, other_time: 10.5916137695
epoch time: 68.3365097046s, input_fired_time: 0.8980864286, output_fired_time: 0.0000000000, propagate_forward_time: 65.5568466187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8815765381
validation[          , genome  6297] predictions:    5542/  10000 (55.42%), best:    5633/10000 (56.33%), error:     13898.09180, best error:     12964.23535 on epoch:    21, epoch:   23/50, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 849.6322021484s, input_fired_time: 7.3073291779, output_fired_time: 5.9074983597, propagate_forward_time: 322.1081237793, propagate_backward_time: 503.4251708984, weight_update_time: 0.5045245290, other_time: 10.8841552734
epoch time: 66.6159362793s, input_fired_time: 0.8676409125, output_fired_time: 0.0000000000, propagate_forward_time: 63.6337509155, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1145477295
validation[          , genome  6297] predictions:    5605/  10000 (56.05%), best:    5633/10000 (56.33%), error:     13469.57422, best error:     12964.23535 on epoch:    21, epoch:   24/50, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 856.6802978516s, input_fired_time: 7.3433461189, output_fired_time: 5.9343156815, propagate_forward_time: 325.1121215820, propagate_backward_time: 506.8121948242, weight_update_time: 0.5080111623, other_time: 11.4783325195
epoch time: 68.1922607422s, input_fired_time: 0.8805576563, output_fired_time: 0.0000000000, propagate_forward_time: 65.1674423218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1442642212
validation[          , genome  6297] predictions:    5507/  10000 (55.07%), best:    5633/10000 (56.33%), error:     13701.91504, best error:     12964.23535 on epoch:    21, epoch:   25/50, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 868.3234863281s, input_fired_time: 7.4528288841, output_fired_time: 5.9595704079, propagate_forward_time: 330.0213623047, propagate_backward_time: 513.4766235352, weight_update_time: 0.5196247101, other_time: 11.4130859375
epoch time: 71.4481506348s, input_fired_time: 0.9135310650, output_fired_time: 0.0000000000, propagate_forward_time: 68.4021377563, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1324844360
validation[          , genome  6297] predictions:    5663/  10000 (56.63%), best:    5633/10000 (56.33%), error:     13239.28125, best error:     12964.23535 on epoch:    21, epoch:   26/50, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542605141_174_6297.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542605141_174_6297_1_r52443168_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.867332
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.0031293
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.000125172
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 27
read max_epochs: 50
read reset_weights: 0
read padding: 2
read best_epoch: 21
read number_validation_images: 10000
read best_validation_predictions: 5633
read best_validation_error: 12964.2
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6297
read normal distribution: '1 0 0'
generator_str: '2083721846'
read generator: 2083721846
read generated_by_map:
1 crossover 1
reading 90 nodes.
reading 313 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 888.392944335938s, input_fired_time: 7.54476928710938, output_fired_time: 6.15209817886353, propagate_forward_time: 338.749176025391, propagate_backward_time: 524.265747070313, weight_update_time: 0.526992738246918, other_time: 11.68115234375
epoch time: 68.1660537719727s, input_fired_time: 0.895703077316284, output_fired_time: 0, propagate_forward_time: 64.9654541015625, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.30489349365234
validation[          , genome  6297] predictions:    5610/  10000 (56.10%), best:    5633/10000 (56.33%), error:     13473.08691, best error:     12964.23535 on epoch:    21, epoch:   27/50, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 896.8929443359s, input_fired_time: 7.6035504341, output_fired_time: 6.1701731682, propagate_forward_time: 343.7955017090, propagate_backward_time: 527.8334350586, weight_update_time: 0.5301686525, other_time: 11.4902954102
epoch time: 70.3729629517s, input_fired_time: 0.9103199244, output_fired_time: 0.0000000000, propagate_forward_time: 67.2814331055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1812133789
validation[          , genome  6297] predictions:    5511/  10000 (55.11%), best:    5633/10000 (56.33%), error:     13742.63770, best error:     12964.23535 on epoch:    21, epoch:   28/50, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 891.9584350586s, input_fired_time: 7.5819888115, output_fired_time: 6.1510877609, propagate_forward_time: 341.7229614258, propagate_backward_time: 525.2733764648, weight_update_time: 0.5311101675, other_time: 11.2290649414
epoch time: 71.3976974487s, input_fired_time: 0.9186486006, output_fired_time: 0.0000000000, propagate_forward_time: 68.4198913574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0591583252
validation[          , genome  6297] predictions:    5712/  10000 (57.12%), best:    5633/10000 (56.33%), error:     13148.95801, best error:     12964.23535 on epoch:    21, epoch:   29/50, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 892.7109985352s, input_fired_time: 7.5767955780, output_fired_time: 6.1096520424, propagate_forward_time: 341.4494323730, propagate_backward_time: 526.2294921875, weight_update_time: 0.5312550664, other_time: 11.3455810547
epoch time: 70.9127807617s, input_fired_time: 0.9079772830, output_fired_time: 0.0000000000, propagate_forward_time: 67.8764114380, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1283950806
validation[          , genome  6297] predictions:    5556/  10000 (55.56%), best:    5633/10000 (56.33%), error:     13735.19727, best error:     12964.23535 on epoch:    21, epoch:   30/50, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 895.8414306641s, input_fired_time: 7.6220335960, output_fired_time: 6.1730189323, propagate_forward_time: 343.5570678711, propagate_backward_time: 527.4132690430, weight_update_time: 0.5294938684, other_time: 11.0760498047
epoch time: 73.2412338257s, input_fired_time: 0.9563736320, output_fired_time: 0.0000000000, propagate_forward_time: 70.2966003418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9882583618
validation[          , genome  6297] predictions:    5640/  10000 (56.40%), best:    5633/10000 (56.33%), error:     13307.56348, best error:     12964.23535 on epoch:    21, epoch:   31/50, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 892.3062133789s, input_fired_time: 7.5805149078, output_fired_time: 6.1281661987, propagate_forward_time: 341.1676025391, propagate_backward_time: 525.5211181641, weight_update_time: 0.5306356549, other_time: 11.9088134766
epoch time: 71.0720672607s, input_fired_time: 0.9214017987, output_fired_time: 0.0000000000, propagate_forward_time: 67.9093246460, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2413406372
validation[          , genome  6297] predictions:    5552/  10000 (55.52%), best:    5633/10000 (56.33%), error:     13650.85449, best error:     12964.23535 on epoch:    21, epoch:   32/50, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 895.9459838867s, input_fired_time: 7.6152238846, output_fired_time: 6.1413435936, propagate_forward_time: 342.8754272461, propagate_backward_time: 527.5667724609, weight_update_time: 0.5338513851, other_time: 11.7471923828
epoch time: 71.1092758179s, input_fired_time: 0.9265230894, output_fired_time: 0.0000000000, propagate_forward_time: 67.9418029785, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2409515381
validation[          , genome  6297] predictions:    5577/  10000 (55.77%), best:    5633/10000 (56.33%), error:     13801.93457, best error:     12964.23535 on epoch:    21, epoch:   33/50, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 897.8878784180s, input_fired_time: 7.6491122246, output_fired_time: 6.1542506218, propagate_forward_time: 343.2991333008, propagate_backward_time: 528.7138061523, weight_update_time: 0.5291886926, other_time: 12.0715942383
epoch time: 72.1536178589s, input_fired_time: 0.9282711744, output_fired_time: 0.0000000000, propagate_forward_time: 68.9583358765, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2670135498
validation[          , genome  6297] predictions:    5791/  10000 (57.91%), best:    5633/10000 (56.33%), error:     12994.74805, best error:     12964.23535 on epoch:    21, epoch:   34/50, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 893.8386840820s, input_fired_time: 7.6464486122, output_fired_time: 6.1371874809, propagate_forward_time: 342.3451843262, propagate_backward_time: 525.5634155273, weight_update_time: 0.5279867649, other_time: 12.1464233398
epoch time: 71.8895874023s, input_fired_time: 0.9370425940, output_fired_time: 0.0000000000, propagate_forward_time: 68.6998748779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2526702881
validation[          , genome  6297] predictions:    5848/  10000 (58.48%), best:    5848/10000 (58.48%), error:     12603.59570, best error:     12603.59570 on epoch:    35, epoch:   35/50, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 887.4581909180s, input_fired_time: 7.6207933426, output_fired_time: 6.0779781342, propagate_forward_time: 339.3522949219, propagate_backward_time: 522.1881713867, weight_update_time: 0.5269051194, other_time: 12.2189331055
epoch time: 71.6579055786s, input_fired_time: 0.9377023578, output_fired_time: 0.0000000000, propagate_forward_time: 68.3703536987, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3498458862
validation[          , genome  6297] predictions:    5694/  10000 (56.94%), best:    5848/10000 (58.48%), error:     12942.33594, best error:     12603.59570 on epoch:    35, epoch:   36/50, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 890.7244873047s, input_fired_time: 7.6414880753, output_fired_time: 6.1142344475, propagate_forward_time: 340.1345825195, propagate_backward_time: 524.4389038086, weight_update_time: 0.5206468701, other_time: 12.3952636719
epoch time: 70.7740631104s, input_fired_time: 0.9243369102, output_fired_time: 0.0000000000, propagate_forward_time: 67.5288925171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3208312988
validation[          , genome  6297] predictions:    5854/  10000 (58.54%), best:    5848/10000 (58.48%), error:     12721.16211, best error:     12603.59570 on epoch:    35, epoch:   37/50, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 890.8934936523s, input_fired_time: 7.6544294357, output_fired_time: 6.0447964668, propagate_forward_time: 341.6471557617, propagate_backward_time: 523.1999511719, weight_update_time: 0.5214017630, other_time: 12.3471679688
epoch time: 70.5820159912s, input_fired_time: 0.9315963984, output_fired_time: 0.0000000000, propagate_forward_time: 67.3748931885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2755279541
validation[          , genome  6297] predictions:    5817/  10000 (58.17%), best:    5848/10000 (58.48%), error:     12741.99609, best error:     12603.59570 on epoch:    35, epoch:   38/50, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 885.8236083984s, input_fired_time: 7.6651997566, output_fired_time: 6.1012368202, propagate_forward_time: 338.9208068848, propagate_backward_time: 521.5477294922, weight_update_time: 0.5263904333, other_time: 11.5886230469
epoch time: 71.6955871582s, input_fired_time: 0.9522866607, output_fired_time: 0.0000000000, propagate_forward_time: 68.5974349976, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1458663940
validation[          , genome  6297] predictions:    5816/  10000 (58.16%), best:    5848/10000 (58.48%), error:     12824.42480, best error:     12603.59570 on epoch:    35, epoch:   39/50, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 883.7377319336s, input_fired_time: 7.6451535225, output_fired_time: 6.1272912025, propagate_forward_time: 338.4283752441, propagate_backward_time: 520.2767333984, weight_update_time: 0.5289964676, other_time: 11.2601318359
epoch time: 70.2377319336s, input_fired_time: 0.9162331820, output_fired_time: 0.0000000000, propagate_forward_time: 67.2679214478, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0535736084
validation[          , genome  6297] predictions:    5850/  10000 (58.50%), best:    5848/10000 (58.48%), error:     12736.32227, best error:     12603.59570 on epoch:    35, epoch:   40/50, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 887.0078735352s, input_fired_time: 7.6934885979, output_fired_time: 6.0786232948, propagate_forward_time: 339.5175170898, propagate_backward_time: 522.1322631836, weight_update_time: 0.5319688320, other_time: 11.5859985352
epoch time: 69.5101013184s, input_fired_time: 0.9295155406, output_fired_time: 0.0000000000, propagate_forward_time: 66.4402694702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1403198242
validation[          , genome  6297] predictions:    5818/  10000 (58.18%), best:    5848/10000 (58.48%), error:     12823.68652, best error:     12603.59570 on epoch:    35, epoch:   41/50, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 887.3408203125s, input_fired_time: 7.6888070107, output_fired_time: 6.1076126099, propagate_forward_time: 339.3099060059, propagate_backward_time: 522.7749633789, weight_update_time: 0.5310187936, other_time: 11.4595336914
epoch time: 71.3296051025s, input_fired_time: 0.9504509568, output_fired_time: 0.0000000000, propagate_forward_time: 68.2077407837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1714096069
validation[          , genome  6297] predictions:    5872/  10000 (58.72%), best:    5872/10000 (58.72%), error:     12591.46875, best error:     12591.46875 on epoch:    42, epoch:   42/50, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 890.6288452148s, input_fired_time: 7.7118883133, output_fired_time: 6.1030001640, propagate_forward_time: 342.3764648438, propagate_backward_time: 522.4987792969, weight_update_time: 0.5274336934, other_time: 11.9386596680
epoch time: 70.8812332153s, input_fired_time: 0.9500204921, output_fired_time: 0.0000000000, propagate_forward_time: 67.7867050171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1445083618
validation[          , genome  6297] predictions:    5774/  10000 (57.74%), best:    5872/10000 (58.72%), error:     12662.94434, best error:     12591.46875 on epoch:    42, epoch:   43/50, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 887.1907958984s, input_fired_time: 7.6817975044, output_fired_time: 6.0843486786, propagate_forward_time: 340.6498107910, propagate_backward_time: 520.5811157227, weight_update_time: 0.5250378847, other_time: 12.1936645508
epoch time: 70.1276397705s, input_fired_time: 0.9237666726, output_fired_time: 0.0000000000, propagate_forward_time: 66.9147491455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2891235352
validation[          , genome  6297] predictions:    5870/  10000 (58.70%), best:    5870/10000 (58.70%), error:     12576.14160, best error:     12576.14160 on epoch:    44, epoch:   44/50, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 890.0151977539s, input_fired_time: 7.6796684265, output_fired_time: 6.1057949066, propagate_forward_time: 340.1386718750, propagate_backward_time: 523.7821655273, weight_update_time: 0.5257521272, other_time: 12.3088989258
epoch time: 72.9120559692s, input_fired_time: 0.9537160993, output_fired_time: 0.0000000000, propagate_forward_time: 69.6227798462, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3355636597
validation[          , genome  6297] predictions:    5879/  10000 (58.79%), best:    5870/10000 (58.70%), error:     12620.20508, best error:     12576.14160 on epoch:    44, epoch:   45/50, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 895.9542236328s, input_fired_time: 7.7422971725, output_fired_time: 6.1480731964, propagate_forward_time: 343.4397583008, propagate_backward_time: 526.7821655273, weight_update_time: 0.5281005502, other_time: 11.8419189453
epoch time: 72.1058654785s, input_fired_time: 0.9483697414, output_fired_time: 0.0000000000, propagate_forward_time: 68.9785156250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1789779663
validation[          , genome  6297] predictions:    5923/  10000 (59.23%), best:    5923/10000 (59.23%), error:     12516.34766, best error:     12516.34766 on epoch:    46, epoch:   46/50, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 893.7038574219s, input_fired_time: 7.7468619347, output_fired_time: 6.1923279762, propagate_forward_time: 341.8566284180, propagate_backward_time: 525.9616088867, weight_update_time: 0.5327748656, other_time: 11.9464111328
epoch time: 70.6909484863s, input_fired_time: 0.9554632306, output_fired_time: 0.0000000000, propagate_forward_time: 67.5336151123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2018737793
validation[          , genome  6297] predictions:    5943/  10000 (59.43%), best:    5943/10000 (59.43%), error:     12233.62695, best error:     12233.62695 on epoch:    47, epoch:   47/50, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 905.4783325195s, input_fired_time: 7.8211679459, output_fired_time: 6.2428307533, propagate_forward_time: 349.2206115723, propagate_backward_time: 530.6203002930, weight_update_time: 0.5339899659, other_time: 11.5734252930
epoch time: 71.8243484497s, input_fired_time: 0.9525278807, output_fired_time: 0.0000000000, propagate_forward_time: 68.7398452759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1319732666
validation[          , genome  6297] predictions:    6000/  10000 (60.00%), best:    6000/10000 (60.00%), error:     11978.50098, best error:     11978.50098 on epoch:    48, epoch:   48/50, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 894.1753540039s, input_fired_time: 7.7761459351, output_fired_time: 6.1484608650, propagate_forward_time: 342.8652954102, propagate_backward_time: 526.2333374023, weight_update_time: 0.5341472030, other_time: 11.1521606445
epoch time: 71.2289047241s, input_fired_time: 0.9505013824, output_fired_time: 0.0000000000, propagate_forward_time: 68.1635665894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1148376465
validation[          , genome  6297] predictions:    5949/  10000 (59.49%), best:    6000/10000 (60.00%), error:     12383.12988, best error:     11978.50098 on epoch:    48, epoch:   49/50, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 891.3833007813s, input_fired_time: 7.7540836334, output_fired_time: 6.1660532951, propagate_forward_time: 340.9499816895, propagate_backward_time: 525.1483764648, weight_update_time: 0.5351237655, other_time: 11.3648071289
epoch time: 72.0612487793s, input_fired_time: 0.9672854543, output_fired_time: 0.0000000000, propagate_forward_time: 69.1549758911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9389877319
validation[          , genome  6297] predictions:    5872/  10000 (58.72%), best:    6000/10000 (60.00%), error:     12464.48340, best error:     11978.50098 on epoch:    48, epoch:   50/50, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 358.0463867188s, input_fired_time: 4.7941350937, output_fired_time: 0.0000000000, propagate_forward_time: 343.1235656738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.1286926270
best training[          , genome  6297] predictions:   35937/  50000 (71.87%), best:    6000/10000 (60.00%), error:     40697.02344, best error:     11978.50098 on epoch:    48, epoch:   51/50, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 71.1352691650s, input_fired_time: 0.9544843435, output_fired_time: 0.0000000000, propagate_forward_time: 68.1840133667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9967727661
   testing[          , genome  6297] predictions:    6000/  10000 (60.00%), best:    6000/10000 (60.00%), error:     11978.50098, best error:     11978.50098 on epoch:    48, epoch:   51/50, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488
backpropagation finished successfully!
23:03:32 (15588): called boinc_finish(0)

</stderr_txt>
]]>