Nameexact_genome_1532008504_163_9005_1
Workunit3870206
Created20 Jul 2018, 20:46:07 UTC
Sent20 Jul 2018, 22:30:22 UTC
Report deadline4 Jan 2019, 12:10:53 UTC
Received25 Jul 2018, 19:01:23 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time2 days 8 hours 55 min 26 sec
CPU time2 days 8 hours 54 min 47 sec
Validate stateInitial
Credit0.00
Device peak FLOPS3.72 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size581.73 MB
Peak swap size601.33 MB
Peak disk usage14.61 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
ated_by_map:
1 change_size 1
reading 123 nodes.
reading 486 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
12:25:47 (12956): Can't acquire lockfile (32) - waiting 35s
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1532008504_163_9005.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1532008504_163_9005_1_r1609476701_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1532008504_163_9005.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1532008504_163_9005_1_r1609476701_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495202
read mu: 0.907485
read mu_delta: 0.948682
read initial_learning_rate: 0.000713535
read learning_rate: 7.25618e-05
read learning_rate_delta: 0.934981
read initial_weight_decay: 0.000476859
read weight_decay: 6.33493e-05
read weight_decay_delta: 0.942359
read batch_size: 89
read epsilon: 1e-07
read alpha: 0.098293
read input_dropout_probability: 0.00119593
read hidden_dropout_probability: 0.0993703
read velocity_reset: 1609
read epoch: 34
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 28
read number_validation_images: 10000
read best_validation_predictions: 6471
read best_validation_error: 10190.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 9005
read normal distribution: '0 1.0271909236908 1.18792617321014'
generator_str: '211865941'
read generator: 211865941
read generated_by_map:
1 change_size 1
reading 123 nodes.
reading 486 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1532008504_163_9005.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1532008504_163_9005_1_r1609476701_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.495202
read mu: 0.907485
read mu_delta: 0.948682
read initial_learning_rate: 0.000713535
read learning_rate: 7.25618e-05
read learning_rate_delta: 0.934981
read initial_weight_decay: 0.000476859
read weight_decay: 6.33493e-05
read weight_decay_delta: 0.942359
read batch_size: 89
read epsilon: 1e-07
read alpha: 0.098293
read input_dropout_probability: 0.00119593
read hidden_dropout_probability: 0.0993703
read velocity_reset: 1609
read epoch: 34
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 28
read number_validation_images: 10000
read best_validation_predictions: 6471
read best_validation_error: 10190.8
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 9005
read normal distribution: '0 1.0271909236908 1.18792617321014'
generator_str: '211865941'
read generator: 211865941
read generated_by_map:
1 change_size 1
reading 123 nodes.
reading 486 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 1290.77954101563s, input_fired_time: 23.9369201660156, output_fired_time: 8.20662689208984, propagate_forward_time: 459.078186035156, propagate_backward_time: 786.41796875, weight_update_time: 0.326971739530563, other_time: 13.1398315429688
epoch time: 96.0254821777344s, input_fired_time: 1.39388763904572, output_fired_time: 0, propagate_forward_time: 92.3434371948242, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.28815460205078
validation[          , genome  9005] predictions:    6502/  10000 (65.02%), best:    6471/10000 (64.71%), error:     10194.58887, best error:     10190.76465 on epoch:    28, epoch:   34/100, mu: 0.9074852467, learning_rate: 0.0000725618, weight_decay: 0.0000633493

epoch time: 1294.0246582031s, input_fired_time: 23.9844284058, output_fired_time: 8.2142467499, propagate_forward_time: 460.2947387695, propagate_backward_time: 788.5347900391, weight_update_time: 0.3271090090, other_time: 12.9965209961
epoch time: 96.0203781128s, input_fired_time: 1.3905150890, output_fired_time: 0.0000000000, propagate_forward_time: 92.3617172241, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2681427002
validation[          , genome  9005] predictions:    6495/  10000 (64.95%), best:    6495/10000 (64.95%), error:     10136.54102, best error:     10136.54102 on epoch:    35, epoch:   35/100, mu: 0.9117197394, learning_rate: 0.0000678439, weight_decay: 0.0000596977

epoch time: 1292.9447021484s, input_fired_time: 23.9818935394, output_fired_time: 8.2094497681, propagate_forward_time: 459.9257507324, propagate_backward_time: 787.8182983398, weight_update_time: 0.3278048635, other_time: 13.0092163086
epoch time: 96.3316726685s, input_fired_time: 1.3942612410, output_fired_time: 0.0000000000, propagate_forward_time: 92.6579208374, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2794876099
validation[          , genome  9005] predictions:    6463/  10000 (64.63%), best:    6495/10000 (64.95%), error:     10286.76953, best error:     10136.54102 on epoch:    35, epoch:   36/100, mu: 0.9157369137, learning_rate: 0.0000634328, weight_decay: 0.0000562567

epoch time: 1358.4256591797s, input_fired_time: 25.2125778198, output_fired_time: 8.6200828552, propagate_forward_time: 483.4936828613, propagate_backward_time: 827.5163574219, weight_update_time: 0.3419556916, other_time: 13.5830078125
epoch time: 115.8480758667s, input_fired_time: 1.6694257259, output_fired_time: 0.0000000000, propagate_forward_time: 111.5006256104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6780242920
validation[          , genome  9005] predictions:    6463/  10000 (64.63%), best:    6495/10000 (64.95%), error:     10193.41016, best error:     10136.54102 on epoch:    35, epoch:   37/100, mu: 0.9195479155, learning_rate: 0.0000593084, weight_decay: 0.0000530140

epoch time: 1557.1824951172s, input_fired_time: 28.8402652740, output_fired_time: 9.8617229462, propagate_forward_time: 554.9439697266, propagate_backward_time: 948.3085327148, weight_update_time: 0.3867097497, other_time: 15.2280883789
epoch time: 115.8028869629s, input_fired_time: 1.6732182503, output_fired_time: 0.0000000000, propagate_forward_time: 111.4631423950, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6665267944
validation[          , genome  9005] predictions:    6481/  10000 (64.81%), best:    6495/10000 (64.95%), error:     10153.52246, best error:     10136.54102 on epoch:    35, epoch:   38/100, mu: 0.9231633544, learning_rate: 0.0000554522, weight_decay: 0.0000499582

epoch time: 1558.0089111328s, input_fired_time: 28.8615264893, output_fired_time: 9.8666887283, propagate_forward_time: 555.2805175781, propagate_backward_time: 948.7971191406, weight_update_time: 0.3864099383, other_time: 15.2030029297
epoch time: 115.7889709473s, input_fired_time: 1.6583178043, output_fired_time: 0.0000000000, propagate_forward_time: 111.4577636719, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6728897095
validation[          , genome  9005] predictions:    6445/  10000 (64.45%), best:    6495/10000 (64.95%), error:     10247.01465, best error:     10136.54102 on epoch:    35, epoch:   39/100, mu: 0.9265932441, learning_rate: 0.0000518468, weight_decay: 0.0000470785

epoch time: 1556.9364013672s, input_fired_time: 28.8743934631, output_fired_time: 9.8585653305, propagate_forward_time: 554.8496093750, propagate_backward_time: 948.1529541016, weight_update_time: 0.3858709335, other_time: 15.2009277344
epoch time: 115.9467926025s, input_fired_time: 1.6755899191, output_fired_time: 0.0000000000, propagate_forward_time: 111.5994567871, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6717453003
validation[          , genome  9005] predictions:    6515/  10000 (65.15%), best:    6495/10000 (64.95%), error:     10166.57129, best error:     10136.54102 on epoch:    35, epoch:   40/100, mu: 0.9298471212, learning_rate: 0.0000484757, weight_decay: 0.0000443648

epoch time: 1557.3125000000s, input_fired_time: 28.8768138885, output_fired_time: 9.8615913391, propagate_forward_time: 554.8994140625, propagate_backward_time: 948.4830932617, weight_update_time: 0.3862869740, other_time: 15.1915893555
epoch time: 115.8254547119s, input_fired_time: 1.6770416498, output_fired_time: 0.0000000000, propagate_forward_time: 111.4779586792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6704559326
validation[          , genome  9005] predictions:    6551/  10000 (65.51%), best:    6551/10000 (65.51%), error:      9977.62988, best error:      9977.62988 on epoch:    41, epoch:   41/100, mu: 0.9329340458, learning_rate: 0.0000453239, weight_decay: 0.0000418076

epoch time: 1556.9240722656s, input_fired_time: 28.8913459778, output_fired_time: 9.8570470810, propagate_forward_time: 554.8846435547, propagate_backward_time: 948.1065063477, weight_update_time: 0.3860670924, other_time: 15.1845092773
epoch time: 115.7527542114s, input_fired_time: 1.6772749424, output_fired_time: 0.0000000000, propagate_forward_time: 111.4095001221, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6659774780
validation[          , genome  9005] predictions:    6569/  10000 (65.69%), best:    6551/10000 (65.51%), error:     10075.89551, best error:      9977.62988 on epoch:    41, epoch:   42/100, mu: 0.9358625412, learning_rate: 0.0000423770, weight_decay: 0.0000393977

epoch time: 1556.7966308594s, input_fired_time: 28.8747978210, output_fired_time: 9.8552055359, propagate_forward_time: 554.6524047852, propagate_backward_time: 948.2344360352, weight_update_time: 0.3865380287, other_time: 15.1798095703
epoch time: 115.8992691040s, input_fired_time: 1.6841897964, output_fired_time: 0.0000000000, propagate_forward_time: 111.5520095825, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6630706787
validation[          , genome  9005] predictions:    6576/  10000 (65.76%), best:    6551/10000 (65.51%), error:     10008.23535, best error:      9977.62988 on epoch:    41, epoch:   43/100, mu: 0.9386407733, learning_rate: 0.0000396217, weight_decay: 0.0000371268

epoch time: 1556.7926025391s, input_fired_time: 28.9084930420, output_fired_time: 9.8555822372, propagate_forward_time: 554.7817382813, propagate_backward_time: 948.0728149414, weight_update_time: 0.3865876794, other_time: 15.1740112305
epoch time: 115.9100570679s, input_fired_time: 1.6796543598, output_fired_time: 0.0000000000, propagate_forward_time: 111.5592651367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6711349487
validation[          , genome  9005] predictions:    6420/  10000 (64.20%), best:    6551/10000 (65.51%), error:     10252.43066, best error:      9977.62988 on epoch:    41, epoch:   44/100, mu: 0.9412764311, learning_rate: 0.0000370455, weight_decay: 0.0000349868

epoch time: 1556.5999755859s, input_fired_time: 28.9214859009, output_fired_time: 9.8579912186, propagate_forward_time: 554.6398315430, propagate_backward_time: 947.9763793945, weight_update_time: 0.3867090046, other_time: 15.2042236328
epoch time: 115.9491424561s, input_fired_time: 1.6859469414, output_fired_time: 0.0000000000, propagate_forward_time: 111.5780792236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6851196289
validation[          , genome  9005] predictions:    6599/  10000 (65.99%), best:    6599/10000 (65.99%), error:      9925.72363, best error:      9925.72363 on epoch:    45, epoch:   45/100, mu: 0.9437768459, learning_rate: 0.0000346368, weight_decay: 0.0000329701

epoch time: 1556.6209716797s, input_fired_time: 28.9234619141, output_fired_time: 9.8548641205, propagate_forward_time: 554.6319580078, propagate_backward_time: 948.0039672852, weight_update_time: 0.3868261874, other_time: 15.2067260742
epoch time: 115.9105453491s, input_fired_time: 1.6856272221, output_fired_time: 0.0000000000, propagate_forward_time: 111.5620498657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6628646851
validation[          , genome  9005] predictions:    6571/  10000 (65.71%), best:    6599/10000 (65.99%), error:      9948.92285, best error:      9925.72363 on epoch:    45, epoch:   46/100, mu: 0.9461489320, learning_rate: 0.0000323848, weight_decay: 0.0000310696

epoch time: 1556.8970947266s, input_fired_time: 28.9165725708, output_fired_time: 9.8558959961, propagate_forward_time: 554.7944946289, propagate_backward_time: 948.1104736328, weight_update_time: 0.3870550096, other_time: 15.2195434570
epoch time: 115.9198303223s, input_fired_time: 1.6834287643, output_fired_time: 0.0000000000, propagate_forward_time: 111.5654296875, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6709747314
validation[          , genome  9005] predictions:    6553/  10000 (65.53%), best:    6599/10000 (65.99%), error:     10115.37012, best error:      9925.72363 on epoch:    45, epoch:   47/100, mu: 0.9483993053, learning_rate: 0.0000302791, weight_decay: 0.0000292788

epoch time: 1557.0566406250s, input_fired_time: 28.9129047394, output_fired_time: 9.8572702408, propagate_forward_time: 554.9266967773, propagate_backward_time: 948.1721801758, weight_update_time: 0.3865774274, other_time: 15.1875000000
epoch time: 115.9166717529s, input_fired_time: 1.6909277439, output_fired_time: 0.0000000000, propagate_forward_time: 111.5520401001, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6737060547
validation[          , genome  9005] predictions:    6541/  10000 (65.41%), best:    6599/10000 (65.99%), error:      9988.72754, best error:      9925.72363 on epoch:    45, epoch:   48/100, mu: 0.9505341649, learning_rate: 0.0000283104, weight_decay: 0.0000275911

epoch time: 1557.2570800781s, input_fired_time: 28.9631843567, output_fired_time: 9.8583030701, propagate_forward_time: 554.8956909180, propagate_backward_time: 948.3421020508, weight_update_time: 0.3864628077, other_time: 15.1978759766
epoch time: 115.9560623169s, input_fired_time: 1.6893955469, output_fired_time: 0.0000000000, propagate_forward_time: 111.5892944336, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6773757935
validation[          , genome  9005] predictions:    6512/  10000 (65.12%), best:    6599/10000 (65.99%), error:     10051.68457, best error:      9925.72363 on epoch:    45, epoch:   49/100, mu: 0.9525594711, learning_rate: 0.0000264697, weight_decay: 0.0000260007

epoch time: 1557.5922851563s, input_fired_time: 28.9579296112, output_fired_time: 9.8598794937, propagate_forward_time: 555.0822753906, propagate_backward_time: 948.4847412109, weight_update_time: 0.3868215382, other_time: 15.2075195313
epoch time: 116.0189056396s, input_fired_time: 1.6931054592, output_fired_time: 0.0000000000, propagate_forward_time: 111.6455078125, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6802902222
validation[          , genome  9005] predictions:    6614/  10000 (66.14%), best:    6614/10000 (66.14%), error:      9807.20215, best error:      9807.20215 on epoch:    50, epoch:   50/100, mu: 0.9544808269, learning_rate: 0.0000247487, weight_decay: 0.0000245020

epoch time: 1557.7635498047s, input_fired_time: 28.9956283569, output_fired_time: 9.8739099503, propagate_forward_time: 555.0325927734, propagate_backward_time: 948.6478881836, weight_update_time: 0.3867518306, other_time: 15.2135620117
epoch time: 115.9692535400s, input_fired_time: 1.6987353563, output_fired_time: 0.0000000000, propagate_forward_time: 111.5909652710, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6795501709
validation[          , genome  9005] predictions:    6658/  10000 (66.58%), best:    6658/10000 (66.58%), error:      9788.41113, best error:      9788.41113 on epoch:    51, epoch:   51/100, mu: 0.9563035965, learning_rate: 0.0000231395, weight_decay: 0.0000230897

epoch time: 1557.4509277344s, input_fired_time: 29.0014171600, output_fired_time: 9.8602666855, propagate_forward_time: 554.9662475586, propagate_backward_time: 948.4109497070, weight_update_time: 0.3872525096, other_time: 15.2120361328
epoch time: 115.9048995972s, input_fired_time: 1.6988034248, output_fired_time: 0.0000000000, propagate_forward_time: 111.5370788574, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6690139771
validation[          , genome  9005] predictions:    6659/  10000 (66.59%), best:    6658/10000 (66.58%), error:      9888.41992, best error:      9788.41113 on epoch:    51, epoch:   52/100, mu: 0.9580328465, learning_rate: 0.0000216350, weight_decay: 0.0000217587

epoch time: 1558.2427978516s, input_fired_time: 29.0044193268, output_fired_time: 9.8665628433, propagate_forward_time: 555.2661743164, propagate_backward_time: 948.8491821289, weight_update_time: 0.3881626427, other_time: 15.2564697266
epoch time: 116.2709579468s, input_fired_time: 1.7000569105, output_fired_time: 0.0000000000, propagate_forward_time: 111.8826980591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6882019043
validation[          , genome  9005] predictions:    6529/  10000 (65.29%), best:    6658/10000 (66.58%), error:     10000.41211, best error:      9788.41113 on epoch:    51, epoch:   53/100, mu: 0.9596733451, learning_rate: 0.0000202283, weight_decay: 0.0000205045

epoch time: 1558.0457763672s, input_fired_time: 29.0021362305, output_fired_time: 9.8653554916, propagate_forward_time: 555.1637573242, propagate_backward_time: 948.7804565430, weight_update_time: 0.3878585100, other_time: 15.2341308594
epoch time: 116.0474929810s, input_fired_time: 1.7018933296, output_fired_time: 0.0000000000, propagate_forward_time: 111.6559295654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6896667480
validation[          , genome  9005] predictions:    6660/  10000 (66.60%), best:    6660/10000 (66.60%), error:      9766.94824, best error:      9766.94824 on epoch:    54, epoch:   54/100, mu: 0.9612296224, learning_rate: 0.0000189131, weight_decay: 0.0000193226

epoch time: 1557.2246093750s, input_fired_time: 29.0007457733, output_fired_time: 9.8609247208, propagate_forward_time: 554.8251953125, propagate_backward_time: 948.3110351563, weight_update_time: 0.3872962594, other_time: 15.2266845703
epoch time: 116.0191497803s, input_fired_time: 1.6961070299, output_fired_time: 0.0000000000, propagate_forward_time: 111.6413040161, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6817398071
validation[          , genome  9005] predictions:    6621/  10000 (66.21%), best:    6660/10000 (66.60%), error:      9839.23730, best error:      9766.94824 on epoch:    54, epoch:   55/100, mu: 0.9627060294, learning_rate: 0.0000176834, weight_decay: 0.0000182088

epoch time: 1557.7753906250s, input_fired_time: 29.0350208282, output_fired_time: 9.8655118942, propagate_forward_time: 555.0402221680, propagate_backward_time: 948.5891723633, weight_update_time: 0.3872082531, other_time: 15.2454833984
epoch time: 115.9784240723s, input_fired_time: 1.7007035017, output_fired_time: 0.0000000000, propagate_forward_time: 111.5947723389, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6829452515
validation[          , genome  9005] predictions:    6654/  10000 (66.54%), best:    6660/10000 (66.60%), error:      9788.84570, best error:      9766.94824 on epoch:    54, epoch:   56/100, mu: 0.9641066790, learning_rate: 0.0000165336, weight_decay: 0.0000171593

epoch time: 1558.0960693359s, input_fired_time: 29.0155200958, output_fired_time: 9.8629951477, propagate_forward_time: 555.3455810547, propagate_backward_time: 948.6366577148, weight_update_time: 0.3883064091, other_time: 15.2352905273
epoch time: 115.9669799805s, input_fired_time: 1.7013354301, output_fired_time: 0.0000000000, propagate_forward_time: 111.5829010010, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6827468872
validation[          , genome  9005] predictions:    6571/  10000 (65.71%), best:    6660/10000 (66.60%), error:      9891.43359, best error:      9766.94824 on epoch:    54, epoch:   57/100, mu: 0.9654354453, learning_rate: 0.0000154586, weight_decay: 0.0000161702

epoch time: 1558.0484619141s, input_fired_time: 29.0356807709, output_fired_time: 9.8671522141, propagate_forward_time: 555.2049560547, propagate_backward_time: 948.7011108398, weight_update_time: 0.3886478543, other_time: 15.2395629883
epoch time: 115.9847564697s, input_fired_time: 1.7001597881, output_fired_time: 0.0000000000, propagate_forward_time: 111.6118164063, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6727828979
validation[          , genome  9005] predictions:    6629/  10000 (66.29%), best:    6660/10000 (66.60%), error:      9826.39941, best error:      9766.94824 on epoch:    54, epoch:   58/100, mu: 0.9666960239, learning_rate: 0.0000144535, weight_decay: 0.0000152381

epoch time: 1558.0333251953s, input_fired_time: 29.0312385559, output_fired_time: 9.8632745743, propagate_forward_time: 555.0949707031, propagate_backward_time: 948.8193969727, weight_update_time: 0.3881014287, other_time: 15.2244262695
epoch time: 116.1117706299s, input_fired_time: 1.7123315334, output_fired_time: 0.0000000000, propagate_forward_time: 111.7240829468, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6753540039
validation[          , genome  9005] predictions:    6596/  10000 (65.96%), best:    6660/10000 (66.60%), error:      9801.19531, best error:      9766.94824 on epoch:    54, epoch:   59/100, mu: 0.9678919315, learning_rate: 0.0000135138, weight_decay: 0.0000143598

epoch time: 1558.1502685547s, input_fired_time: 29.0483741760, output_fired_time: 9.8650121689, propagate_forward_time: 555.3098754883, propagate_backward_time: 948.6957397461, weight_update_time: 0.3878763318, other_time: 15.2313232422
epoch time: 115.9837799072s, input_fired_time: 1.7106829882, output_fired_time: 0.0000000000, propagate_forward_time: 111.6030426025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6700515747
validation[          , genome  9005] predictions:    6634/  10000 (66.34%), best:    6634/10000 (66.34%), error:      9760.24707, best error:      9760.24707 on epoch:    60, epoch:   60/100, mu: 0.9690264463, learning_rate: 0.0000126351, weight_decay: 0.0000135321

epoch time: 1558.0136718750s, input_fired_time: 29.0538558960, output_fired_time: 9.8637771606, propagate_forward_time: 555.1731567383, propagate_backward_time: 948.6828002930, weight_update_time: 0.3884649873, other_time: 15.2401123047
epoch time: 115.9508895874s, input_fired_time: 1.7132359743, output_fired_time: 0.0000000000, propagate_forward_time: 111.5505294800, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6871261597
validation[          , genome  9005] predictions:    6678/  10000 (66.78%), best:    6678/10000 (66.78%), error:      9725.55664, best error:      9725.55664 on epoch:    61, epoch:   61/100, mu: 0.9701027870, learning_rate: 0.0000118136, weight_decay: 0.0000127520

epoch time: 1558.3679199219s, input_fired_time: 29.0690460205, output_fired_time: 9.8666372299, propagate_forward_time: 555.2929077148, propagate_backward_time: 948.8809814453, weight_update_time: 0.3882899582, other_time: 15.2583618164
epoch time: 116.0082397461s, input_fired_time: 1.7127362490, output_fired_time: 0.0000000000, propagate_forward_time: 111.6093750000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6861267090
validation[          , genome  9005] predictions:    6692/  10000 (66.92%), best:    6692/10000 (66.92%), error:      9665.51270, best error:      9665.51270 on epoch:    62, epoch:   62/100, mu: 0.9711238742, learning_rate: 0.0000110455, weight_decay: 0.0000120170

epoch time: 1558.0371093750s, input_fired_time: 29.0765743256, output_fired_time: 9.8633165359, propagate_forward_time: 555.2429809570, propagate_backward_time: 948.6317749023, weight_update_time: 0.3886139691, other_time: 15.2225341797
epoch time: 116.0173034668s, input_fired_time: 1.7211520672, output_fired_time: 0.0000000000, propagate_forward_time: 111.6179351807, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6782150269
validation[          , genome  9005] predictions:    6705/  10000 (67.05%), best:    6705/10000 (67.05%), error:      9660.07910, best error:      9660.07910 on epoch:    63, epoch:   63/100, mu: 0.9720925689, learning_rate: 0.0000103273, weight_decay: 0.0000113243

epoch time: 1558.3990478516s, input_fired_time: 29.0655021667, output_fired_time: 9.8668365479, propagate_forward_time: 555.3175659180, propagate_backward_time: 948.9042358398, weight_update_time: 0.3891771734, other_time: 15.2448730469
epoch time: 116.0129089355s, input_fired_time: 1.7106195688, output_fired_time: 0.0000000000, propagate_forward_time: 111.6291427612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6731491089
validation[          , genome  9005] predictions:    6553/  10000 (65.53%), best:    6705/10000 (67.05%), error:      9864.26563, best error:      9660.07910 on epoch:    63, epoch:   64/100, mu: 0.9730115533, learning_rate: 0.0000096558, weight_decay: 0.0000106716

epoch time: 1558.1500244141s, input_fired_time: 29.0901145935, output_fired_time: 9.8667325974, propagate_forward_time: 555.1381835938, propagate_backward_time: 948.8101196289, weight_update_time: 0.3884411752, other_time: 15.2449340820
epoch time: 115.9242172241s, input_fired_time: 1.7207828760, output_fired_time: 0.0000000000, propagate_forward_time: 111.5257263184, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6777114868
validation[          , genome  9005] predictions:    6679/  10000 (66.79%), best:    6705/10000 (67.05%), error:      9739.67383, best error:      9660.07910 on epoch:    63, epoch:   65/100, mu: 0.9738833904, learning_rate: 0.0000090280, weight_decay: 0.0000100565

epoch time: 1557.9412841797s, input_fired_time: 29.0903015137, output_fired_time: 9.8620090485, propagate_forward_time: 555.0364990234, propagate_backward_time: 948.7203369141, weight_update_time: 0.3887472749, other_time: 15.2320556641
epoch time: 116.2119293213s, input_fired_time: 1.7214072943, output_fired_time: 0.0000000000, propagate_forward_time: 111.8041915894, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6863327026
validation[          , genome  9005] predictions:    6733/  10000 (67.33%), best:    6733/10000 (67.33%), error:      9582.04199, best error:      9582.04199 on epoch:    66, epoch:   66/100, mu: 0.9747104645, learning_rate: 0.0000084410, weight_decay: 0.0000094768

epoch time: 1559.1838378906s, input_fired_time: 29.1484508514, output_fired_time: 9.8847255707, propagate_forward_time: 555.1018066406, propagate_backward_time: 949.6805419922, weight_update_time: 0.3895016015, other_time: 15.3682861328
epoch time: 115.9818344116s, input_fired_time: 1.7219212055, output_fired_time: 0.0000000000, propagate_forward_time: 111.5531539917, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7067565918
validation[          , genome  9005] predictions:    6689/  10000 (66.89%), best:    6733/10000 (67.33%), error:      9654.55566, best error:      9582.04199 on epoch:    66, epoch:   67/100, mu: 0.9754951000, learning_rate: 0.0000078922, weight_decay: 0.0000089305

epoch time: 1559.6862792969s, input_fired_time: 29.1516857147, output_fired_time: 9.8769645691, propagate_forward_time: 555.4159545898, propagate_backward_time: 949.8793945313, weight_update_time: 0.3914165497, other_time: 15.3622436523
epoch time: 115.9598083496s, input_fired_time: 1.7264944315, output_fired_time: 0.0000000000, propagate_forward_time: 111.5461654663, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6871490479
validation[          , genome  9005] predictions:    6732/  10000 (67.32%), best:    6733/10000 (67.33%), error:      9599.64453, best error:      9582.04199 on epoch:    66, epoch:   68/100, mu: 0.9762394428, learning_rate: 0.0000073791, weight_decay: 0.0000084158

epoch time: 1557.6610107422s, input_fired_time: 29.1148033142, output_fired_time: 9.8615226746, propagate_forward_time: 554.9828491211, propagate_backward_time: 948.4714965820, weight_update_time: 0.3894594610, other_time: 15.2303466797
epoch time: 115.9086608887s, input_fired_time: 1.7228453159, output_fired_time: 0.0000000000, propagate_forward_time: 111.5077667236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6780471802
validation[          , genome  9005] predictions:    6684/  10000 (66.84%), best:    6733/10000 (67.33%), error:      9743.97266, best error:      9582.04199 on epoch:    66, epoch:   69/100, mu: 0.9769455791, learning_rate: 0.0000068993, weight_decay: 0.0000079307

epoch time: 1557.6113281250s, input_fired_time: 29.1003875732, output_fired_time: 9.8616151810, propagate_forward_time: 555.0249633789, propagate_backward_time: 948.4013671875, weight_update_time: 0.3898876905, other_time: 15.2230834961
epoch time: 116.0149917603s, input_fired_time: 1.7243589163, output_fired_time: 0.0000000000, propagate_forward_time: 111.6090698242, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6815643311
validation[          , genome  9005] predictions:    6701/  10000 (67.01%), best:    6733/10000 (67.33%), error:      9584.90820, best error:      9582.04199 on epoch:    66, epoch:   70/100, mu: 0.9776154757, learning_rate: 0.0000064507, weight_decay: 0.0000074735

epoch time: 1557.7806396484s, input_fired_time: 29.1150207520, output_fired_time: 9.8596420288, propagate_forward_time: 554.9996948242, propagate_backward_time: 948.5744628906, weight_update_time: 0.3892683685, other_time: 15.2318725586
epoch time: 116.1423568726s, input_fired_time: 1.7249658108, output_fired_time: 0.0000000000, propagate_forward_time: 111.7378234863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6795654297
validation[          , genome  9005] predictions:    6704/  10000 (67.04%), best:    6733/10000 (67.33%), error:      9648.74902, best error:      9582.04199 on epoch:    66, epoch:   71/100, mu: 0.9782510400, learning_rate: 0.0000060313, weight_decay: 0.0000070427

epoch time: 1558.2120361328s, input_fired_time: 29.1341133118, output_fired_time: 9.8641510010, propagate_forward_time: 555.2572021484, propagate_backward_time: 948.7385253906, weight_update_time: 0.3902073801, other_time: 15.2180175781
epoch time: 116.0185165405s, input_fired_time: 1.7265484333, output_fired_time: 0.0000000000, propagate_forward_time: 111.6135635376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6784057617
validation[          , genome  9005] predictions:    6689/  10000 (66.89%), best:    6733/10000 (67.33%), error:      9639.40137, best error:      9582.04199 on epoch:    66, epoch:   72/100, mu: 0.9788540006, learning_rate: 0.0000056391, weight_decay: 0.0000066368

epoch time: 1558.2554931641s, input_fired_time: 29.1463928223, output_fired_time: 9.8692703247, propagate_forward_time: 555.2108154297, propagate_backward_time: 948.8107910156, weight_update_time: 0.3908530474, other_time: 15.2182617188
epoch time: 115.9255371094s, input_fired_time: 1.7243616581, output_fired_time: 0.0000000000, propagate_forward_time: 111.5255432129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6756286621
validation[          , genome  9005] predictions:    6680/  10000 (66.80%), best:    6733/10000 (67.33%), error:      9663.84961, best error:      9582.04199 on epoch:    66, epoch:   73/100, mu: 0.9794259667, learning_rate: 0.0000052725, weight_decay: 0.0000062542

epoch time: 1558.3937988281s, input_fired_time: 29.1221828461, output_fired_time: 9.8675918579, propagate_forward_time: 555.2689208984, propagate_backward_time: 948.9077148438, weight_update_time: 0.3916541934, other_time: 15.2274169922
epoch time: 115.9683761597s, input_fired_time: 1.7243099213, output_fired_time: 0.0000000000, propagate_forward_time: 111.5666580200, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6774063110
validation[          , genome  9005] predictions:    6676/  10000 (66.76%), best:    6733/10000 (67.33%), error:      9625.28613, best error:      9582.04199 on epoch:    66, epoch:   74/100, mu: 0.9799686074, learning_rate: 0.0000049297, weight_decay: 0.0000058937

epoch time: 1557.8173828125s, input_fired_time: 29.1131534576, output_fired_time: 9.8608360291, propagate_forward_time: 555.0083618164, propagate_backward_time: 948.6343383789, weight_update_time: 0.3902944922, other_time: 15.2006835938
epoch time: 115.9746170044s, input_fired_time: 1.7278885841, output_fired_time: 0.0000000000, propagate_forward_time: 111.5800704956, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6666564941
validation[          , genome  9005] predictions:    6724/  10000 (67.24%), best:    6733/10000 (67.33%), error:      9603.92383, best error:      9582.04199 on epoch:    66, epoch:   75/100, mu: 0.9804834127, learning_rate: 0.0000046091, weight_decay: 0.0000055540

epoch time: 1558.3347167969s, input_fired_time: 29.1530113220, output_fired_time: 9.8718681335, propagate_forward_time: 555.1427612305, propagate_backward_time: 948.9373168945, weight_update_time: 0.3909604847, other_time: 15.2298583984
epoch time: 115.9212570190s, input_fired_time: 1.7239460945, output_fired_time: 0.0000000000, propagate_forward_time: 111.5272369385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6700744629
validation[          , genome  9005] predictions:    6746/  10000 (67.46%), best:    6746/10000 (67.46%), error:      9531.32227, best error:      9531.32227 on epoch:    76, epoch:   76/100, mu: 0.9809718132, learning_rate: 0.0000043095, weight_decay: 0.0000052339

epoch time: 1557.3048095703s, input_fired_time: 29.1341362000, output_fired_time: 9.8558721542, propagate_forward_time: 554.9382324219, propagate_backward_time: 948.1621704102, weight_update_time: 0.3906851113, other_time: 15.2144165039
epoch time: 115.8972778320s, input_fired_time: 1.7294490337, output_fired_time: 0.0000000000, propagate_forward_time: 111.4946594238, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6731719971
validation[          , genome  9005] predictions:    6732/  10000 (67.32%), best:    6746/10000 (67.46%), error:      9546.29785, best error:      9531.32227 on epoch:    76, epoch:   77/100, mu: 0.9814351201, learning_rate: 0.0000040293, weight_decay: 0.0000049322

epoch time: 1557.0937500000s, input_fired_time: 29.1525917053, output_fired_time: 9.8553838730, propagate_forward_time: 554.9214477539, propagate_backward_time: 947.9655761719, weight_update_time: 0.3909506500, other_time: 15.1987915039
epoch time: 115.8537673950s, input_fired_time: 1.7271312475, output_fired_time: 0.0000000000, propagate_forward_time: 111.4647369385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6618957520
validation[          , genome  9005] predictions:    6755/  10000 (67.55%), best:    6746/10000 (67.46%), error:      9554.87109, best error:      9531.32227 on epoch:    76, epoch:   78/100, mu: 0.9818746448, learning_rate: 0.0000037673, weight_decay: 0.0000046479

epoch time: 1557.8187255859s, input_fired_time: 29.1502037048, output_fired_time: 9.8596982956, propagate_forward_time: 555.1056518555, propagate_backward_time: 948.4770507813, weight_update_time: 0.3916202188, other_time: 15.2261352539
epoch time: 115.9262619019s, input_fired_time: 1.7309985161, output_fired_time: 0.0000000000, propagate_forward_time: 111.5200958252, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6751708984
validation[          , genome  9005] predictions:    6744/  10000 (67.44%), best:    6744/10000 (67.44%), error:      9490.78418, best error:      9490.78418 on epoch:    79, epoch:   79/100, mu: 0.9822916389, learning_rate: 0.0000035223, weight_decay: 0.0000043800

epoch time: 1557.3887939453s, input_fired_time: 29.1333389282, output_fired_time: 9.8596343994, propagate_forward_time: 554.8845214844, propagate_backward_time: 948.3052978516, weight_update_time: 0.3922902942, other_time: 15.2060546875
epoch time: 115.9568939209s, input_fired_time: 1.7302088737, output_fired_time: 0.0000000000, propagate_forward_time: 111.5493774414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6773071289
validation[          , genome  9005] predictions:    6727/  10000 (67.27%), best:    6744/10000 (67.44%), error:      9544.25391, best error:      9490.78418 on epoch:    79, epoch:   80/100, mu: 0.9826872349, learning_rate: 0.0000032933, weight_decay: 0.0000041275

epoch time: 1556.3641357422s, input_fired_time: 29.1360073090, output_fired_time: 9.8537635803, propagate_forward_time: 554.5386352539, propagate_backward_time: 947.6496582031, weight_update_time: 0.3914938867, other_time: 15.1860961914
epoch time: 115.9362945557s, input_fired_time: 1.7314989567, output_fired_time: 0.0000000000, propagate_forward_time: 111.5307998657, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6739959717
validation[          , genome  9005] predictions:    6749/  10000 (67.49%), best:    6744/10000 (67.44%), error:      9492.86426, best error:      9490.78418 on epoch:    79, epoch:   81/100, mu: 0.9830625057, learning_rate: 0.0000030792, weight_decay: 0.0000038896

epoch time: 1556.3917236328s, input_fired_time: 29.1419658661, output_fired_time: 9.8535785675, propagate_forward_time: 554.6192016602, propagate_backward_time: 947.5942993164, weight_update_time: 0.3914102316, other_time: 15.1826171875
epoch time: 115.9914245605s, input_fired_time: 1.7316522598, output_fired_time: 0.0000000000, propagate_forward_time: 111.5905914307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6691818237
validation[          , genome  9005] predictions:    6692/  10000 (66.92%), best:    6744/10000 (67.44%), error:      9588.76563, best error:      9490.78418 on epoch:    79, epoch:   82/100, mu: 0.9834185243, learning_rate: 0.0000028790, weight_decay: 0.0000036654

epoch time: 1556.5012207031s, input_fired_time: 29.1352558136, output_fired_time: 9.8533620834, propagate_forward_time: 554.5770263672, propagate_backward_time: 947.7297363281, weight_update_time: 0.3925541043, other_time: 15.2058105469
epoch time: 115.9548416138s, input_fired_time: 1.7308884859, output_fired_time: 0.0000000000, propagate_forward_time: 111.5539703369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6699829102
validation[          , genome  9005] predictions:    6700/  10000 (67.00%), best:    6744/10000 (67.44%), error:      9556.00879, best error:      9490.78418 on epoch:    79, epoch:   83/100, mu: 0.9837562442, learning_rate: 0.0000026918, weight_decay: 0.0000034541

epoch time: 1556.2747802734s, input_fired_time: 29.1443576813, output_fired_time: 9.8569831848, propagate_forward_time: 554.4502563477, propagate_backward_time: 947.6179199219, weight_update_time: 0.3921352327, other_time: 15.2052612305
epoch time: 115.9019393921s, input_fired_time: 1.7308210135, output_fired_time: 0.0000000000, propagate_forward_time: 111.4985046387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6726150513
validation[          , genome  9005] predictions:    6722/  10000 (67.22%), best:    6744/10000 (67.44%), error:      9528.02930, best error:      9490.78418 on epoch:    79, epoch:   84/100, mu: 0.9840766788, learning_rate: 0.0000025168, weight_decay: 0.0000032550

epoch time: 1557.0781250000s, input_fired_time: 29.1548957825, output_fired_time: 9.8566570282, propagate_forward_time: 554.8804321289, propagate_backward_time: 947.9531860352, weight_update_time: 0.3934110999, other_time: 15.2329101563
epoch time: 115.9723815918s, input_fired_time: 1.7330354452, output_fired_time: 0.0000000000, propagate_forward_time: 111.5573348999, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6820144653
validation[          , genome  9005] predictions:    6751/  10000 (67.51%), best:    6751/10000 (67.51%), error:      9490.38965, best error:      9490.38965 on epoch:    85, epoch:   85/100, mu: 0.9843806624, learning_rate: 0.0000023531, weight_decay: 0.0000030674

epoch time: 1557.7094726563s, input_fired_time: 29.1866321564, output_fired_time: 9.8646306992, propagate_forward_time: 555.0493164063, propagate_backward_time: 948.3827514648, weight_update_time: 0.3937326074, other_time: 15.2261352539
epoch time: 115.9547500610s, input_fired_time: 1.7311779261, output_fired_time: 0.0000000000, propagate_forward_time: 111.5437240601, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6798477173
validation[          , genome  9005] predictions:    6773/  10000 (67.73%), best:    6751/10000 (67.51%), error:      9511.87109, best error:      9490.38965 on epoch:    85, epoch:   86/100, mu: 0.9846690297, learning_rate: 0.0000022001, weight_decay: 0.0000028906

epoch time: 1557.5718994141s, input_fired_time: 29.1725826263, output_fired_time: 9.8623924255, propagate_forward_time: 555.0054321289, propagate_backward_time: 948.2988891602, weight_update_time: 0.3944866061, other_time: 15.2325439453
epoch time: 116.0059661865s, input_fired_time: 1.7323411703, output_fired_time: 0.0000000000, propagate_forward_time: 111.6012954712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6723327637
validation[          , genome  9005] predictions:    6800/  10000 (68.00%), best:    6800/10000 (68.00%), error:      9465.90039, best error:      9465.90039 on epoch:    87, epoch:   87/100, mu: 0.9849426150, learning_rate: 0.0000020571, weight_decay: 0.0000027240

epoch time: 1557.4920654297s, input_fired_time: 29.1822967529, output_fired_time: 9.8603334427, propagate_forward_time: 555.0277709961, propagate_backward_time: 948.1888427734, weight_update_time: 0.3952301443, other_time: 15.2328491211
epoch time: 116.0423889160s, input_fired_time: 1.7368093729, output_fired_time: 0.0000000000, propagate_forward_time: 111.6284942627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6770858765
validation[          , genome  9005] predictions:    6778/  10000 (67.78%), best:    6778/10000 (67.78%), error:      9434.23242, best error:      9434.23242 on epoch:    88, epoch:   88/100, mu: 0.9852021337, learning_rate: 0.0000019233, weight_decay: 0.0000025670

epoch time: 1558.0059814453s, input_fired_time: 29.1921367645, output_fired_time: 9.8602542877, propagate_forward_time: 555.2491455078, propagate_backward_time: 948.4657592773, weight_update_time: 0.3946406841, other_time: 15.2387084961
epoch time: 115.8945007324s, input_fired_time: 1.7348207235, output_fired_time: 0.0000000000, propagate_forward_time: 111.4808425903, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6788406372
validation[          , genome  9005] predictions:    6728/  10000 (67.28%), best:    6778/10000 (67.78%), error:      9511.60449, best error:      9434.23242 on epoch:    88, epoch:   89/100, mu: 0.9854483604, learning_rate: 0.0000017983, weight_decay: 0.0000024190

epoch time: 1557.0915527344s, input_fired_time: 29.1616458893, output_fired_time: 9.8582458496, propagate_forward_time: 554.6635131836, propagate_backward_time: 948.1778564453, weight_update_time: 0.3956748247, other_time: 15.2302856445
epoch time: 115.8985366821s, input_fired_time: 1.7351009846, output_fired_time: 0.0000000000, propagate_forward_time: 111.4917526245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6716842651
validation[          , genome  9005] predictions:    6751/  10000 (67.51%), best:    6778/10000 (67.78%), error:      9468.72559, best error:      9434.23242 on epoch:    88, epoch:   90/100, mu: 0.9856819510, learning_rate: 0.0000016814, weight_decay: 0.0000022796

epoch time: 1558.4049072266s, input_fired_time: 29.2147560120, output_fired_time: 9.8680210114, propagate_forward_time: 555.0468139648, propagate_backward_time: 949.0289306641, weight_update_time: 0.3960371017, other_time: 15.2463989258
epoch time: 115.9450531006s, input_fired_time: 1.7362521887, output_fired_time: 0.0000000000, propagate_forward_time: 111.5277786255, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6810226440
validation[          , genome  9005] predictions:    6746/  10000 (67.46%), best:    6778/10000 (67.78%), error:      9495.99023, best error:      9434.23242 on epoch:    88, epoch:   91/100, mu: 0.9859035611, learning_rate: 0.0000015720, weight_decay: 0.0000021482

epoch time: 1557.6300048828s, input_fired_time: 29.1939640045, output_fired_time: 9.8615570068, propagate_forward_time: 554.9561767578, propagate_backward_time: 948.3499145508, weight_update_time: 0.3977552354, other_time: 15.2683715820
epoch time: 115.9995193481s, input_fired_time: 1.7399142981, output_fired_time: 0.0000000000, propagate_forward_time: 111.5746841431, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6849212646
validation[          , genome  9005] predictions:    6751/  10000 (67.51%), best:    6778/10000 (67.78%), error:      9450.34082, best error:      9434.23242 on epoch:    88, epoch:   92/100, mu: 0.9861137867, learning_rate: 0.0000014698, weight_decay: 0.0000020243

epoch time: 1558.7921142578s, input_fired_time: 29.2410297394, output_fired_time: 9.8711481094, propagate_forward_time: 555.3970947266, propagate_backward_time: 949.0280761719, weight_update_time: 0.3981298208, other_time: 15.2547607422
epoch time: 115.9358596802s, input_fired_time: 1.7367566824, output_fired_time: 0.0000000000, propagate_forward_time: 111.5156784058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6834259033
validation[          , genome  9005] predictions:    6785/  10000 (67.85%), best:    6778/10000 (67.78%), error:      9475.80859, best error:      9434.23242 on epoch:    88, epoch:   93/100, mu: 0.9863132238, learning_rate: 0.0000013743, weight_decay: 0.0000019077

epoch time: 1557.4737548828s, input_fired_time: 29.2007389069, output_fired_time: 9.8568181992, propagate_forward_time: 555.0325927734, propagate_backward_time: 948.1524047852, weight_update_time: 0.3982668221, other_time: 15.2312622070
epoch time: 116.2317352295s, input_fired_time: 1.7437390089, output_fired_time: 0.0000000000, propagate_forward_time: 111.7948532104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6931457520
validation[          , genome  9005] predictions:    6770/  10000 (67.70%), best:    6778/10000 (67.78%), error:      9435.10254, best error:      9434.23242 on epoch:    88, epoch:   94/100, mu: 0.9865024090, learning_rate: 0.0000012849, weight_decay: 0.0000017977

epoch time: 1557.7208251953s, input_fired_time: 29.1929321289, output_fired_time: 9.8619604111, propagate_forward_time: 555.0159912109, propagate_backward_time: 948.4158935547, weight_update_time: 0.3991943598, other_time: 15.2340087891
epoch time: 115.9592285156s, input_fired_time: 1.7379562855, output_fired_time: 0.0000000000, propagate_forward_time: 111.5506362915, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6706390381
validation[          , genome  9005] predictions:    6748/  10000 (67.48%), best:    6778/10000 (67.78%), error:      9441.67090, best error:      9434.23242 on epoch:    88, epoch:   95/100, mu: 0.9866818786, learning_rate: 0.0000012014, weight_decay: 0.0000016941

epoch time: 1557.0552978516s, input_fired_time: 29.1952037811, output_fired_time: 9.8575420380, propagate_forward_time: 554.7731323242, propagate_backward_time: 948.0101318359, weight_update_time: 0.3993056417, other_time: 15.2192993164
epoch time: 116.2005996704s, input_fired_time: 1.7413084507, output_fired_time: 0.0000000000, propagate_forward_time: 111.7857818604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6735076904
validation[          , genome  9005] predictions:    6740/  10000 (67.40%), best:    6778/10000 (67.78%), error:      9443.43164, best error:      9434.23242 on epoch:    88, epoch:   96/100, mu: 0.9868521690, learning_rate: 0.0000011233, weight_decay: 0.0000015964

epoch time: 1557.8427734375s, input_fired_time: 29.2039775848, output_fired_time: 9.8651199341, propagate_forward_time: 555.0195312500, propagate_backward_time: 948.4899291992, weight_update_time: 0.4009760618, other_time: 15.2642211914
epoch time: 116.2126007080s, input_fired_time: 1.7428869009, output_fired_time: 0.0000000000, propagate_forward_time: 111.7966003418, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6731109619
validation[          , genome  9005] predictions:    6792/  10000 (67.92%), best:    6792/10000 (67.92%), error:      9413.30469, best error:      9413.30469 on epoch:    97, epoch:   97/100, mu: 0.9870136976, learning_rate: 0.0000010502, weight_decay: 0.0000015044

epoch time: 1557.6456298828s, input_fired_time: 29.2093734741, output_fired_time: 9.8600540161, propagate_forward_time: 555.0142211914, propagate_backward_time: 948.3265380859, weight_update_time: 0.4015043080, other_time: 15.2354125977
epoch time: 115.9311828613s, input_fired_time: 1.7400228977, output_fired_time: 0.0000000000, propagate_forward_time: 111.5139160156, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6772460938
validation[          , genome  9005] predictions:    6775/  10000 (67.75%), best:    6792/10000 (67.92%), error:      9419.07324, best error:      9413.30469 on epoch:    97, epoch:   98/100, mu: 0.9871669412, learning_rate: 0.0000009819, weight_decay: 0.0000014177

epoch time: 1557.8597412109s, input_fired_time: 29.2134475708, output_fired_time: 9.8591289520, propagate_forward_time: 555.1704711914, propagate_backward_time: 948.3864135742, weight_update_time: 0.4030018151, other_time: 15.2302246094
epoch time: 115.8045425415s, input_fired_time: 1.7387026548, output_fired_time: 0.0000000000, propagate_forward_time: 111.3923416138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6735000610
validation[          , genome  9005] predictions:    6756/  10000 (67.56%), best:    6792/10000 (67.92%), error:      9417.94727, best error:      9413.30469 on epoch:    97, epoch:   99/100, mu: 0.9873123169, learning_rate: 0.0000009181, weight_decay: 0.0000013360

epoch time: 1557.7515869141s, input_fired_time: 29.2231616974, output_fired_time: 9.8632755280, propagate_forward_time: 554.9926757813, propagate_backward_time: 948.4278564453, weight_update_time: 0.4038811326, other_time: 15.2446289063
epoch time: 115.9977035522s, input_fired_time: 1.7391381264, output_fired_time: 0.0000000000, propagate_forward_time: 111.5752792358, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6832885742
validation[          , genome  9005] predictions:    6774/  10000 (67.74%), best:    6792/10000 (67.92%), error:      9419.42578, best error:      9413.30469 on epoch:    97, epoch:  100/100, mu: 0.9874502420, learning_rate: 0.0000008584, weight_decay: 0.0000012590

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 577.1896972656s, input_fired_time: 8.6793508530, output_fired_time: 0.0000000000, propagate_forward_time: 555.0845336914, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.4258422852
best training[          , genome  9005] predictions:   37030/  50000 (74.06%), best:    6792/10000 (67.92%), error:     39329.43359, best error:      9413.30469 on epoch:    97, epoch:  101/100, mu: 0.9875810742, learning_rate: 0.0000008026, weight_decay: 0.0000011864
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 116.1113739014s, input_fired_time: 1.7391095161, output_fired_time: 0.0000000000, propagate_forward_time: 111.6869583130, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6853027344
   testing[          , genome  9005] predictions:    6792/  10000 (67.92%), best:    6792/10000 (67.92%), error:      9413.30469, best error:      9413.30469 on epoch:    97, epoch:  101/100, mu: 0.9875810742, learning_rate: 0.0000008026, weight_decay: 0.0000011864
backpropagation finished successfully!
20:23:38 (18056): called boinc_finish(0)

</stderr_txt>
]]>