Nameexact_genome_1542495604_186_6217_0
Workunit4096273
Created18 Nov 2018, 4:26:57 UTC
Sent18 Nov 2018, 5:02:38 UTC
Report deadline1 Feb 2019, 5:24:39 UTC
Received20 Nov 2018, 12:14:25 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID13757
Run time19 hours 5 min 11 sec
CPU time18 hours 37 min 29 sec
Validate stateValid
Credit18,753.82
Device peak FLOPS4.19 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size532.50 MB
Peak swap size552.10 MB
Peak disk usage9.39 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>

validation[          , genome  6217] predictions:    4569/  10000 (45.69%), best:    6023/10000 (60.23%), error:     17112.49805, best error:     11893.38184 on epoch:     0, epoch:   21/100, mu: 0.8405837417, learning_rate: 0.0000024901, weight_decay: 0.0001936067

epoch time: 645.9417114258s, input_fired_time: 9.5416021347, output_fired_time: 3.4910373688, propagate_forward_time: 232.5923309326, propagate_backward_time: 392.3804931641, weight_update_time: 0.4458300471, other_time: 7.9362182617
epoch time: 48.6838302612s, input_fired_time: 0.5156883597, output_fired_time: 0.0000000000, propagate_forward_time: 46.9084739685, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2596664429
validation[          , genome  6217] predictions:    4499/  10000 (44.99%), best:    6023/10000 (60.23%), error:     17137.71484, best error:     11893.38184 on epoch:     0, epoch:   22/100, mu: 0.8485353589, learning_rate: 0.0000023305, weight_decay: 0.0001840879

epoch time: 653.7089233398s, input_fired_time: 9.6836442947, output_fired_time: 3.6682164669, propagate_forward_time: 234.7262268066, propagate_backward_time: 397.5533447266, weight_update_time: 0.4685320258, other_time: 8.0774841309
epoch time: 48.6043357849s, input_fired_time: 0.5286353230, output_fired_time: 0.0000000000, propagate_forward_time: 46.8210144043, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2546844482
validation[          , genome  6217] predictions:    4358/  10000 (43.58%), best:    6023/10000 (60.23%), error:     17086.74609, best error:     11893.38184 on epoch:     0, epoch:   23/100, mu: 0.8560637832, learning_rate: 0.0000021812, weight_decay: 0.0001750370

arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_186_6217.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542495604_186_6217_0_r2135591817_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from checkpoint file: 'checkpoint.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.518864
read mu: 0.863192
read mu_delta: 0.946782
read initial_learning_rate: 1e-05
read learning_rate: 2.04152e-06
read learning_rate_delta: 0.93594
read initial_weight_decay: 0.00055811
read weight_decay: 0.000166431
read weight_decay_delta: 0.950834
read batch_size: 94
read epsilon: 1e-07
read alpha: 0.0816428
read input_dropout_probability: 0.00121351
read hidden_dropout_probability: 0.102503
read velocity_reset: 1874
read epoch: 24
read max_epochs: 100
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 6023
read best_validation_error: 11893.4
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6217
read normal distribution: '1 0.139186546206474 -0.336117923259735'
generator_str: '1670283661'
read generator: 1670283661
read generated_by_map:
1 change_size_y 1
reading 66 nodes.
reading 250 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 50000
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
epoch time: 650.082092285156s, input_fired_time: 9.68718814849854, output_fired_time: 3.55819392204285, propagate_forward_time: 233.709091186523, propagate_backward_time: 394.816864013672, weight_update_time: 0.441880106925964, other_time: 8.31076049804688
epoch time: 55.9206161499023s, input_fired_time: 0.692298591136932, output_fired_time: 0, propagate_forward_time: 53.810188293457, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.41812896728516
validation[          , genome  6217] predictions:    4451/  10000 (44.51%), best:    6023/10000 (60.23%), error:     17024.49609, best error:     11893.38184 on epoch:     0, epoch:   24/100, mu: 0.8631916046, learning_rate: 0.0000020415, weight_decay: 0.0001664312

epoch time: 722.8641967773s, input_fired_time: 10.7690229416, output_fired_time: 3.9049425125, propagate_forward_time: 260.1777954102, propagate_backward_time: 438.7510986328, weight_update_time: 0.4926889539, other_time: 9.2612915039
epoch time: 52.9650115967s, input_fired_time: 0.5695617199, output_fired_time: 0.0000000000, propagate_forward_time: 51.0069198608, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3885307312
validation[          , genome  6217] predictions:    4505/  10000 (45.05%), best:    6023/10000 (60.23%), error:     17016.02148, best error:     11893.38184 on epoch:     0, epoch:   25/100, mu: 0.8699400425, learning_rate: 0.0000019107, weight_decay: 0.0001582484

epoch time: 729.3776245117s, input_fired_time: 10.8765792847, output_fired_time: 3.9693763256, propagate_forward_time: 262.3828125000, propagate_backward_time: 442.9544677734, weight_update_time: 0.5179510713, other_time: 9.1943969727
epoch time: 53.5835685730s, input_fired_time: 0.5923894644, output_fired_time: 0.0000000000, propagate_forward_time: 51.6106987000, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.3804817200
validation[          , genome  6217] predictions:    4440/  10000 (44.40%), best:    6023/10000 (60.23%), error:     17051.24609, best error:     11893.38184 on epoch:     0, epoch:   26/100, mu: 0.8763293624, learning_rate: 0.0000017883, weight_decay: 0.0001504680

epoch time: 680.9641723633s, input_fired_time: 9.9512176514, output_fired_time: 3.7070345879, propagate_forward_time: 244.2556915283, propagate_backward_time: 414.4065856934, weight_update_time: 0.4420237243, other_time: 8.6436462402
epoch time: 47.0161666870s, input_fired_time: 0.5009295344, output_fired_time: 0.0000000000, propagate_forward_time: 45.2929191589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2223167419
validation[          , genome  6217] predictions:    4548/  10000 (45.48%), best:    6023/10000 (60.23%), error:     16924.59961, best error:     11893.38184 on epoch:     0, epoch:   27/100, mu: 0.8823786378, learning_rate: 0.0000016738, weight_decay: 0.0001430701

epoch time: 627.5668945313s, input_fired_time: 9.2737150192, output_fired_time: 3.4153952599, propagate_forward_time: 225.6149749756, propagate_backward_time: 381.2756958008, weight_update_time: 0.4346981943, other_time: 7.9870605469
epoch time: 47.0046997070s, input_fired_time: 0.5122799277, output_fired_time: 0.0000000000, propagate_forward_time: 45.2558975220, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2365226746
validation[          , genome  6217] predictions:    4488/  10000 (44.88%), best:    6023/10000 (60.23%), error:     16876.69336, best error:     11893.38184 on epoch:     0, epoch:   28/100, mu: 0.8881059885, learning_rate: 0.0000015666, weight_decay: 0.0001360360

epoch time: 627.0919799805s, input_fired_time: 9.2776823044, output_fired_time: 3.4000594616, propagate_forward_time: 225.3170776367, propagate_backward_time: 381.1148986816, weight_update_time: 0.4367274642, other_time: 7.9822082520
epoch time: 47.0782890320s, input_fired_time: 0.5024116039, output_fired_time: 0.0000000000, propagate_forward_time: 45.3291587830, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2467193604
validation[          , genome  6217] predictions:    4530/  10000 (45.30%), best:    6023/10000 (60.23%), error:     16902.77148, best error:     11893.38184 on epoch:     0, epoch:   29/100, mu: 0.8935285807, learning_rate: 0.0000014662, weight_decay: 0.0001293477

epoch time: 625.9736938477s, input_fired_time: 9.2373952866, output_fired_time: 3.3972809315, propagate_forward_time: 224.9015197754, propagate_backward_time: 380.6164550781, weight_update_time: 0.4311572313, other_time: 7.8210754395
epoch time: 46.9276695251s, input_fired_time: 0.5060255527, output_fired_time: 0.0000000000, propagate_forward_time: 45.2115020752, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2101402283
validation[          , genome  6217] predictions:    4574/  10000 (45.74%), best:    6023/10000 (60.23%), error:     16851.03711, best error:     11893.38184 on epoch:     0, epoch:   30/100, mu: 0.8986625671, learning_rate: 0.0000013723, weight_decay: 0.0001229882

epoch time: 625.2470092773s, input_fired_time: 9.2599287033, output_fired_time: 3.4228360653, propagate_forward_time: 224.7092285156, propagate_backward_time: 380.0180053711, weight_update_time: 0.4305259883, other_time: 7.8369750977
epoch time: 46.8521385193s, input_fired_time: 0.5056968331, output_fired_time: 0.0000000000, propagate_forward_time: 45.1349182129, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2115249634
validation[          , genome  6217] predictions:    4588/  10000 (45.88%), best:    6023/10000 (60.23%), error:     16822.47656, best error:     11893.38184 on epoch:     0, epoch:   31/100, mu: 0.9035233259, learning_rate: 0.0000012844, weight_decay: 0.0001169413

epoch time: 625.3685913086s, input_fired_time: 9.2716665268, output_fired_time: 3.4398984909, propagate_forward_time: 225.2159271240, propagate_backward_time: 379.6325378418, weight_update_time: 0.4332343340, other_time: 7.8085632324
epoch time: 46.8230438232s, input_fired_time: 0.5062670708, output_fired_time: 0.0000000000, propagate_forward_time: 45.1126823425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2040939331
validation[          , genome  6217] predictions:    4564/  10000 (45.64%), best:    6023/10000 (60.23%), error:     16802.93555, best error:     11893.38184 on epoch:     0, epoch:   32/100, mu: 0.9081254005, learning_rate: 0.0000012021, weight_decay: 0.0001111918

epoch time: 625.5682373047s, input_fired_time: 9.2292451859, output_fired_time: 3.4342072010, propagate_forward_time: 225.1251831055, propagate_backward_time: 379.9629211426, weight_update_time: 0.4345331490, other_time: 7.8166809082
epoch time: 47.1508712769s, input_fired_time: 0.5034058690, output_fired_time: 0.0000000000, propagate_forward_time: 45.4612579346, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1862068176
validation[          , genome  6217] predictions:    4567/  10000 (45.67%), best:    6023/10000 (60.23%), error:     16793.45703, best error:     11893.38184 on epoch:     0, epoch:   33/100, mu: 0.9124825597, learning_rate: 0.0000011251, weight_decay: 0.0001057250

epoch time: 625.4854125977s, input_fired_time: 9.2814550400, output_fired_time: 3.4123682976, propagate_forward_time: 224.8089141846, propagate_backward_time: 380.1536254883, weight_update_time: 0.4393363595, other_time: 7.8291015625
epoch time: 47.0217628479s, input_fired_time: 0.5032121539, output_fired_time: 0.0000000000, propagate_forward_time: 45.3051071167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2134437561
validation[          , genome  6217] predictions:    4603/  10000 (46.03%), best:    6023/10000 (60.23%), error:     16799.79883, best error:     11893.38184 on epoch:     0, epoch:   34/100, mu: 0.9166078568, learning_rate: 0.0000010530, weight_decay: 0.0001005269

epoch time: 631.8126831055s, input_fired_time: 9.3017587662, output_fired_time: 3.4351391792, propagate_forward_time: 227.8883514404, propagate_backward_time: 383.2959289551, weight_update_time: 0.4337116182, other_time: 7.8915100098
epoch time: 46.9116554260s, input_fired_time: 0.5102744699, output_fired_time: 0.0000000000, propagate_forward_time: 45.1895904541, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2117919922
validation[          , genome  6217] predictions:    4563/  10000 (45.63%), best:    6023/10000 (60.23%), error:     16735.41016, best error:     11893.38184 on epoch:     0, epoch:   35/100, mu: 0.9205136299, learning_rate: 0.0000009856, weight_decay: 0.0000955844

epoch time: 626.3916625977s, input_fired_time: 9.2503423691, output_fired_time: 3.4321603775, propagate_forward_time: 225.1926574707, propagate_backward_time: 380.7050476074, weight_update_time: 0.4340550900, other_time: 7.8114013672
epoch time: 46.8563995361s, input_fired_time: 0.5030405521, output_fired_time: 0.0000000000, propagate_forward_time: 45.1417312622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2116279602
validation[          , genome  6217] predictions:    4489/  10000 (44.89%), best:    6023/10000 (60.23%), error:     16785.95117, best error:     11893.38184 on epoch:     0, epoch:   36/100, mu: 0.9242115617, learning_rate: 0.0000009224, weight_decay: 0.0000908849

epoch time: 625.5454711914s, input_fired_time: 9.2625970840, output_fired_time: 3.4096980095, propagate_forward_time: 224.9183654785, propagate_backward_time: 380.1385192871, weight_update_time: 0.4345731735, other_time: 7.8163452148
epoch time: 47.1183433533s, input_fired_time: 0.4951476455, output_fired_time: 0.0000000000, propagate_forward_time: 45.4034385681, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2197570801
validation[          , genome  6217] predictions:    4445/  10000 (44.45%), best:    6023/10000 (60.23%), error:     16783.71289, best error:     11893.38184 on epoch:     0, epoch:   37/100, mu: 0.9277126789, learning_rate: 0.0000008633, weight_decay: 0.0000864165

epoch time: 626.1302490234s, input_fired_time: 9.2446432114, output_fired_time: 3.4180176258, propagate_forward_time: 225.0193481445, propagate_backward_time: 380.6149291992, weight_update_time: 0.4328190386, other_time: 7.8333129883
epoch time: 46.9495010376s, input_fired_time: 0.5079586506, output_fired_time: 0.0000000000, propagate_forward_time: 45.2179107666, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2236328125
validation[          , genome  6217] predictions:    4692/  10000 (46.92%), best:    6023/10000 (60.23%), error:     16703.91797, best error:     11893.38184 on epoch:     0, epoch:   38/100, mu: 0.9310274720, learning_rate: 0.0000008080, weight_decay: 0.0000821678

epoch time: 625.6809082031s, input_fired_time: 9.2482194901, output_fired_time: 3.4157078266, propagate_forward_time: 224.9702758789, propagate_backward_time: 380.2261352539, weight_update_time: 0.4399964809, other_time: 7.8205566406
epoch time: 46.9490852356s, input_fired_time: 0.5088729858, output_fired_time: 0.0000000000, propagate_forward_time: 45.2282485962, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2119636536
validation[          , genome  6217] predictions:    4623/  10000 (46.23%), best:    6023/10000 (60.23%), error:     16700.04492, best error:     11893.38184 on epoch:     0, epoch:   39/100, mu: 0.9341658354, learning_rate: 0.0000007563, weight_decay: 0.0000781279

epoch time: 627.4612426758s, input_fired_time: 9.3050241470, output_fired_time: 3.4275579453, propagate_forward_time: 225.4758148193, propagate_backward_time: 381.4425659180, weight_update_time: 0.4324786067, other_time: 7.8102416992
epoch time: 46.9199409485s, input_fired_time: 0.5053147674, output_fired_time: 0.0000000000, propagate_forward_time: 45.2046432495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2099838257
validation[          , genome  6217] predictions:    4550/  10000 (45.50%), best:    6023/10000 (60.23%), error:     16721.89844, best error:     11893.38184 on epoch:     0, epoch:   40/100, mu: 0.9371371865, learning_rate: 0.0000007078, weight_decay: 0.0000742867

epoch time: 625.4243164063s, input_fired_time: 9.2377939224, output_fired_time: 3.4186992645, propagate_forward_time: 224.8531646729, propagate_backward_time: 380.0797729492, weight_update_time: 0.4348170161, other_time: 7.8348999023
epoch time: 46.9420471191s, input_fired_time: 0.5001941323, output_fired_time: 0.0000000000, propagate_forward_time: 45.2316513062, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2102012634
validation[          , genome  6217] predictions:    4599/  10000 (45.99%), best:    6023/10000 (60.23%), error:     16699.52539, best error:     11893.38184 on epoch:     0, epoch:   41/100, mu: 0.9399504066, learning_rate: 0.0000006625, weight_decay: 0.0000706343

epoch time: 625.7461547852s, input_fired_time: 9.2537336349, output_fired_time: 3.4086983204, propagate_forward_time: 224.9146423340, propagate_backward_time: 380.3275146484, weight_update_time: 0.4360451102, other_time: 7.8415832520
epoch time: 46.9381332397s, input_fired_time: 0.4990617633, output_fired_time: 0.0000000000, propagate_forward_time: 45.2069625854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2321090698
validation[          , genome  6217] predictions:    4631/  10000 (46.31%), best:    6023/10000 (60.23%), error:     16666.33789, best error:     11893.38184 on epoch:     0, epoch:   42/100, mu: 0.9426139593, learning_rate: 0.0000006200, weight_decay: 0.0000671615

epoch time: 625.5121459961s, input_fired_time: 9.2571411133, output_fired_time: 3.4207267761, propagate_forward_time: 224.8874969482, propagate_backward_time: 380.1325378418, weight_update_time: 0.4331572056, other_time: 7.8142395020
epoch time: 46.9200057983s, input_fired_time: 0.5058905482, output_fired_time: 0.0000000000, propagate_forward_time: 45.1906700134, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2234458923
validation[          , genome  6217] predictions:    4671/  10000 (46.71%), best:    6023/10000 (60.23%), error:     16651.95703, best error:     11893.38184 on epoch:     0, epoch:   43/100, mu: 0.9451357126, learning_rate: 0.0000005803, weight_decay: 0.0000638595

epoch time: 627.5421752930s, input_fired_time: 9.2923069000, output_fired_time: 3.4027819633, propagate_forward_time: 225.8309936523, propagate_backward_time: 381.2036437988, weight_update_time: 0.4318146408, other_time: 7.8124694824
epoch time: 46.8641967773s, input_fired_time: 0.4999418259, output_fired_time: 0.0000000000, propagate_forward_time: 45.1568069458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2074470520
validation[          , genome  6217] predictions:    4534/  10000 (45.34%), best:    6023/10000 (60.23%), error:     16720.27344, best error:     11893.38184 on epoch:     0, epoch:   44/100, mu: 0.9475232959, learning_rate: 0.0000005431, weight_decay: 0.0000607198

epoch time: 625.5558471680s, input_fired_time: 9.2713651657, output_fired_time: 3.4323053360, propagate_forward_time: 224.9713134766, propagate_backward_time: 380.0063171387, weight_update_time: 0.4322010279, other_time: 7.8745422363
epoch time: 46.9385299683s, input_fired_time: 0.5037594438, output_fired_time: 0.0000000000, propagate_forward_time: 45.2199172974, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2148513794
validation[          , genome  6217] predictions:    4498/  10000 (44.98%), best:    6023/10000 (60.23%), error:     16738.75391, best error:     11893.38184 on epoch:     0, epoch:   45/100, mu: 0.9497838020, learning_rate: 0.0000005083, weight_decay: 0.0000577344

epoch time: 625.8825683594s, input_fired_time: 9.2595596313, output_fired_time: 3.4273002148, propagate_forward_time: 225.3308105469, propagate_backward_time: 380.0494689941, weight_update_time: 0.4310052395, other_time: 7.8153991699
epoch time: 46.9722366333s, input_fired_time: 0.5062126517, output_fired_time: 0.0000000000, propagate_forward_time: 45.2636184692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2024040222
validation[          , genome  6217] predictions:    4701/  10000 (47.01%), best:    6023/10000 (60.23%), error:     16662.45898, best error:     11893.38184 on epoch:     0, epoch:   46/100, mu: 0.9519240260, learning_rate: 0.0000004758, weight_decay: 0.0000548959

epoch time: 625.7269897461s, input_fired_time: 9.2523326874, output_fired_time: 3.4125285149, propagate_forward_time: 225.1245117188, propagate_backward_time: 380.0853271484, weight_update_time: 0.4293390214, other_time: 7.8522949219
epoch time: 46.9228019714s, input_fired_time: 0.5002869368, output_fired_time: 0.0000000000, propagate_forward_time: 45.2096214294, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2128944397
validation[          , genome  6217] predictions:    4607/  10000 (46.07%), best:    6023/10000 (60.23%), error:     16623.02539, best error:     11893.38184 on epoch:     0, epoch:   47/100, mu: 0.9539503455, learning_rate: 0.0000004453, weight_decay: 0.0000521969

epoch time: 625.4914550781s, input_fired_time: 9.2464466095, output_fired_time: 3.4024291039, propagate_forward_time: 224.9688415527, propagate_backward_time: 380.0311279297, weight_update_time: 0.4332204759, other_time: 7.8426208496
epoch time: 46.8998374939s, input_fired_time: 0.4989165664, output_fired_time: 0.0000000000, propagate_forward_time: 45.1854782104, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2154426575
validation[          , genome  6217] predictions:    4667/  10000 (46.67%), best:    6023/10000 (60.23%), error:     16590.75391, best error:     11893.38184 on epoch:     0, epoch:   48/100, mu: 0.9558688402, learning_rate: 0.0000004168, weight_decay: 0.0000496306

epoch time: 624.7719116211s, input_fired_time: 9.2393245697, output_fired_time: 3.4192633629, propagate_forward_time: 224.6190490723, propagate_backward_time: 379.7056579590, weight_update_time: 0.4333965480, other_time: 7.7886352539
epoch time: 46.9007911682s, input_fired_time: 0.5004988909, output_fired_time: 0.0000000000, propagate_forward_time: 45.1989326477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2013587952
validation[          , genome  6217] predictions:    4584/  10000 (45.84%), best:    6023/10000 (60.23%), error:     16638.25781, best error:     11893.38184 on epoch:     0, epoch:   49/100, mu: 0.9576852322, learning_rate: 0.0000003901, weight_decay: 0.0000471904

epoch time: 625.8704833984s, input_fired_time: 9.2377681732, output_fired_time: 3.4192204475, propagate_forward_time: 225.2081146240, propagate_backward_time: 380.1638488770, weight_update_time: 0.4327092171, other_time: 7.8414611816
epoch time: 46.9022178650s, input_fired_time: 0.5011432171, output_fired_time: 0.0000000000, propagate_forward_time: 45.1904792786, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2105941772
validation[          , genome  6217] predictions:    4659/  10000 (46.59%), best:    6023/10000 (60.23%), error:     16656.62500, best error:     11893.38184 on epoch:     0, epoch:   50/100, mu: 0.9594049454, learning_rate: 0.0000003651, weight_decay: 0.0000448703

epoch time: 624.8460083008s, input_fired_time: 9.2166938782, output_fired_time: 3.4072985649, propagate_forward_time: 224.5705413818, propagate_backward_time: 379.8463134766, weight_update_time: 0.4566795528, other_time: 7.8051757813
epoch time: 46.7747306824s, input_fired_time: 0.4987232089, output_fired_time: 0.0000000000, propagate_forward_time: 45.0613784790, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2146301270
validation[          , genome  6217] predictions:    4670/  10000 (46.70%), best:    6023/10000 (60.23%), error:     16645.10156, best error:     11893.38184 on epoch:     0, epoch:   51/100, mu: 0.9610331655, learning_rate: 0.0000003417, weight_decay: 0.0000426642

epoch time: 624.5749511719s, input_fired_time: 9.2494497299, output_fired_time: 3.4114239216, propagate_forward_time: 224.5174407959, propagate_backward_time: 379.6308593750, weight_update_time: 0.4303977489, other_time: 7.7657470703
epoch time: 46.8426055908s, input_fired_time: 0.5059655309, output_fired_time: 0.0000000000, propagate_forward_time: 45.1467475891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1898918152
validation[          , genome  6217] predictions:    4681/  10000 (46.81%), best:    6023/10000 (60.23%), error:     16605.85547, best error:     11893.38184 on epoch:     0, epoch:   52/100, mu: 0.9625747204, learning_rate: 0.0000003198, weight_decay: 0.0000405666

epoch time: 624.6824340820s, input_fired_time: 9.2655544281, output_fired_time: 3.4012980461, propagate_forward_time: 224.5650024414, propagate_backward_time: 379.6626281738, weight_update_time: 0.4442955554, other_time: 7.7879333496
epoch time: 46.7365188599s, input_fired_time: 0.5045883656, output_fired_time: 0.0000000000, propagate_forward_time: 45.0221710205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2097587585
validation[          , genome  6217] predictions:    4580/  10000 (45.80%), best:    6023/10000 (60.23%), error:     16627.50781, best error:     11893.38184 on epoch:     0, epoch:   53/100, mu: 0.9640342593, learning_rate: 0.0000002993, weight_decay: 0.0000385721

epoch time: 633.5253295898s, input_fired_time: 9.4592475891, output_fired_time: 3.4653382301, propagate_forward_time: 227.9468383789, propagate_backward_time: 384.8119812012, weight_update_time: 0.4354983270, other_time: 7.8419494629
epoch time: 47.1799697876s, input_fired_time: 0.5027123094, output_fired_time: 0.0000000000, propagate_forward_time: 45.4852294922, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1920280457
validation[          , genome  6217] predictions:    4684/  10000 (46.84%), best:    6023/10000 (60.23%), error:     16645.77930, best error:     11893.38184 on epoch:     0, epoch:   54/100, mu: 0.9654160738, learning_rate: 0.0000002802, weight_decay: 0.0000366757

epoch time: 618.9273071289s, input_fired_time: 9.1486940384, output_fired_time: 3.3899784088, propagate_forward_time: 222.3933258057, propagate_backward_time: 376.4424438477, weight_update_time: 0.4257148802, other_time: 7.5529174805
epoch time: 46.4836196899s, input_fired_time: 0.4957088530, output_fired_time: 0.0000000000, propagate_forward_time: 44.8191833496, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1687278748
validation[          , genome  6217] predictions:    4709/  10000 (47.09%), best:    6023/10000 (60.23%), error:     16620.08984, best error:     11893.38184 on epoch:     0, epoch:   55/100, mu: 0.9667243958, learning_rate: 0.0000002622, weight_decay: 0.0000348725

epoch time: 625.2351684570s, input_fired_time: 9.2652359009, output_fired_time: 3.4176955223, propagate_forward_time: 224.6748657227, propagate_backward_time: 380.0641784668, weight_update_time: 0.4482493401, other_time: 7.8131408691
epoch time: 47.2731666565s, input_fired_time: 0.4991175234, output_fired_time: 0.0000000000, propagate_forward_time: 45.5583839417, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2156639099
validation[          , genome  6217] predictions:    4627/  10000 (46.27%), best:    6023/10000 (60.23%), error:     16583.55469, best error:     11893.38184 on epoch:     0, epoch:   56/100, mu: 0.9679630995, learning_rate: 0.0000002454, weight_decay: 0.0000331579

epoch time: 624.7195434570s, input_fired_time: 9.2232904434, output_fired_time: 3.3966989517, propagate_forward_time: 224.5340576172, propagate_backward_time: 379.8154296875, weight_update_time: 0.4299258292, other_time: 7.7500610352
epoch time: 46.8437728882s, input_fired_time: 0.4998403490, output_fired_time: 0.0000000000, propagate_forward_time: 45.1403923035, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2035408020
validation[          , genome  6217] predictions:    4682/  10000 (46.82%), best:    6023/10000 (60.23%), error:     16626.66992, best error:     11893.38184 on epoch:     0, epoch:   57/100, mu: 0.9691358805, learning_rate: 0.0000002297, weight_decay: 0.0000315277

epoch time: 625.6007690430s, input_fired_time: 9.2676076889, output_fired_time: 3.4019229412, propagate_forward_time: 225.1806335449, propagate_backward_time: 379.9555664063, weight_update_time: 0.4308059216, other_time: 7.7950744629
epoch time: 46.9771690369s, input_fired_time: 0.4980389178, output_fired_time: 0.0000000000, propagate_forward_time: 45.2653007507, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2138290405
validation[          , genome  6217] predictions:    4617/  10000 (46.17%), best:    6023/10000 (60.23%), error:     16663.24609, best error:     11893.38184 on epoch:     0, epoch:   58/100, mu: 0.9702461958, learning_rate: 0.0000002150, weight_decay: 0.0000299776

epoch time: 625.7532958984s, input_fired_time: 9.2327899933, output_fired_time: 3.4189851284, propagate_forward_time: 224.8903656006, propagate_backward_time: 380.3682556152, weight_update_time: 0.4429130554, other_time: 7.8428649902
epoch time: 46.9480667114s, input_fired_time: 0.5069133043, output_fired_time: 0.0000000000, propagate_forward_time: 45.2338676453, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2072868347
validation[          , genome  6217] predictions:    4696/  10000 (46.96%), best:    6023/10000 (60.23%), error:     16581.48828, best error:     11893.38184 on epoch:     0, epoch:   59/100, mu: 0.9712974429, learning_rate: 0.0000002012, weight_decay: 0.0000285037

epoch time: 625.9662475586s, input_fired_time: 9.2680025101, output_fired_time: 3.4294157028, propagate_forward_time: 225.0597534180, propagate_backward_time: 380.3775329590, weight_update_time: 0.4425750971, other_time: 7.8315124512
epoch time: 46.9174766541s, input_fired_time: 0.5070781708, output_fired_time: 0.0000000000, propagate_forward_time: 45.1977500916, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2126502991
validation[          , genome  6217] predictions:    4652/  10000 (46.52%), best:    6023/10000 (60.23%), error:     16643.52539, best error:     11893.38184 on epoch:     0, epoch:   60/100, mu: 0.9722927809, learning_rate: 0.0000001883, weight_decay: 0.0000271023

epoch time: 629.3318481445s, input_fired_time: 9.3004932404, output_fired_time: 3.4688220024, propagate_forward_time: 226.2580413818, propagate_backward_time: 382.4610290527, weight_update_time: 0.4412395656, other_time: 7.8434753418
epoch time: 47.3078842163s, input_fired_time: 0.5081005692, output_fired_time: 0.0000000000, propagate_forward_time: 45.5983543396, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2014274597
validation[          , genome  6217] predictions:    4627/  10000 (46.27%), best:    6023/10000 (60.23%), error:     16612.29492, best error:     11893.38184 on epoch:     0, epoch:   61/100, mu: 0.9732351303, learning_rate: 0.0000001763, weight_decay: 0.0000257698

epoch time: 624.6265869141s, input_fired_time: 9.2384252548, output_fired_time: 3.4170486927, propagate_forward_time: 224.7399139404, propagate_backward_time: 379.5373535156, weight_update_time: 0.4325763583, other_time: 7.6938476563
epoch time: 46.5091400146s, input_fired_time: 0.4963400364, output_fired_time: 0.0000000000, propagate_forward_time: 44.8566169739, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1561813354
validation[          , genome  6217] predictions:    4629/  10000 (46.29%), best:    6023/10000 (60.23%), error:     16658.28320, best error:     11893.38184 on epoch:     0, epoch:   62/100, mu: 0.9741272926, learning_rate: 0.0000001650, weight_decay: 0.0000245028

epoch time: 625.8540039063s, input_fired_time: 9.2590885162, output_fired_time: 3.4592447281, propagate_forward_time: 224.9083862305, propagate_backward_time: 380.5341491699, weight_update_time: 0.4300940931, other_time: 7.6931457520
epoch time: 47.4677848816s, input_fired_time: 0.5102133155, output_fired_time: 0.0000000000, propagate_forward_time: 45.7483215332, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2092514038
validation[          , genome  6217] predictions:    4598/  10000 (45.98%), best:    6023/10000 (60.23%), error:     16628.08008, best error:     11893.38184 on epoch:     0, epoch:   63/100, mu: 0.9749720097, learning_rate: 0.0000001544, weight_decay: 0.0000232981

epoch time: 624.7506103516s, input_fired_time: 9.2492723465, output_fired_time: 3.4028773308, propagate_forward_time: 224.8913269043, propagate_backward_time: 379.5410461426, weight_update_time: 0.4351059198, other_time: 7.6660766602
epoch time: 46.2710227966s, input_fired_time: 0.4950354993, output_fired_time: 0.0000000000, propagate_forward_time: 44.6133384705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1626472473
validation[          , genome  6217] predictions:    4700/  10000 (47.00%), best:    6023/10000 (60.23%), error:     16595.41406, best error:     11893.38184 on epoch:     0, epoch:   64/100, mu: 0.9757717848, learning_rate: 0.0000001445, weight_decay: 0.0000221526

epoch time: 617.5097045898s, input_fired_time: 9.1179876328, output_fired_time: 3.3597617149, propagate_forward_time: 222.2611846924, propagate_backward_time: 375.2661132813, weight_update_time: 0.4261692762, other_time: 7.5046997070
epoch time: 46.2111091614s, input_fired_time: 0.4943692386, output_fired_time: 0.0000000000, propagate_forward_time: 44.5558319092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1609077454
validation[          , genome  6217] predictions:    4581/  10000 (45.81%), best:    6023/10000 (60.23%), error:     16618.52930, best error:     11893.38184 on epoch:     0, epoch:   65/100, mu: 0.9765290022, learning_rate: 0.0000001352, weight_decay: 0.0000210635

epoch time: 616.4558105469s, input_fired_time: 9.0974807739, output_fired_time: 3.3412220478, propagate_forward_time: 221.6824035645, propagate_backward_time: 374.8439025879, weight_update_time: 0.4257378280, other_time: 7.4907836914
epoch time: 46.2277565002s, input_fired_time: 0.4947582483, output_fired_time: 0.0000000000, propagate_forward_time: 44.5757789612, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1572189331
validation[          , genome  6217] predictions:    4711/  10000 (47.11%), best:    6023/10000 (60.23%), error:     16655.10547, best error:     11893.38184 on epoch:     0, epoch:   66/100, mu: 0.9772459269, learning_rate: 0.0000001266, weight_decay: 0.0000200279

epoch time: 615.9532470703s, input_fired_time: 9.1473016739, output_fired_time: 3.3475959301, propagate_forward_time: 221.6751556396, propagate_backward_time: 374.2675170898, weight_update_time: 0.4269477427, other_time: 7.5156860352
epoch time: 46.2302093506s, input_fired_time: 0.4979527891, output_fired_time: 0.0000000000, propagate_forward_time: 44.5720291138, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1602287292
validation[          , genome  6217] predictions:    4683/  10000 (46.83%), best:    6023/10000 (60.23%), error:     16640.18359, best error:     11893.38184 on epoch:     0, epoch:   67/100, mu: 0.9779246449, learning_rate: 0.0000001185, weight_decay: 0.0000190432

epoch time: 616.5307617188s, input_fired_time: 9.1093378067, output_fired_time: 3.3532340527, propagate_forward_time: 221.6622619629, propagate_backward_time: 374.9000854492, weight_update_time: 0.4240219295, other_time: 7.5058898926
epoch time: 46.2871971130s, input_fired_time: 0.4958165884, output_fired_time: 0.0000000000, propagate_forward_time: 44.6120681763, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1793136597
validation[          , genome  6217] predictions:    4718/  10000 (47.18%), best:    6023/10000 (60.23%), error:     16628.91016, best error:     11893.38184 on epoch:     0, epoch:   68/100, mu: 0.9785672426, learning_rate: 0.0000001109, weight_decay: 0.0000181069

epoch time: 616.7655029297s, input_fired_time: 9.1371059418, output_fired_time: 3.3666784763, propagate_forward_time: 221.7050018311, propagate_backward_time: 374.9756469727, weight_update_time: 0.4277373552, other_time: 7.5810546875
epoch time: 46.1985054016s, input_fired_time: 0.4959069192, output_fired_time: 0.0000000000, propagate_forward_time: 44.5247802734, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1778182983
validation[          , genome  6217] predictions:    4647/  10000 (46.47%), best:    6023/10000 (60.23%), error:     16632.83398, best error:     11893.38184 on epoch:     0, epoch:   69/100, mu: 0.9791756868, learning_rate: 0.0000001038, weight_decay: 0.0000172167

epoch time: 616.6034545898s, input_fired_time: 9.1220874786, output_fired_time: 3.3558752537, propagate_forward_time: 221.5532989502, propagate_backward_time: 374.9505004883, weight_update_time: 0.4285978973, other_time: 7.6217041016
epoch time: 46.2560615540s, input_fired_time: 0.4945174456, output_fired_time: 0.0000000000, propagate_forward_time: 44.5958137512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1657295227
validation[          , genome  6217] predictions:    4614/  10000 (46.14%), best:    6023/10000 (60.23%), error:     16669.39258, best error:     11893.38184 on epoch:     0, epoch:   70/100, mu: 0.9797517061, learning_rate: 0.0000000971, weight_decay: 0.0000163702

epoch time: 616.6981811523s, input_fired_time: 9.1135110855, output_fired_time: 3.3478517532, propagate_forward_time: 221.9184265137, propagate_backward_time: 374.7561645508, weight_update_time: 0.4259762168, other_time: 7.5622253418
epoch time: 46.3590126038s, input_fired_time: 0.4956199527, output_fired_time: 0.0000000000, propagate_forward_time: 44.6973228455, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1660690308
validation[          , genome  6217] predictions:    4620/  10000 (46.20%), best:    6023/10000 (60.23%), error:     16627.29102, best error:     11893.38184 on epoch:     0, epoch:   71/100, mu: 0.9802970886, learning_rate: 0.0000000909, weight_decay: 0.0000155654

epoch time: 616.1306152344s, input_fired_time: 9.1096191406, output_fired_time: 3.3665926456, propagate_forward_time: 221.4101409912, propagate_backward_time: 374.6239929199, weight_update_time: 0.4263633490, other_time: 7.6202697754
epoch time: 46.3281021118s, input_fired_time: 0.4934812784, output_fired_time: 0.0000000000, propagate_forward_time: 44.6640129089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1706085205
validation[          , genome  6217] predictions:    4699/  10000 (46.99%), best:    6023/10000 (60.23%), error:     16629.19531, best error:     11893.38184 on epoch:     0, epoch:   72/100, mu: 0.9808134437, learning_rate: 0.0000000851, weight_decay: 0.0000148001

epoch time: 616.5096435547s, input_fired_time: 9.1368093491, output_fired_time: 3.3658719063, propagate_forward_time: 221.7338409424, propagate_backward_time: 374.7148132324, weight_update_time: 0.4246995747, other_time: 7.5583801270
epoch time: 46.3004035950s, input_fired_time: 0.5000824332, output_fired_time: 0.0000000000, propagate_forward_time: 44.6428604126, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1574592590
validation[          , genome  6217] predictions:    4640/  10000 (46.40%), best:    6023/10000 (60.23%), error:     16623.63867, best error:     11893.38184 on epoch:     0, epoch:   73/100, mu: 0.9813023210, learning_rate: 0.0000000796, weight_decay: 0.0000140724

epoch time: 616.7490844727s, input_fired_time: 9.1285057068, output_fired_time: 3.3570051193, propagate_forward_time: 221.7624816895, propagate_backward_time: 374.9443359375, weight_update_time: 0.4253960848, other_time: 7.5567932129
epoch time: 46.2371749878s, input_fired_time: 0.4929486215, output_fired_time: 0.0000000000, propagate_forward_time: 44.5502624512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1939620972
validation[          , genome  6217] predictions:    4697/  10000 (46.97%), best:    6023/10000 (60.23%), error:     16638.20703, best error:     11893.38184 on epoch:     0, epoch:   74/100, mu: 0.9817652106, learning_rate: 0.0000000745, weight_decay: 0.0000133805

epoch time: 616.1462402344s, input_fired_time: 9.1115713120, output_fired_time: 3.3496003151, propagate_forward_time: 221.6456604004, propagate_backward_time: 374.4312744141, weight_update_time: 0.4248739183, other_time: 7.6081237793
epoch time: 46.2634849548s, input_fired_time: 0.4932208061, output_fired_time: 0.0000000000, propagate_forward_time: 44.6053924561, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1648712158
validation[          , genome  6217] predictions:    4672/  10000 (46.72%), best:    6023/10000 (60.23%), error:     16650.69922, best error:     11893.38184 on epoch:     0, epoch:   75/100, mu: 0.9822034240, learning_rate: 0.0000000698, weight_decay: 0.0000127227

epoch time: 616.4322509766s, input_fired_time: 9.1538314819, output_fired_time: 3.3478786945, propagate_forward_time: 221.5825805664, propagate_backward_time: 374.7763061523, weight_update_time: 0.4266664386, other_time: 7.5716552734
epoch time: 46.2368698120s, input_fired_time: 0.4941943884, output_fired_time: 0.0000000000, propagate_forward_time: 44.5642471313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1784286499
validation[          , genome  6217] predictions:    4625/  10000 (46.25%), best:    6023/10000 (60.23%), error:     16656.16406, best error:     11893.38184 on epoch:     0, epoch:   76/100, mu: 0.9826183319, learning_rate: 0.0000000653, weight_decay: 0.0000120971

epoch time: 616.0675659180s, input_fired_time: 9.1912431717, output_fired_time: 3.3626580238, propagate_forward_time: 221.6863555908, propagate_backward_time: 374.2694396973, weight_update_time: 0.4241150618, other_time: 7.5578918457
epoch time: 46.1375350952s, input_fired_time: 0.4958610237, output_fired_time: 0.0000000000, propagate_forward_time: 44.4713897705, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1702842712
validation[          , genome  6217] predictions:    4690/  10000 (46.90%), best:    6023/10000 (60.23%), error:     16655.01953, best error:     11893.38184 on epoch:     0, epoch:   77/100, mu: 0.9830111861, learning_rate: 0.0000000611, weight_decay: 0.0000115024

epoch time: 616.5587768555s, input_fired_time: 9.1606769562, output_fired_time: 3.3570253849, propagate_forward_time: 221.6658172607, propagate_backward_time: 374.8140869141, weight_update_time: 0.4236676991, other_time: 7.5610961914
epoch time: 46.2339630127s, input_fired_time: 0.4950999916, output_fired_time: 0.0000000000, propagate_forward_time: 44.5679702759, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1708946228
validation[          , genome  6217] predictions:    4714/  10000 (47.14%), best:    6023/10000 (60.23%), error:     16666.06445, best error:     11893.38184 on epoch:     0, epoch:   78/100, mu: 0.9833831191, learning_rate: 0.0000000572, weight_decay: 0.0000109369

epoch time: 616.4617309570s, input_fired_time: 9.0956172943, output_fired_time: 3.3497982025, propagate_forward_time: 221.6991271973, propagate_backward_time: 374.7727661133, weight_update_time: 0.4248736501, other_time: 7.5444030762
epoch time: 46.3067054749s, input_fired_time: 0.4966405630, output_fired_time: 0.0000000000, propagate_forward_time: 44.6281585693, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1819076538
validation[          , genome  6217] predictions:    4679/  10000 (46.79%), best:    6023/10000 (60.23%), error:     16645.28711, best error:     11893.38184 on epoch:     0, epoch:   79/100, mu: 0.9837352633, learning_rate: 0.0000000535, weight_decay: 0.0000103991

epoch time: 616.3359375000s, input_fired_time: 9.1058731079, output_fired_time: 3.3491730690, propagate_forward_time: 221.7318725586, propagate_backward_time: 374.5586547852, weight_update_time: 0.4256847203, other_time: 7.5903320313
epoch time: 46.3325881958s, input_fired_time: 0.4963364899, output_fired_time: 0.0000000000, propagate_forward_time: 44.6488685608, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1873817444
validation[          , genome  6217] predictions:    4662/  10000 (46.62%), best:    6023/10000 (60.23%), error:     16659.33789, best error:     11893.38184 on epoch:     0, epoch:   80/100, mu: 0.9840686321, learning_rate: 0.0000000501, weight_decay: 0.0000098879

epoch time: 616.4496459961s, input_fired_time: 9.1020622253, output_fired_time: 3.3475770950, propagate_forward_time: 221.7090148926, propagate_backward_time: 374.6946716309, weight_update_time: 0.4240060151, other_time: 7.5963134766
epoch time: 46.1743850708s, input_fired_time: 0.4939989150, output_fired_time: 0.0000000000, propagate_forward_time: 44.5060081482, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1743774414
validation[          , genome  6217] predictions:    4632/  10000 (46.32%), best:    6023/10000 (60.23%), error:     16660.72656, best error:     11893.38184 on epoch:     0, epoch:   81/100, mu: 0.9843842983, learning_rate: 0.0000000469, weight_decay: 0.0000094017

epoch time: 616.2442626953s, input_fired_time: 9.1194620132, output_fired_time: 3.3606486320, propagate_forward_time: 221.6132049561, propagate_backward_time: 374.5697937012, weight_update_time: 0.4252456725, other_time: 7.5811462402
epoch time: 46.1912078857s, input_fired_time: 0.4949639142, output_fired_time: 0.0000000000, propagate_forward_time: 44.5264701843, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1697731018
validation[          , genome  6217] predictions:    4681/  10000 (46.81%), best:    6023/10000 (60.23%), error:     16662.08984, best error:     11893.38184 on epoch:     0, epoch:   82/100, mu: 0.9846831560, learning_rate: 0.0000000439, weight_decay: 0.0000089395

epoch time: 616.6220092773s, input_fired_time: 9.1031379700, output_fired_time: 3.3937044144, propagate_forward_time: 221.8367919922, propagate_backward_time: 374.7253417969, weight_update_time: 0.4249924719, other_time: 7.5630493164
epoch time: 46.1941833496s, input_fired_time: 0.4936690032, output_fired_time: 0.0000000000, propagate_forward_time: 44.5259513855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1745643616
validation[          , genome  6217] predictions:    4674/  10000 (46.74%), best:    6023/10000 (60.23%), error:     16672.42969, best error:     11893.38184 on epoch:     0, epoch:   83/100, mu: 0.9849660993, learning_rate: 0.0000000411, weight_decay: 0.0000085000

epoch time: 616.6907958984s, input_fired_time: 9.1237583160, output_fired_time: 3.3518090248, propagate_forward_time: 221.7323150635, propagate_backward_time: 374.8976745605, weight_update_time: 0.4554165900, other_time: 7.5852355957
epoch time: 46.2178459167s, input_fired_time: 0.5017662048, output_fired_time: 0.0000000000, propagate_forward_time: 44.5517082214, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1643714905
validation[          , genome  6217] predictions:    4667/  10000 (46.67%), best:    6023/10000 (60.23%), error:     16668.79492, best error:     11893.38184 on epoch:     0, epoch:   84/100, mu: 0.9852340221, learning_rate: 0.0000000384, weight_decay: 0.0000080820

epoch time: 616.8065185547s, input_fired_time: 9.1566333771, output_fired_time: 3.3592488766, propagate_forward_time: 221.6569671631, propagate_backward_time: 375.0393371582, weight_update_time: 0.4233037829, other_time: 7.5943298340
epoch time: 46.3519554138s, input_fired_time: 0.4955188036, output_fired_time: 0.0000000000, propagate_forward_time: 44.6805877686, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1758499146
validation[          , genome  6217] predictions:    4683/  10000 (46.83%), best:    6023/10000 (60.23%), error:     16676.11523, best error:     11893.38184 on epoch:     0, epoch:   85/100, mu: 0.9854876399, learning_rate: 0.0000000360, weight_decay: 0.0000076847

epoch time: 616.3130493164s, input_fired_time: 9.1148118973, output_fired_time: 3.3698925972, propagate_forward_time: 221.6804504395, propagate_backward_time: 374.5213317871, weight_update_time: 0.4258165359, other_time: 7.6265869141
epoch time: 46.1923103333s, input_fired_time: 0.4939190447, output_fired_time: 0.0000000000, propagate_forward_time: 44.5307273865, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1676635742
validation[          , genome  6217] predictions:    4677/  10000 (46.77%), best:    6023/10000 (60.23%), error:     16697.23242, best error:     11893.38184 on epoch:     0, epoch:   86/100, mu: 0.9857277870, learning_rate: 0.0000000337, weight_decay: 0.0000073069

epoch time: 616.9598999023s, input_fired_time: 9.1141338348, output_fired_time: 3.3446674347, propagate_forward_time: 221.9833068848, propagate_backward_time: 374.9385986328, weight_update_time: 0.4253621101, other_time: 7.5791931152
epoch time: 46.3060073853s, input_fired_time: 0.4992165267, output_fired_time: 0.0000000000, propagate_forward_time: 44.6358985901, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1708908081
validation[          , genome  6217] predictions:    4647/  10000 (46.47%), best:    6023/10000 (60.23%), error:     16643.03906, best error:     11893.38184 on epoch:     0, epoch:   87/100, mu: 0.9859551191, learning_rate: 0.0000000315, weight_decay: 0.0000069476

epoch time: 616.3212280273s, input_fired_time: 9.1376943588, output_fired_time: 3.3598234653, propagate_forward_time: 221.5449523926, propagate_backward_time: 374.6997375488, weight_update_time: 0.4271882176, other_time: 7.5790405273
epoch time: 46.2376174927s, input_fired_time: 0.4935803413, output_fired_time: 0.0000000000, propagate_forward_time: 44.5631713867, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1808662415
validation[          , genome  6217] predictions:    4688/  10000 (46.88%), best:    6023/10000 (60.23%), error:     16724.15625, best error:     11893.38184 on epoch:     0, epoch:   88/100, mu: 0.9861703515, learning_rate: 0.0000000295, weight_decay: 0.0000066060

epoch time: 618.0238037109s, input_fired_time: 9.1306333542, output_fired_time: 3.3504230976, propagate_forward_time: 222.1072998047, propagate_backward_time: 375.8311157227, weight_update_time: 0.4290672541, other_time: 7.6043701172
epoch time: 47.0720443726s, input_fired_time: 0.5070128441, output_fired_time: 0.0000000000, propagate_forward_time: 45.3416213989, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2234115601
validation[          , genome  6217] predictions:    4673/  10000 (46.73%), best:    6023/10000 (60.23%), error:     16682.62695, best error:     11893.38184 on epoch:     0, epoch:   89/100, mu: 0.9863741398, learning_rate: 0.0000000276, weight_decay: 0.0000062812

epoch time: 628.0874633789s, input_fired_time: 9.3125228882, output_fired_time: 3.4209268093, propagate_forward_time: 225.6925659180, propagate_backward_time: 381.7310791016, weight_update_time: 0.4458745122, other_time: 7.9304199219
epoch time: 47.0450096130s, input_fired_time: 0.5038899779, output_fired_time: 0.0000000000, propagate_forward_time: 45.3105773926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2305412292
validation[          , genome  6217] predictions:    4674/  10000 (46.74%), best:    6023/10000 (60.23%), error:     16706.27930, best error:     11893.38184 on epoch:     0, epoch:   90/100, mu: 0.9865670800, learning_rate: 0.0000000258, weight_decay: 0.0000059724

epoch time: 626.3356323242s, input_fired_time: 9.2529058456, output_fired_time: 3.4289588928, propagate_forward_time: 225.0663452148, propagate_backward_time: 380.6972351074, weight_update_time: 0.4315345287, other_time: 7.8901672363
epoch time: 46.8494033813s, input_fired_time: 0.5009663105, output_fired_time: 0.0000000000, propagate_forward_time: 45.1093292236, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2391090393
validation[          , genome  6217] predictions:    4683/  10000 (46.83%), best:    6023/10000 (60.23%), error:     16698.82227, best error:     11893.38184 on epoch:     0, epoch:   91/100, mu: 0.9867497683, learning_rate: 0.0000000242, weight_decay: 0.0000056788

epoch time: 629.1081542969s, input_fired_time: 9.4115009308, output_fired_time: 3.4528567791, propagate_forward_time: 226.0873718262, propagate_backward_time: 382.1739501953, weight_update_time: 0.4305672944, other_time: 7.9824523926
epoch time: 46.8752059937s, input_fired_time: 0.5030822158, output_fired_time: 0.0000000000, propagate_forward_time: 45.1693916321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2027320862
validation[          , genome  6217] predictions:    4684/  10000 (46.84%), best:    6023/10000 (60.23%), error:     16699.93359, best error:     11893.38184 on epoch:     0, epoch:   92/100, mu: 0.9869227409, learning_rate: 0.0000000226, weight_decay: 0.0000053996

epoch time: 626.0908203125s, input_fired_time: 9.2389650345, output_fired_time: 3.4301934242, propagate_forward_time: 225.2277526855, propagate_backward_time: 380.2914733887, weight_update_time: 0.4316794872, other_time: 7.9024658203
epoch time: 47.0440368652s, input_fired_time: 0.5038211942, output_fired_time: 0.0000000000, propagate_forward_time: 45.3051795959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2350349426
validation[          , genome  6217] predictions:    4633/  10000 (46.33%), best:    6023/10000 (60.23%), error:     16712.08203, best error:     11893.38184 on epoch:     0, epoch:   93/100, mu: 0.9870865345, learning_rate: 0.0000000212, weight_decay: 0.0000051341

epoch time: 626.2930908203s, input_fired_time: 9.2773418427, output_fired_time: 3.4189417362, propagate_forward_time: 225.1605377197, propagate_backward_time: 380.5636596680, weight_update_time: 0.4449762404, other_time: 7.8726196289
epoch time: 47.1352844238s, input_fired_time: 0.5111202002, output_fired_time: 0.0000000000, propagate_forward_time: 45.3960800171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2280845642
validation[          , genome  6217] predictions:    4678/  10000 (46.78%), best:    6023/10000 (60.23%), error:     16726.43945, best error:     11893.38184 on epoch:     0, epoch:   94/100, mu: 0.9872415662, learning_rate: 0.0000000198, weight_decay: 0.0000048817

epoch time: 631.8942871094s, input_fired_time: 9.3527078629, output_fired_time: 3.4720339775, propagate_forward_time: 227.1786651611, propagate_backward_time: 384.0100097656, weight_update_time: 0.4349857569, other_time: 7.8808593750
epoch time: 47.2802467346s, input_fired_time: 0.5092774034, output_fired_time: 0.0000000000, propagate_forward_time: 45.5412712097, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2296981812
validation[          , genome  6217] predictions:    4694/  10000 (46.94%), best:    6023/10000 (60.23%), error:     16707.28906, best error:     11893.38184 on epoch:     0, epoch:   95/100, mu: 0.9873883724, learning_rate: 0.0000000186, weight_decay: 0.0000046417

epoch time: 621.8289184570s, input_fired_time: 9.1953916550, output_fired_time: 3.3883943558, propagate_forward_time: 223.6909790039, propagate_backward_time: 377.8650207520, weight_update_time: 0.4349068105, other_time: 7.6891784668
epoch time: 46.5157737732s, input_fired_time: 0.5213158131, output_fired_time: 0.0000000000, propagate_forward_time: 44.8073616028, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1870956421
validation[          , genome  6217] predictions:    4656/  10000 (46.56%), best:    6023/10000 (60.23%), error:     16722.40430, best error:     11893.38184 on epoch:     0, epoch:   96/100, mu: 0.9875273705, learning_rate: 0.0000000174, weight_decay: 0.0000044135

epoch time: 631.0244140625s, input_fired_time: 9.4062252045, output_fired_time: 3.4623055458, propagate_forward_time: 227.1482238770, propagate_backward_time: 383.1759948730, weight_update_time: 0.4320854545, other_time: 7.8316650391
epoch time: 47.4554367065s, input_fired_time: 0.5074740648, output_fired_time: 0.0000000000, propagate_forward_time: 45.7259140015, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2220497131
validation[          , genome  6217] predictions:    4671/  10000 (46.71%), best:    6023/10000 (60.23%), error:     16742.66211, best error:     11893.38184 on epoch:     0, epoch:   97/100, mu: 0.9876589775, learning_rate: 0.0000000163, weight_decay: 0.0000041965

epoch time: 631.8916625977s, input_fired_time: 9.3905258179, output_fired_time: 3.4852318764, propagate_forward_time: 227.3245697021, propagate_backward_time: 383.8079833984, weight_update_time: 0.4370937347, other_time: 7.8833618164
epoch time: 46.4519653320s, input_fired_time: 0.4982363880, output_fired_time: 0.0000000000, propagate_forward_time: 44.7663078308, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1874198914
validation[          , genome  6217] predictions:    4670/  10000 (46.70%), best:    6023/10000 (60.23%), error:     16679.80859, best error:     11893.38184 on epoch:     0, epoch:   98/100, mu: 0.9877835512, learning_rate: 0.0000000152, weight_decay: 0.0000039901

epoch time: 621.3048095703s, input_fired_time: 9.2330942154, output_fired_time: 3.3991823196, propagate_forward_time: 223.3928985596, propagate_backward_time: 377.6499633789, weight_update_time: 0.4275244772, other_time: 7.6296997070
epoch time: 48.2503204346s, input_fired_time: 0.5146974921, output_fired_time: 0.0000000000, propagate_forward_time: 46.4902954102, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.2453269958
validation[          , genome  6217] predictions:    4681/  10000 (46.81%), best:    6023/10000 (60.23%), error:     16723.57422, best error:     11893.38184 on epoch:     0, epoch:   99/100, mu: 0.9879015088, learning_rate: 0.0000000142, weight_decay: 0.0000037940

epoch time: 629.7531738281s, input_fired_time: 9.3641233444, output_fired_time: 3.4457733631, propagate_forward_time: 226.6029510498, propagate_backward_time: 382.4689025879, weight_update_time: 0.4357682168, other_time: 7.8713684082
epoch time: 46.4132499695s, input_fired_time: 0.4967623651, output_fired_time: 0.0000000000, propagate_forward_time: 44.7383422852, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1781463623
validation[          , genome  6217] predictions:    4672/  10000 (46.72%), best:    6023/10000 (60.23%), error:     16729.52148, best error:     11893.38184 on epoch:     0, epoch:  100/100, mu: 0.9880132079, learning_rate: 0.0000000133, weight_decay: 0.0000036074

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 231.8583221436s, input_fired_time: 3.0522248745, output_fired_time: 0.0000000000, propagate_forward_time: 222.8468475342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.9592437744
best training[          , genome  6217] predictions:   33084/  50000 (66.17%), best:    6023/10000 (60.23%), error:     53296.17578, best error:     11893.38184 on epoch:     0, epoch:  101/100, mu: 0.9881189466, learning_rate: 0.0000000125, weight_decay: 0.0000034301
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 46.6000366211s, input_fired_time: 0.6108247042, output_fired_time: 0.0000000000, propagate_forward_time: 44.7965087891, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.1927032471
   testing[          , genome  6217] predictions:    6023/  10000 (60.23%), best:    6023/10000 (60.23%), error:     11893.38184, best error:     11893.38184 on epoch:     0, epoch:  101/100, mu: 0.9881189466, learning_rate: 0.0000000125, weight_decay: 0.0000034301
backpropagation finished successfully!
05:11:58 (10956): called boinc_finish(0)

</stderr_txt>
]]>