Nameexact_genome_1542727803_167_6404_0
Workunit4101141
Created20 Nov 2018, 18:10:31 UTC
Sent20 Nov 2018, 18:13:36 UTC
Report deadline9 Dec 2018, 10:07:23 UTC
Received21 Nov 2018, 2:52:06 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID87483
Run time8 hours 35 min 44 sec
CPU time8 hours 30 min 48 sec
Validate stateValid
Credit4,665.59
Device peak FLOPS4.23 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size513.01 MB
Peak swap size532.94 MB
Peak disk usage8.97 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'projects/csgrid.org_csg/exact_client_0.34_windows_x86_64.exe'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542727803_167_6404.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542727803_167_6404_0_r995062358_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542727803_167_6404.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.5
read mu: 0.5
read mu_delta: 0.95
read initial_learning_rate: 0.0125
read learning_rate: 0.0125
read learning_rate_delta: 0.95
read initial_weight_decay: 0.0005
read weight_decay: 0.0005
read weight_decay_delta: 0.95
read batch_size: 50
read epsilon: 1e-07
read alpha: 0.1
read input_dropout_probability: 0
read hidden_dropout_probability: 0
read velocity_reset: 1000
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6404
read normal distribution: '1 0 0'
generator_str: '10831328'
read generator: 10831328
read generated_by_map:
1 enable_edge 1
reading 62 nodes.
reading 257 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507813
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 1653503348
post shuffle 1: 722718574
epoch time: 1059.01721191406s, input_fired_time: 5.42052745819092, output_fired_time: 4.72401428222656, propagate_forward_time: 418.793762207031, propagate_backward_time: 620.272583007813, weight_update_time: 0.619443833827972, other_time: 9.80633544921875
epoch time: 86.4461517333984s, input_fired_time: 0.651724398136139, output_fired_time: 0, propagate_forward_time: 84.0030059814453, propagate_backward_time: 0, weight_update_time: 0, other_time: 1.79141998291016
validation[          , genome  6404] predictions:    4898/  10000 (48.98%), best:    4898/10000 (48.98%), error:     16380.16406, best error:     16380.16406 on epoch:     0, epoch:    0/25, mu: 0.5000000000, learning_rate: 0.0125000002, weight_decay: 0.0005000000

epoch time: 1065.1752929688s, input_fired_time: 5.4050993919, output_fired_time: 4.7537827492, propagate_forward_time: 421.3727722168, propagate_backward_time: 623.8118896484, weight_update_time: 0.6265600324, other_time: 9.8316650391
epoch time: 86.4125366211s, input_fired_time: 0.6668912768, output_fired_time: 0.0000000000, propagate_forward_time: 83.9049835205, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8406600952
validation[          , genome  6404] predictions:    4915/  10000 (49.15%), best:    4898/10000 (48.98%), error:     16622.03906, best error:     16380.16406 on epoch:     0, epoch:    1/25, mu: 0.5245000124, learning_rate: 0.0118749999, weight_decay: 0.0004750000

epoch time: 1077.2851562500s, input_fired_time: 5.3886590004, output_fired_time: 4.7807435989, propagate_forward_time: 426.3523864746, propagate_backward_time: 630.8571166992, weight_update_time: 0.6200428605, other_time: 9.9061889648
epoch time: 85.1888580322s, input_fired_time: 0.6413152814, output_fired_time: 0.0000000000, propagate_forward_time: 82.7655105591, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7820358276
validation[          , genome  6404] predictions:    4413/  10000 (44.13%), best:    4898/10000 (48.98%), error:     18819.64453, best error:     16380.16406 on epoch:     0, epoch:    2/25, mu: 0.5477750301, learning_rate: 0.0112812500, weight_decay: 0.0004512500

epoch time: 1101.6595458984s, input_fired_time: 5.3682761192, output_fired_time: 4.8118152618, propagate_forward_time: 435.7781066895, propagate_backward_time: 645.4755859375, weight_update_time: 0.6155084968, other_time: 10.2258300781
epoch time: 89.1015853882s, input_fired_time: 0.6437475085, output_fired_time: 0.0000000000, propagate_forward_time: 86.6296234131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8282165527
validation[          , genome  6404] predictions:    4698/  10000 (46.98%), best:    4898/10000 (48.98%), error:     17651.00586, best error:     16380.16406 on epoch:     0, epoch:    3/25, mu: 0.5698862672, learning_rate: 0.0107171871, weight_decay: 0.0004286875

epoch time: 1113.0317382813s, input_fired_time: 5.4028477669, output_fired_time: 4.8541898727, propagate_forward_time: 440.5066528320, propagate_backward_time: 651.9589843750, weight_update_time: 0.6222854853, other_time: 10.3090209961
epoch time: 91.1097259521s, input_fired_time: 0.6321434975, output_fired_time: 0.0000000000, propagate_forward_time: 88.6041717529, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8734130859
validation[          , genome  6404] predictions:    5055/  10000 (50.55%), best:    5055/10000 (50.55%), error:     15881.67480, best error:     15881.67480 on epoch:     4, epoch:    4/25, mu: 0.5908919573, learning_rate: 0.0101813274, weight_decay: 0.0004072531

epoch time: 1120.8492431641s, input_fired_time: 5.3919830322, output_fired_time: 4.8630571365, propagate_forward_time: 443.5553283691, propagate_backward_time: 656.9113159180, weight_update_time: 0.6191776991, other_time: 10.1276245117
epoch time: 90.9285049438s, input_fired_time: 0.6429287195, output_fired_time: 0.0000000000, propagate_forward_time: 88.4909133911, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7946624756
validation[          , genome  6404] predictions:    5092/  10000 (50.92%), best:    5092/10000 (50.92%), error:     15475.09180, best error:     15475.09180 on epoch:     5, epoch:    5/25, mu: 0.6108473539, learning_rate: 0.0096722608, weight_decay: 0.0003868904

epoch time: 1119.6676025391s, input_fired_time: 5.3985905647, output_fired_time: 4.9218621254, propagate_forward_time: 443.2895202637, propagate_backward_time: 656.0759887695, weight_update_time: 0.6222907305, other_time: 9.9816284180
epoch time: 90.6517791748s, input_fired_time: 0.6560401320, output_fired_time: 0.0000000000, propagate_forward_time: 88.1518859863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8438568115
validation[          , genome  6404] predictions:    4816/  10000 (48.16%), best:    5092/10000 (50.92%), error:     16902.14844, best error:     15475.09180 on epoch:     5, epoch:    6/25, mu: 0.6298049688, learning_rate: 0.0091886474, weight_decay: 0.0003675459

epoch time: 1123.1737060547s, input_fired_time: 5.4202761650, output_fired_time: 4.8922734261, propagate_forward_time: 445.2574462891, propagate_backward_time: 657.5706787109, weight_update_time: 0.6184977889, other_time: 10.0329589844
epoch time: 91.3926467896s, input_fired_time: 0.6580651402, output_fired_time: 0.0000000000, propagate_forward_time: 88.9603805542, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7742004395
validation[          , genome  6404] predictions:    4995/  10000 (49.95%), best:    5092/10000 (50.92%), error:     15746.72168, best error:     15475.09180 on epoch:     5, epoch:    7/25, mu: 0.6478147507, learning_rate: 0.0087292148, weight_decay: 0.0003491686

epoch time: 1127.0212402344s, input_fired_time: 5.4659409523, output_fired_time: 4.9259800911, propagate_forward_time: 446.5649719238, propagate_backward_time: 659.8828735352, weight_update_time: 0.6233482361, other_time: 10.1814575195
epoch time: 91.6976699829s, input_fired_time: 0.6408616304, output_fired_time: 0.0000000000, propagate_forward_time: 89.1746368408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8821716309
validation[          , genome  6404] predictions:    4906/  10000 (49.06%), best:    5092/10000 (50.92%), error:     15674.92090, best error:     15475.09180 on epoch:     5, epoch:    8/25, mu: 0.6649240255, learning_rate: 0.0082927542, weight_decay: 0.0003317102

epoch time: 1124.8017578125s, input_fired_time: 5.4503679276, output_fired_time: 4.8962984085, propagate_forward_time: 445.5062866211, propagate_backward_time: 658.8843383789, weight_update_time: 0.6210699081, other_time: 10.0645751953
epoch time: 91.5630798340s, input_fired_time: 0.6511434317, output_fired_time: 0.0000000000, propagate_forward_time: 89.0800552368, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8318786621
validation[          , genome  6404] predictions:    4960/  10000 (49.60%), best:    5092/10000 (50.92%), error:     15955.80371, best error:     15475.09180 on epoch:     5, epoch:    9/25, mu: 0.6811778545, learning_rate: 0.0078781163, weight_decay: 0.0003151247

epoch time: 1126.6107177734s, input_fired_time: 5.4162626266, output_fired_time: 4.9138402939, propagate_forward_time: 446.3249816895, propagate_backward_time: 659.7322998047, weight_update_time: 0.6129697561, other_time: 10.2233886719
epoch time: 91.5857467651s, input_fired_time: 0.6598700285, output_fired_time: 0.0000000000, propagate_forward_time: 89.0504379272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8754425049
validation[          , genome  6404] predictions:    5127/  10000 (51.27%), best:    5127/10000 (51.27%), error:     15231.26563, best error:     15231.26563 on epoch:    10, epoch:   10/25, mu: 0.6966189742, learning_rate: 0.0074842102, weight_decay: 0.0002993684

epoch time: 1124.7708740234s, input_fired_time: 5.4535508156, output_fired_time: 4.8802499771, propagate_forward_time: 445.7795104980, propagate_backward_time: 658.5377807617, weight_update_time: 0.6271976829, other_time: 10.1198120117
epoch time: 91.9019470215s, input_fired_time: 0.6442279220, output_fired_time: 0.0000000000, propagate_forward_time: 89.4513092041, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8064117432
validation[          , genome  6404] predictions:    5254/  10000 (52.54%), best:    5254/10000 (52.54%), error:     14330.78613, best error:     14330.78613 on epoch:    11, epoch:   11/25, mu: 0.7112880349, learning_rate: 0.0071099997, weight_decay: 0.0002844000

epoch time: 1125.2055664063s, input_fired_time: 5.4213862419, output_fired_time: 4.9045610428, propagate_forward_time: 445.9067687988, propagate_backward_time: 658.7269897461, weight_update_time: 0.6295744181, other_time: 10.2459106445
epoch time: 91.7497940063s, input_fired_time: 0.6589934826, output_fired_time: 0.0000000000, propagate_forward_time: 89.2331466675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8576507568
validation[          , genome  6404] predictions:    5323/  10000 (53.23%), best:    5323/10000 (53.23%), error:     14306.62109, best error:     14306.62109 on epoch:    12, epoch:   12/25, mu: 0.7252236605, learning_rate: 0.0067544994, weight_decay: 0.0002701800

epoch time: 1126.0726318359s, input_fired_time: 5.4381666183, output_fired_time: 4.9105401039, propagate_forward_time: 446.2725830078, propagate_backward_time: 659.2914428711, weight_update_time: 0.6238722205, other_time: 10.1599731445
epoch time: 91.5452270508s, input_fired_time: 0.6668596268, output_fired_time: 0.0000000000, propagate_forward_time: 89.0529556274, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8254089355
validation[          , genome  6404] predictions:    5363/  10000 (53.63%), best:    5323/10000 (53.23%), error:     14412.33887, best error:     14306.62109 on epoch:    12, epoch:   13/25, mu: 0.7384625077, learning_rate: 0.0064167744, weight_decay: 0.0002566710

epoch time: 1126.1251220703s, input_fired_time: 5.4584221840, output_fired_time: 4.8688712120, propagate_forward_time: 446.1388549805, propagate_backward_time: 659.4979248047, weight_update_time: 0.6138086915, other_time: 10.1610717773
epoch time: 91.8394012451s, input_fired_time: 0.6603593826, output_fired_time: 0.0000000000, propagate_forward_time: 89.3115005493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8675384521
validation[          , genome  6404] predictions:    5356/  10000 (53.56%), best:    5323/10000 (53.23%), error:     14770.16992, best error:     14306.62109 on epoch:    12, epoch:   14/25, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 1124.7078857422s, input_fired_time: 5.4474687576, output_fired_time: 4.8878836632, propagate_forward_time: 445.8046264648, propagate_backward_time: 658.1960449219, weight_update_time: 0.6308293343, other_time: 10.3717651367
epoch time: 92.1172027588s, input_fired_time: 0.6717996597, output_fired_time: 0.0000000000, propagate_forward_time: 89.5820465088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8633575439
validation[          , genome  6404] predictions:    5244/  10000 (52.44%), best:    5323/10000 (53.23%), error:     15186.84570, best error:     14306.62109 on epoch:    12, epoch:   15/25, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 1127.3001708984s, input_fired_time: 5.4346714020, output_fired_time: 4.8960595131, propagate_forward_time: 446.2946472168, propagate_backward_time: 660.3825683594, weight_update_time: 0.6155884266, other_time: 10.2921142578
epoch time: 91.6684188843s, input_fired_time: 0.6604291201, output_fired_time: 0.0000000000, propagate_forward_time: 89.1144561768, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8935317993
validation[          , genome  6404] predictions:    5257/  10000 (52.57%), best:    5323/10000 (53.23%), error:     14322.84082, best error:     14306.62109 on epoch:    12, epoch:   16/25, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 1126.8361816406s, input_fired_time: 5.4673261642, output_fired_time: 4.9195899963, propagate_forward_time: 446.7344665527, propagate_backward_time: 659.5469970703, weight_update_time: 0.6183928251, other_time: 10.1678466797
epoch time: 91.9144363403s, input_fired_time: 0.6639509797, output_fired_time: 0.0000000000, propagate_forward_time: 89.3535156250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8969726563
validation[          , genome  6404] predictions:    5460/  10000 (54.60%), best:    5460/10000 (54.60%), error:     13819.71680, best error:     13819.71680 on epoch:    17, epoch:   17/25, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 1044.0422363281s, input_fired_time: 5.2000088692, output_fired_time: 4.5459494591, propagate_forward_time: 408.6488342285, propagate_backward_time: 615.5374755859, weight_update_time: 0.5912511945, other_time: 10.1101074219
epoch time: 83.5190200806s, input_fired_time: 0.6198779345, output_fired_time: 0.0000000000, propagate_forward_time: 81.0724487305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8266906738
validation[          , genome  6404] predictions:    5406/  10000 (54.06%), best:    5460/10000 (54.60%), error:     13989.46094, best error:     13819.71680 on epoch:    17, epoch:   18/25, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 1034.9769287109s, input_fired_time: 5.1794471741, output_fired_time: 4.4875030518, propagate_forward_time: 405.2931518555, propagate_backward_time: 609.8511962891, weight_update_time: 0.5809110403, other_time: 10.1655883789
epoch time: 82.9161682129s, input_fired_time: 0.6189460158, output_fired_time: 0.0000000000, propagate_forward_time: 80.5089874268, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7882385254
validation[          , genome  6404] predictions:    5503/  10000 (55.03%), best:    5460/10000 (54.60%), error:     13878.22852, best error:     13819.71680 on epoch:    17, epoch:   19/25, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 1031.4868164063s, input_fired_time: 5.1599841118, output_fired_time: 4.4754648209, propagate_forward_time: 403.8259582520, propagate_backward_time: 608.0198364258, weight_update_time: 0.5907750726, other_time: 10.0055541992
epoch time: 82.9335021973s, input_fired_time: 0.6065490842, output_fired_time: 0.0000000000, propagate_forward_time: 80.5193786621, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8075714111
validation[          , genome  6404] predictions:    5144/  10000 (51.44%), best:    5460/10000 (54.60%), error:     14974.62109, best error:     13819.71680 on epoch:    17, epoch:   20/25, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 1032.5584716797s, input_fired_time: 5.1644086838, output_fired_time: 4.4752011299, propagate_forward_time: 403.2576599121, propagate_backward_time: 609.6898193359, weight_update_time: 0.5856994390, other_time: 9.9713134766
epoch time: 83.6313934326s, input_fired_time: 0.6185158491, output_fired_time: 0.0000000000, propagate_forward_time: 81.2023773193, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8105010986
validation[          , genome  6404] predictions:    5469/  10000 (54.69%), best:    5469/10000 (54.69%), error:     13379.06641, best error:     13379.06641 on epoch:    21, epoch:   21/25, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1030.1131591797s, input_fired_time: 5.1882719994, output_fired_time: 4.4761075974, propagate_forward_time: 403.2081298828, propagate_backward_time: 607.2451782227, weight_update_time: 0.5844923854, other_time: 9.9954833984
epoch time: 82.9493408203s, input_fired_time: 0.6049833298, output_fired_time: 0.0000000000, propagate_forward_time: 80.5039901733, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8403701782
validation[          , genome  6404] predictions:    5355/  10000 (53.55%), best:    5469/10000 (54.69%), error:     14335.72266, best error:     13379.06641 on epoch:    21, epoch:   22/25, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 1032.2213134766s, input_fired_time: 5.2031650543, output_fired_time: 4.4847407341, propagate_forward_time: 402.9943542480, propagate_backward_time: 609.3701782227, weight_update_time: 0.5851179361, other_time: 10.1688842773
epoch time: 83.1558456421s, input_fired_time: 0.6195638776, output_fired_time: 0.0000000000, propagate_forward_time: 80.7256851196, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8106002808
validation[          , genome  6404] predictions:    5205/  10000 (52.05%), best:    5469/10000 (54.69%), error:     14574.29102, best error:     13379.06641 on epoch:    21, epoch:   23/25, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 978.2606201172s, input_fired_time: 5.0357642174, output_fired_time: 4.3056774139, propagate_forward_time: 379.6132202148, propagate_backward_time: 579.0358886719, weight_update_time: 0.5566969514, other_time: 10.2700805664
epoch time: 76.9323043823s, input_fired_time: 0.5974152088, output_fired_time: 0.0000000000, propagate_forward_time: 74.5486526489, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7862396240
validation[          , genome  6404] predictions:    5391/  10000 (53.91%), best:    5469/10000 (54.69%), error:     14231.04199, best error:     13379.06641 on epoch:    21, epoch:   24/25, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 959.4848632813s, input_fired_time: 4.9587793350, output_fired_time: 4.1913366318, propagate_forward_time: 369.7830505371, propagate_backward_time: 570.3933105469, weight_update_time: 0.5550726652, other_time: 10.1583251953
epoch time: 76.7218246460s, input_fired_time: 0.5991852283, output_fired_time: 0.0000000000, propagate_forward_time: 74.2471313477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8755111694
validation[          , genome  6404] predictions:    5452/  10000 (54.52%), best:    5469/10000 (54.69%), error:     13712.47070, best error:     13379.06641 on epoch:    21, epoch:   25/25, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 384.8870239258s, input_fired_time: 2.9393105507, output_fired_time: 0.0000000000, propagate_forward_time: 372.6872558594, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 9.2604675293
best training[          , genome  6404] predictions:   30758/  50000 (61.52%), best:    5469/10000 (54.69%), error:     56275.04688, best error:     13379.06641 on epoch:    21, epoch:   26/25, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 76.9200897217s, input_fired_time: 0.5853545666, output_fired_time: 0.0000000000, propagate_forward_time: 73.6824645996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6522674561
   testing[          , genome  6404] predictions:    5469/  10000 (54.69%), best:    5469/10000 (54.69%), error:     13379.06641, best error:     13379.06641 on epoch:    21, epoch:   26/25, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600
backpropagation finished successfully!
06:51:25 (11820): called boinc_finish(0)

</stderr_txt>
]]>