Nameexact_genome_1542334203_172_6028_0
Workunit4091928
Created16 Nov 2018, 3:06:10 UTC
Sent16 Nov 2018, 3:15:44 UTC
Report deadline13 Dec 2018, 13:38:46 UTC
Received19 Nov 2018, 15:12:40 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID75310
Run time10 hours 45 min 4 sec
CPU time10 hours 45 min 4 sec
Validate stateValid
Credit6,858.17
Device peak FLOPS3.28 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size572.30 MB
Peak swap size574.99 MB
Peak disk usage8.63 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
arguments:
	'../../projects/csgrid.org_csg/exact_client_0.33_x86_64-pc-linux-gnu'
	'--training_file'
	'training_samples.bin'
	'--validation_file'
	'validation_samples.bin'
	'--testing_file'
	'testing_samples.bin'
	'--genome_file'
	'input_genome.txt'
	'--output_file'
	'output_genome.txt'
	'--checkpoint_file'
	'checkpoint.txt'
converting arguments to vector
boincified training filename: '../../projects/csgrid.org_csg/cifar_10_training.bin'
boincified validation filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified testing filename: '../../projects/csgrid.org_csg/cifar_10_testing.bin'
boincified genome filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_172_6028.txt'
boincified output filename: '../../projects/csgrid.org_csg/exact_genome_1542334203_172_6028_0_r1416769850_0'
boincified checkpoint filename: 'checkpoint.txt'
loading genome
starting from input file: '../../projects/csgrid.org_csg/exact_genome_1542334203_172_6028.txt'
read CNN_Genome file with version string: 'v0.33'
read exact_id: -1
read genome_id: -1
read initial_mu: 0.498944
read mu: 0.498944
read mu_delta: 0.935969
read initial_learning_rate: 0.000294801
read learning_rate: 0.000294801
read learning_rate_delta: 0.931176
read initial_weight_decay: 0.000232886
read weight_decay: 0.000232886
read weight_decay_delta: 0.941435
read batch_size: 103
read epsilon: 1e-07
read alpha: 0.0959358
read input_dropout_probability: 0.00133843
read hidden_dropout_probability: 0.0834597
read velocity_reset: 1916
read epoch: 0
read max_epochs: 25
read reset_weights: 0
read padding: 2
read best_epoch: 0
read number_validation_images: 10000
read best_validation_predictions: 0
read best_validation_error: 1e+07
read number_training_images: 50000
read training_predictions: 0
read training_error: 1e+07
read number_test_images: 10000
read test_predictions: 0
read test_error: 1e+07
read generation_id: 6028
read normal distribution: '1 0 0'
generator_str: '411961176'
read generator: 411961176
read generated_by_map:
1 disable_node 1
reading 112 nodes.
reading 446 edges.
number input nodes: 3
number softmax nodes: 10
order_size: 0
parsed input file
loaded genome
loading images
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
reading image set with 5000 images.
image_size: 3x32x32 = 3072
read 50000 images.
    class    0: 5000
    class    1: 5000
    class    2: 5000
    class    3: 5000
    class    4: 5000
    class    5: 5000
    class    6: 5000
    class    7: 5000
    class    8: 5000
    class    9: 5000
calculating averages and standard deviations for images
average pixel value for channel 0: 0.491399973630905
average pixel value for channel 1: 0.482159107923508
average pixel value for channel 2: 0.446530401706696
pixel variance for channel 0: 0.0610253289341927
pixel standard deviation for channel 0: 0.247033059597015
pixel variance for channel 1: 0.0592849254608154
pixel standard deviation for channel 1: 0.24348495900631
pixel variance for channel 2: 0.0684280395507812
pixel standard deviation for channel 2: 0.261587530374527
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
number_classes: 10
channels: 3
width: 32
height: 32
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
reading image set with 1000 images.
image_size: 3x32x32 = 3072
read 10000 images.
    class    0: 1000
    class    1: 1000
    class    2: 1000
    class    3: 1000
    class    4: 1000
    class    5: 1000
    class    6: 1000
    class    7: 1000
    class    8: 1000
    class    9: 1000
loaded images
starting backpropagation!
generator min: 1, generator max: 2147483646
pre shuffle 1: 344207104
post shuffle 1: 200957521
epoch time: 1353.48962402344s, input_fired_time: 30.0630798339844, output_fired_time: 8.75740623474121, propagate_forward_time: 525.698120117188, propagate_backward_time: 773.066589355469, weight_update_time: 0.374635487794876, other_time: 15.9043579101562
epoch time: 110.206069946289s, input_fired_time: 1.64613234996796, output_fired_time: 0, propagate_forward_time: 105.918670654297, propagate_backward_time: 0, weight_update_time: 0, other_time: 2.64126586914062
validation[          , genome  6028] predictions:    6351/  10000 (63.51%), best:    6351/10000 (63.51%), error:     10544.08496, best error:     10544.08496 on epoch:     0, epoch:    0/25, mu: 0.4989436865, learning_rate: 0.0002948010, weight_decay: 0.0002328856

epoch time: 1356.3414306641s, input_fired_time: 29.9577369690, output_fired_time: 8.7342205048, propagate_forward_time: 527.9379272461, propagate_backward_time: 773.8756103516, weight_update_time: 0.3724882901, other_time: 15.8358764648
epoch time: 110.4587707520s, input_fired_time: 1.6399989128, output_fired_time: 0.0000000000, propagate_forward_time: 106.1721267700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6466445923
validation[          , genome  6028] predictions:    6264/  10000 (62.64%), best:    6351/10000 (63.51%), error:     10748.21094, best error:     10544.08496 on epoch:     0, epoch:    1/25, mu: 0.5303866863, learning_rate: 0.0002745115, weight_decay: 0.0002192468

epoch time: 1348.6798095703s, input_fired_time: 29.8386039734, output_fired_time: 8.7184190750, propagate_forward_time: 523.8042602539, propagate_backward_time: 770.4721679688, weight_update_time: 0.3718010187, other_time: 15.8463745117
epoch time: 109.6198043823s, input_fired_time: 1.6422044039, output_fired_time: 0.0000000000, propagate_forward_time: 105.3344268799, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6431732178
validation[          , genome  6028] predictions:    6358/  10000 (63.58%), best:    6351/10000 (63.51%), error:     10636.38379, best error:     10544.08496 on epoch:     0, epoch:    2/25, mu: 0.5598163009, learning_rate: 0.0002556184, weight_decay: 0.0002064067

epoch time: 1355.7196044922s, input_fired_time: 29.9217281342, output_fired_time: 8.7461919785, propagate_forward_time: 527.2431030273, propagate_backward_time: 773.9472045898, weight_update_time: 0.3750822246, other_time: 15.8613281250
epoch time: 109.8090972900s, input_fired_time: 1.6372281313, output_fired_time: 0.0000000000, propagate_forward_time: 105.5320892334, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6397781372
validation[          , genome  6028] predictions:    6041/  10000 (60.41%), best:    6351/10000 (63.51%), error:     11352.03809, best error:     10544.08496 on epoch:     0, epoch:    3/25, mu: 0.5873615146, learning_rate: 0.0002380256, weight_decay: 0.0001943185

epoch time: 1347.9427490234s, input_fired_time: 29.8948707581, output_fired_time: 8.7034339905, propagate_forward_time: 523.4154052734, propagate_backward_time: 769.8978271484, weight_update_time: 0.3739905357, other_time: 16.0311279297
epoch time: 110.0307846069s, input_fired_time: 1.6267458200, output_fired_time: 0.0000000000, propagate_forward_time: 105.7602996826, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6437377930
validation[          , genome  6028] predictions:    5946/  10000 (59.46%), best:    6351/10000 (63.51%), error:     11447.63867, best error:     10544.08496 on epoch:     0, epoch:    4/25, mu: 0.6131429672, learning_rate: 0.0002216437, weight_decay: 0.0001829383

epoch time: 1346.9456787109s, input_fired_time: 29.7974205017, output_fired_time: 8.7586975098, propagate_forward_time: 522.9012451172, propagate_backward_time: 769.6773681641, weight_update_time: 0.3725979030, other_time: 15.8110351562
epoch time: 109.5248947144s, input_fired_time: 1.6199394464, output_fired_time: 0.0000000000, propagate_forward_time: 105.2878952026, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6170578003
validation[          , genome  6028] predictions:    5982/  10000 (59.82%), best:    6351/10000 (63.51%), error:     11622.92773, best error:     10544.08496 on epoch:     0, epoch:    5/25, mu: 0.6372736096, learning_rate: 0.0002063892, weight_decay: 0.0001722246

epoch time: 1349.6688232422s, input_fired_time: 29.7706012726, output_fired_time: 8.6958818436, propagate_forward_time: 524.6902465820, propagate_backward_time: 770.8559570312, weight_update_time: 0.3712944090, other_time: 15.6560668945
epoch time: 109.4300537109s, input_fired_time: 1.6226512194, output_fired_time: 0.0000000000, propagate_forward_time: 105.1861419678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6212615967
validation[          , genome  6028] predictions:    6097/  10000 (60.97%), best:    6351/10000 (63.51%), error:     11285.69531, best error:     10544.08496 on epoch:     0, epoch:    6/25, mu: 0.6598591208, learning_rate: 0.0001921846, weight_decay: 0.0001621383

epoch time: 1352.6214599609s, input_fired_time: 29.7883701324, output_fired_time: 8.7017822266, propagate_forward_time: 525.6580810547, propagate_backward_time: 772.7188110352, weight_update_time: 0.3703168035, other_time: 15.7544555664
epoch time: 110.1265182495s, input_fired_time: 1.6524337530, output_fired_time: 0.0000000000, propagate_forward_time: 105.8235778809, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6505050659
validation[          , genome  6028] predictions:    6239/  10000 (62.39%), best:    6351/10000 (63.51%), error:     10903.27051, best error:     10544.08496 on epoch:     0, epoch:    7/25, mu: 0.6809984446, learning_rate: 0.0001789576, weight_decay: 0.0001526428

epoch time: 3141.3623046875s, input_fired_time: 29.7935504913, output_fired_time: 8.7465124130, propagate_forward_time: 523.6116333008, propagate_backward_time: 2563.2456054688, weight_update_time: 0.3742436469, other_time: 15.9650878906
epoch time: 110.5101623535s, input_fired_time: 1.6370784044, output_fired_time: 0.0000000000, propagate_forward_time: 106.1793670654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6937179565
validation[          , genome  6028] predictions:    6221/  10000 (62.21%), best:    6351/10000 (63.51%), error:     10959.83105, best error:     10544.08496 on epoch:     0, epoch:    8/25, mu: 0.7007842064, learning_rate: 0.0001666410, weight_decay: 0.0001437033

epoch time: 1350.1656494141s, input_fired_time: 29.8089065552, output_fired_time: 8.6777172089, propagate_forward_time: 523.1162109375, propagate_backward_time: 772.7340698242, weight_update_time: 0.3728832304, other_time: 15.8286743164
epoch time: 110.3258285522s, input_fired_time: 1.6250919104, output_fired_time: 0.0000000000, propagate_forward_time: 106.0562057495, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6445312500
validation[          , genome  6028] predictions:    5983/  10000 (59.83%), best:    6351/10000 (63.51%), error:     11422.96094, best error:     10544.08496 on epoch:     0, epoch:    9/25, mu: 0.7193030715, learning_rate: 0.0001551720, weight_decay: 0.0001352874

epoch time: 1354.7972412109s, input_fired_time: 29.7682533264, output_fired_time: 8.7554998398, propagate_forward_time: 526.3518676758, propagate_backward_time: 774.0704956055, weight_update_time: 0.3743864000, other_time: 15.8510742188
epoch time: 109.7345962524s, input_fired_time: 1.6252492666, output_fired_time: 0.0000000000, propagate_forward_time: 105.4804840088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6288604736
validation[          , genome  6028] predictions:    6170/  10000 (61.70%), best:    6351/10000 (63.51%), error:     11080.42383, best error:     10544.08496 on epoch:     0, epoch:   10/25, mu: 0.7366361618, learning_rate: 0.0001444924, weight_decay: 0.0001273643

epoch time: 1348.2045898438s, input_fired_time: 29.7525005341, output_fired_time: 8.7044944763, propagate_forward_time: 523.7568969727, propagate_backward_time: 770.3016967773, weight_update_time: 0.3722330034, other_time: 15.6890869141
epoch time: 110.3731994629s, input_fired_time: 1.6823838949, output_fired_time: 0.0000000000, propagate_forward_time: 105.9943466187, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6964721680
validation[          , genome  6028] predictions:    6187/  10000 (61.87%), best:    6351/10000 (63.51%), error:     11046.92969, best error:     10544.08496 on epoch:     0, epoch:   11/25, mu: 0.7528593540, learning_rate: 0.0001345478, weight_decay: 0.0001199052

epoch time: 1351.2584228516s, input_fired_time: 29.8395767212, output_fired_time: 8.7624206543, propagate_forward_time: 524.5767822266, propagate_backward_time: 772.0610961914, weight_update_time: 0.3749284446, other_time: 16.0184936523
epoch time: 109.7094116211s, input_fired_time: 1.6176562309, output_fired_time: 0.0000000000, propagate_forward_time: 105.4718170166, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6199417114
validation[          , genome  6028] predictions:    6253/  10000 (62.53%), best:    6351/10000 (63.51%), error:     10885.64746, best error:     10544.08496 on epoch:     0, epoch:   12/25, mu: 0.7680437565, learning_rate: 0.0001252877, weight_decay: 0.0001128830

epoch time: 1352.7111816406s, input_fired_time: 29.7679443359, output_fired_time: 8.7376003265, propagate_forward_time: 524.3208007812, propagate_backward_time: 773.8865356445, weight_update_time: 0.3748601675, other_time: 15.9983520508
epoch time: 110.6471557617s, input_fired_time: 1.6138093472, output_fired_time: 0.0000000000, propagate_forward_time: 106.3832626343, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6500854492
validation[          , genome  6028] predictions:    6071/  10000 (60.71%), best:    6351/10000 (63.51%), error:     11280.49512, best error:     10544.08496 on epoch:     0, epoch:   13/25, mu: 0.7822558880, learning_rate: 0.0001166648, weight_decay: 0.0001062721

epoch time: 1356.6290283203s, input_fired_time: 29.7469825745, output_fired_time: 8.7564182281, propagate_forward_time: 525.9940795898, propagate_backward_time: 776.3333129883, weight_update_time: 0.3715662956, other_time: 15.7982177734
epoch time: 109.4619140625s, input_fired_time: 1.6039175987, output_fired_time: 0.0000000000, propagate_forward_time: 105.2228164673, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6351776123
validation[          , genome  6028] predictions:    5705/  10000 (57.05%), best:    6351/10000 (63.51%), error:     12359.13574, best error:     10544.08496 on epoch:     0, epoch:   14/25, mu: 0.7955580354, learning_rate: 0.0001086354, weight_decay: 0.0001000483

epoch time: 1347.0909423828s, input_fired_time: 29.7300796509, output_fired_time: 8.7386560440, propagate_forward_time: 522.5278320312, propagate_backward_time: 770.1336669922, weight_update_time: 0.3742111921, other_time: 15.9606933594
epoch time: 110.4154357910s, input_fired_time: 1.6419447660, output_fired_time: 0.0000000000, propagate_forward_time: 106.1097793579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6637115479
validation[          , genome  6028] predictions:    6248/  10000 (62.48%), best:    6351/10000 (63.51%), error:     10866.04492, best error:     10544.08496 on epoch:     0, epoch:   15/25, mu: 0.8080084324, learning_rate: 0.0001011587, weight_decay: 0.0000941890

epoch time: 1352.5190429688s, input_fired_time: 29.8185424805, output_fired_time: 8.6833095551, propagate_forward_time: 524.9554443359, propagate_backward_time: 773.2015380859, weight_update_time: 0.3756454587, other_time: 15.8601074219
epoch time: 110.0069503784s, input_fired_time: 1.6218941212, output_fired_time: 0.0000000000, propagate_forward_time: 105.7414245605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6436309814
validation[          , genome  6028] predictions:    6276/  10000 (62.76%), best:    6351/10000 (63.51%), error:     10952.71875, best error:     10544.08496 on epoch:     0, epoch:   16/25, mu: 0.8196616173, learning_rate: 0.0000941965, weight_decay: 0.0000886729

epoch time: 1352.5742187500s, input_fired_time: 29.7740707397, output_fired_time: 8.7772054672, propagate_forward_time: 524.5001831055, propagate_backward_time: 773.7200317383, weight_update_time: 0.3718002141, other_time: 15.8027343750
epoch time: 109.7222747803s, input_fired_time: 1.6199924946, output_fired_time: 0.0000000000, propagate_forward_time: 105.4717712402, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6305084229
validation[          , genome  6028] predictions:    6110/  10000 (61.10%), best:    6351/10000 (63.51%), error:     11194.92676, best error:     10544.08496 on epoch:     0, epoch:   17/25, mu: 0.8305686116, learning_rate: 0.0000877135, weight_decay: 0.0000834798

epoch time: 1349.3065185547s, input_fired_time: 29.7101879120, output_fired_time: 8.6798505783, propagate_forward_time: 523.3222656250, propagate_backward_time: 771.6851196289, weight_update_time: 0.3750259578, other_time: 15.9091186523
epoch time: 110.2446365356s, input_fired_time: 1.6439574957, output_fired_time: 0.0000000000, propagate_forward_time: 105.9227066040, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6779708862
validation[          , genome  6028] predictions:    6315/  10000 (63.15%), best:    6351/10000 (63.51%), error:     10745.00488, best error:     10544.08496 on epoch:     0, epoch:   18/25, mu: 0.8407772183, learning_rate: 0.0000816767, weight_decay: 0.0000785908

epoch time: 1352.7384033203s, input_fired_time: 29.8516273499, output_fired_time: 8.7953004837, propagate_forward_time: 524.9892578125, propagate_backward_time: 772.7044067383, weight_update_time: 0.3829972446, other_time: 16.3977661133
epoch time: 109.6958541870s, input_fired_time: 1.6344406605, output_fired_time: 0.0000000000, propagate_forward_time: 105.3820495605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6793670654
validation[          , genome  6028] predictions:    6244/  10000 (62.44%), best:    6351/10000 (63.51%), error:     10815.98828, best error:     10544.08496 on epoch:     0, epoch:   19/25, mu: 0.8503321409, learning_rate: 0.0000760553, weight_decay: 0.0000739882

epoch time: 1351.5462646484s, input_fired_time: 29.7979869843, output_fired_time: 8.7476062775, propagate_forward_time: 524.9632568359, propagate_backward_time: 772.1282958984, weight_update_time: 0.3742602468, other_time: 15.9091796875
epoch time: 110.4557495117s, input_fired_time: 1.6230312586, output_fired_time: 0.0000000000, propagate_forward_time: 106.1381912231, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6945266724
validation[          , genome  6028] predictions:    6187/  10000 (61.87%), best:    6351/10000 (63.51%), error:     11025.15723, best error:     10544.08496 on epoch:     0, epoch:   20/25, mu: 0.8592752814, learning_rate: 0.0000708209, weight_decay: 0.0000696551

epoch time: 1356.9039306641s, input_fired_time: 29.8997077942, output_fired_time: 8.7646741867, propagate_forward_time: 527.2555541992, propagate_backward_time: 774.8857421875, weight_update_time: 0.3769502938, other_time: 16.0983276367
epoch time: 110.2665939331s, input_fired_time: 1.6417553425, output_fired_time: 0.0000000000, propagate_forward_time: 105.9531784058, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6716613770
validation[          , genome  6028] predictions:    6376/  10000 (63.76%), best:    6351/10000 (63.51%), error:     10557.20312, best error:     10544.08496 on epoch:     0, epoch:   21/25, mu: 0.8676457405, learning_rate: 0.0000659467, weight_decay: 0.0000655757

epoch time: 1352.5419921875s, input_fired_time: 29.9026069641, output_fired_time: 8.7401885986, propagate_forward_time: 525.0001220703, propagate_backward_time: 773.0298461914, weight_update_time: 0.3730486631, other_time: 15.8692016602
epoch time: 110.0981750488s, input_fired_time: 1.6466259956, output_fired_time: 0.0000000000, propagate_forward_time: 105.7471466064, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7043991089
validation[          , genome  6028] predictions:    6265/  10000 (62.65%), best:    6351/10000 (63.51%), error:     10790.85742, best error:     10544.08496 on epoch:     0, epoch:   22/25, mu: 0.8754802346, learning_rate: 0.0000614079, weight_decay: 0.0000617353

epoch time: 1364.6455078125s, input_fired_time: 30.0272197723, output_fired_time: 8.8835391998, propagate_forward_time: 530.1302490234, propagate_backward_time: 779.0839233398, weight_update_time: 0.3889485002, other_time: 16.5205688477
epoch time: 110.1359710693s, input_fired_time: 1.6780368090, output_fired_time: 0.0000000000, propagate_forward_time: 105.7478561401, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7100753784
validation[          , genome  6028] predictions:    6279/  10000 (62.79%), best:    6351/10000 (63.51%), error:     10658.38281, best error:     10544.08496 on epoch:     0, epoch:   23/25, mu: 0.8828130960, learning_rate: 0.0000571816, weight_decay: 0.0000581198

epoch time: 1357.1894531250s, input_fired_time: 29.9533386230, output_fired_time: 8.8315391541, propagate_forward_time: 525.8179321289, propagate_backward_time: 776.2941284180, weight_update_time: 0.3880383670, other_time: 16.2924804688
epoch time: 111.3847351074s, input_fired_time: 1.6675324440, output_fired_time: 0.0000000000, propagate_forward_time: 106.9888381958, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7283630371
validation[          , genome  6028] predictions:    6376/  10000 (63.76%), best:    6351/10000 (63.51%), error:     10694.14941, best error:     10544.08496 on epoch:     0, epoch:   24/25, mu: 0.8896763921, learning_rate: 0.0000532461, weight_decay: 0.0000547160

epoch time: 1351.4665527344s, input_fired_time: 29.8438129425, output_fired_time: 8.7678489685, propagate_forward_time: 524.3682250977, propagate_backward_time: 772.4927368164, weight_update_time: 0.3744443357, other_time: 15.9938964844
epoch time: 111.1361541748s, input_fired_time: 1.6580179930, output_fired_time: 0.0000000000, propagate_forward_time: 106.7974243164, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6807098389
validation[          , genome  6028] predictions:    6373/  10000 (63.73%), best:    6373/10000 (63.73%), error:     10387.98633, best error:     10387.98633 on epoch:    25, epoch:   25/25, mu: 0.8961002231, learning_rate: 0.0000495815, weight_decay: 0.0000515116

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 551.4409790039s, input_fired_time: 8.3489074707, output_fired_time: 0.0000000000, propagate_forward_time: 529.3433227539, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 13.7487182617
best training[          , genome  6028] predictions:   34436/  50000 (68.87%), best:    6373/10000 (63.73%), error:     46459.01172, best error:     10387.98633 on epoch:    25, epoch:   26/25, mu: 0.9021127224, learning_rate: 0.0000461690, weight_decay: 0.0000484949
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 110.2282791138s, input_fired_time: 1.6685379744, output_fired_time: 0.0000000000, propagate_forward_time: 105.8401260376, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.7196121216
   testing[          , genome  6028] predictions:    6373/  10000 (63.73%), best:    6373/10000 (63.73%), error:     10387.98633, best error:     10387.98633 on epoch:    25, epoch:   26/25, mu: 0.9021127224, learning_rate: 0.0000461690, weight_decay: 0.0000484949
backpropagation finished successfully!
09:09:38 (29207): called boinc_finish(0)

</stderr_txt>
]]>