sumosim: October 2012

Changing some parameters of the base configuration, and running sessions on that configurations, led to the following results.

Meaning of the columns in the following table:

1. Configuration
2. Session ID
3. Qualification
4 - 11. Generation of the session

The configurations mean:
base: The base configuration
crossoverProb05: Set crossover probability to 5%
crossoverProb09: Set crossover probability to 9%
decMutationProb10: Decreased mutation probablity to 10%
evaluateElite: Use elite selection strategy
grammarRuleFourRules: Generate always 4 rules
grammarRuleThreeRules: Generte always 3 rules
grammarRuleTwoRules: Generate akways 2 rules
incMaxWrapTo5: Increase max wrap to 5
incMutationProb10: Increase mutation probability to 10%
maxDepth15: Set max depth to 15
nodal: Use a nodal mutation strategy
nodalMaxDerivationTreeDepth1: Use a nodal mutation strategy with derivation tree depth of 1
nodalMaxDerivationTreeDepth10: Use a nodal mutation strategy with derivation tree depth of 10
nodalMaxDerivationTreeDepth2: Use a nodal mutation strategy with derivation tree depth of 2
populationSize40: Popuöation size 40

base	20120619-194512	92,3 31,5 4,1 3,6	1	10	25	50	100	200	500
	20120612-210623	97,3 46,8 6,5 5,8	1	10	25	50	100	200	500
	20120615-192525	29,9 29,9 7,0 7,0	1	10	25	50	100	200	500	1000	3000
	20120613-104221	47,3 24,4 8,9 7,0	1	10	25	50	100	200
	20120615-210453	48,4 19,4 12,3 8,9	1	10	25	50	100	200	500	1000	3000
	20120611-102707	39,7 18,3 11,9 8,9	1	10	25	50	100	200	500	1000
	20120611-184956	45,0 23,5 18,7 9,6	1	10	25	50	100	200	500
	20120613-185311	93,7 47,5 13,9 9,8	1	10	25	50	100	200	500	1000
	20120612-093946	48,2 19,4 13,9 9,8	1	10	25	50	100	200	500
	20120610-233627	32,7 19,3 12,2 10,7	1	10	25	50	100	200	500
	20120614-103322	32,5 14,1 11,0 11,0	1	10	25	50	100	200
	20120614-195730	23,3 18,3 - 11,9	1	10	25	50	100
	20120611-190036	395,5 24,4 16,3 12,1	1	10	25	50	100	200	500	1000	3000
	20120610-094257	90,4 23,5 13,8 12,2	1	10	25	50	100	200	500
	20120609-102738	89,9 32,6 12,2 12,2	1	10	25	50	100	200	500	1000
	20120615-174629	226,5 38,7 16,2 12,3	1	10	25	50	100	200	500	1000
	20120609-171239	276,8 30,9 15,6 13,5	1	10	25	50	100	200	500
	20120608-233350	4446,2 97,3 15,9 13,7	1	10	25	50	100	200	500	1000
	20120610-002640	47,8 24,1 19,4 13,9	1	10	25	50	100	200	500	1000
	20120610-175412	248,6 32,6 14,0 14,0	1	10	25	50	100	200
	20120609-234659	23,8 16,1 - 16,1	1	10	25	50	100
	20120608-192518	1195,5 46,5 19,4 16,2	1	10	25	50	100	200
	20120613-084231	97,2 76,4 29,7 28,9	1	10	25	50	100	200	500
crossoverProb05	20120717-112701	15,8 12,1 8,2 7,0	1	10	25	50	100	200	500	1000
	20120713-104221	30,5 30,2 15,7 13,5	1	10	25	50	100	200	500	1000
crossoverProb09	20120713-104225	191,6 23,6 10,9 8,9	1	10	25	50	100	200	500	1000
	20120717-112706	987,1 91,4 18,6 15,3	1	10	25	50	100	200	500	1000
decMutationProb10	20120615-210453	2340,6 807,8 8,9 5,2	1	10	25	50	100	200	500	1000	3000
	20120615-174629	236,9 14,0 9,0 6,6	1	10	25	50	100	200	500	1000
	20120615-192525	32,3 16,1 9,8 7,5	1	10	25	50	100	200	500	1000	3000
	20120705-222411	1585,1 42,0 18,9 7,5	1	10	25	50	100	200	500	1000
	20120703-221154	47,9 16,2 12,2 7,6	1	10	25	50	100	200	500	1000
	20120702-081329	24,2 19,6 12,3 9,0	1	10	25	50	100	200	500	1000
	20120614-195730	97,2 23,1 - 9,8	1	10	25	50	100
	20120613-185311	46,5 24,2 13,9 9,8	1	10	25	50	100	200	500	1000
	20120705-232615	216,7 69,1 14,0 10,9	1	10	25	50	100	200	500	1000
	20120614-195040	31,3 23,2 13,6 12,0	1	10	25	50	100	200
	20120620-035406	45,4 22,9 15,8 13,6	1	10	25	50	100	200	500	1000
	20120630-151354	75,2 75,2 18,6 13,6	1	10	25	50	100	200	500	1000
	20120702-191056	32,6 24,4 18,6 13,8	1	10	25	50	100	200	500	1000
	20120703-200323	46,9 24,1 16,5 14,1	1	10	25	50	100	200	500	1000
	20120614-103322	1595,1 42,5 23,3 18,4	1	10	25	50	100	200
	20120619-194512	49,0 43,9 18,8 18,8	1	10	25	50	100	200	500
evaluateElite	20120713-104244	23,7 13,8 9,8 9,8	1	10	25	50	100	200	500	1000
	20120717-112722	43,1 10,9 10,9 10,9	1	10	25	50	100	200	500	1000
grammarRuleFourRules	20120721-100435	24,0 18,9 12,3 7,5	1	10	25	50	100	200	500	1000	3000
grammarRuleThreeRules	20120725-110357	42,6 39,5 4,0 2,7	1	10	25	50	100	200	500	1000	3000
	20120721-100429	617,1 19,5 12,3 7,1	1	10	25	50	100	200	500	1000	3000
grammarRuleTwoRules	20120721-100424	16,3 14,0 8,2 6,1	1	10	25	50	100	200	500	1000	3000
incMaxWrapTo5	20120703-221154	30,0 16,4 2,7 2,6	1	10	25	50	100	200	500	1000
	20120630-151354	94,7 31,1 7,1 5,2	1	10	25	50	100	200	500	1000
	20120702-081329	95,5 10,9 9,7 7,0	1	10	25	50	100	200	500	1000
	20120614-180247	49,1 19,7 7,1 7,1	1	10	25	50	100	200	500	1000	3000
	20120705-232615	191,7 68,5 18,7 7,6	1	10	25	50	100	200	500	1000
	20120620-035406	75,3 65,4 16,3 9,0	1	10	25	50	100	200	500	1000
	20120702-191056	32,1 24,1 15,9 10,7	1	10	25	50	100	200	500	1000
	20120705-222411	696,9 22,7 18,4 13,5	1	10	25	50	100	200	500	1000
	20120703-200323	41,3 23,2 15,6 15,6	1	10	25	50	100	200	500
incMutationProb10	20120614-103322	44,1 22,8 3,8 3,3	1	10	25	50	100	200	500	1000	3000
	20120610-094236	31,4 29,6 4,9 3,9	1	10	25	50	100	200	500
	20120614-122812	343,1 32,8 4,7 4,7	1	10	25	50	100	200	500	1000	3000
	20120612-210623	92,3 39,8 12,1 6,2	1	10	25	50	100	200	500	1000
	20120620-035406	32,1 19,6 12,2 6,2	1	10	25	50	100	200	500	1000	3000
	20120611-184956	24,7 16,4 7,0 6,5	1	10	25	50	100	200	500
	20120611-102741	18,3 18,3 10,9 7,0	1	10	25	50	100	200	500	1000
	20120612-093946	698,3 19,6 9,0 7,1	1	10	25	50	100	200	500
	20120613-185311	1069,1 24,2 12,2 9,8	1	10	25	50	100	200	500	1000
	20120611-190036	29,8 18,6 13,9 12,1	1	10	25	50	100	200	500	1000	3000
	20120613-104221	31,8 16,1 14,0 12,1	1	10	25	50	100	200	500
	20120613-084231	72,0 45,3 13,8 12,2	1	10	25	50	100	200	500	1000
	20120610-234209	4481,0 44,0 19,3 13,8	1	10	25	50	100	200	500	1000
	20120610-175427	80,1 23,1 14,1 14,0	1	10	25	50	100	200
	20120611-113733	80,4 77,9 22,8 18,5	1	10	25	50	100	200	500
maxDepth15	20120717-112732	97,4 48,9 6,2 5,8	1	10	25	50	100	200	500	1000
	20120713-104245	40,6 22,6 15,6 13,4	1	10	25	50	100	200	500	1000
nodal	20120824-163537	221,9 193,6 177,1 152,9	1	10	25	50	100	200	500	1000	3000
	20120824-163449	392,5 310,1 190,0 171,6	1	10	25	50	100	200	500	1000	3000
	20120827-190453	353,4 295,8 188,7 186,1	1	10	25	50	100	200	500
	20120827-190432	556,5 258,8 199,0 194,2	1	10	25	50	100	200	500
nodalMaxDerivationTreeDepth1	20120809-194653	18,4 13,5 13,4 9,6	1	10	25	50	100	200	500	1000	3000
	20120814-181652	79,3 30,2 15,9 15,7	1	10	25	50	100	200	500	1000
nodalMaxDerivationTreeDepth10	20120809-194705	47,9 14,1 6,1 4,5	1	10	25	50	100	200	500	1000	3000
	20120814-181704	32,2 16,3 12,2 9,0	1	10	25	50	100	200	500	1000
nodalMaxDerivationTreeDepth2	20120809-194658	76,9 13,6 6,6 3,8	1	10	25	50	100	200	500	1000	3000
	20120814-181658	1360,4 48,4 12,3 8,9	1	10	25	50	100	200	500	1000
populationSize40	20120713-104234	46,0 29,9 9,6 4,1	1	10	25	50	100	200	500	1000
	20120717-112713	91,1 47,5 10,9 9,8	1	10	25	50	100	200	500	1000

In order to explore the effects, the parameters of the genetic algorithm have a reference parameter set is needed. After trying around a little bit I have chosen the following parameters

eliteSelectionRepalcementStrategy = DefaultEliteSelectionRepalcementStrategy
fitnessEvaluationStrategy = DefaultFitnessEvaluation
initialiserImpl = RampedHalfAndHalfInitialiser
crossoverOperationImpl = SinglePointCrossover
mutationOperationImpl = IntFlipMutation
selectionRepalcementStrategy = Generational
randomNumberGeneratorImpl = Jre
fitnessFunction = SGevaFitnessFuction
fitnessFunction.canCache = false
fitnessFunction.maxDuration = 200
fitnessFunction.testResultConverterName = TheWinnerTakesItAll
fitnessFunction.opponentResourceName = fcl/ref-001.fcl
fitnessFunction.opponentsCount = 100

outputDirPrefix = base
outputBaseDir = C:\Users\wwagner4\pgm\cygwin\home\wwagner4\sumosim-optimizer
growProb = 0,500
maxDerivationTreeDepth = 50
maxDepth = 10
maxWraps = 0
eliteSize = 10
evaluateElite = false
fixedPointCrossover = false
crossoverProb = 0,800
mutationProb = 0,010
populationSize = 20
generations = 100000
seed = None

Running several breeding sessions with the above parameters leaded to the following fitness value trend. The fitness value is the fitness of the best developed individual in the current generation.

The diagram shows that many sessions start with a fairly good fitness value (below 100) and that the othes have a strong tendency to fall below hundred very quickly (before 10 generations). For the meaning of a fitness value see the post: The winner takes it all

Having a closer look at the low fitness values, shows that there is even a trend to fall below 50 within the first 25 generations.

Fitness values in the first generation

             session         bestFitness
base-20120614-195730           30.184661
base-20120609-234659            30.91526
base-20120614-103322           32.503989
base-20120610-233627           32.706588
base-20120610-002640            47.75487
base-20120615-192525           69.534912
base-20120611-102707           80.029995
base-20120611-184956           86.826697
base-20120613-104221           87.284369
base-20120609-102738           89.910391
base-20120610-094257           90.352723
base-20120619-194512           92.292769
base-20120615-210453           94.551918
base-20120612-210623           97.246372
base-20120615-174629          226.501808
base-20120609-171239          320.595443
base-20120613-084231          352.821817
base-20120610-175412          365.867119
base-20120611-190036          697.852911
base-20120612-093946         1352.827676
base-20120613-185311         1367.676366
base-20120608-192518         3029.902041
base-20120608-233350         4446.222934

These are the exact fitness values after 25 generations

             session         bestFitness
base-20120619-194512            4.444169
base-20120615-210453           12.291047
base-20120614-195730           13.675698
base-20120614-103322           14.073996
base-20120609-234659           16.116512
base-20120612-093946           16.271329
base-20120611-102707           16.297538
base-20120613-185311           16.326053
base-20120612-210623           18.963986
base-20120610-094257           19.142386
base-20120610-233627           19.249123
base-20120608-192518            19.58362
base-20120615-192525           22.771596
base-20120608-233350           22.916315
base-20120611-184956            23.50955
base-20120609-171239           23.903934
base-20120610-175412           24.060014
base-20120610-002640           24.060659
base-20120613-104221           24.181404
base-20120611-190036             24.4093
base-20120609-102738           31.385305
base-20120615-174629           37.357823
base-20120613-084231           44.244381

sumosim

Monday, October 22, 2012

Results of Breeding

Monday, October 1, 2012

Basic Breeding Session