STRIPS instances only

Here is a diagram with a larger collection of planners, but with restricted to STRIPS problems only. Several planners only support the STRIPS subset of PDDL. LAMA fares relatively a bit better when only STRIPS instances are looked at.

Results by domain

Here is a list of instances solved for each domain, and a score that is obtained as the sum of the percentage of instances solved by each planner in 30 minutes for each domain.

Solved instances by domain
domain instances M Mp MpX LAMA08 LAMA11 FF

1998-GRID 5 3 5 5 5 5 5

1998-GRIPPER 20 20 20 20 20 20 20

1998-LOGISTICS 30 29 30 30 29 30 30

1998-MOVIE 30 30 30 30 30 30 30

1998-MPRIME 20 18 20 19 20 20 19

1998-MYSTERY 19 18 19 18 19 14 16

2000-BLOCKS 102 84 63 94 54 95 80

2000-FREECELL 60 30 43 46 59 59 60

2002-DEPOTS 22 22 22 22 18 22 22

2002-DRIVERLOG 20 18 20 19 20 20 16

2002-ZENO 20 18 20 20 19 20 20

2004-AIRPORT 50 45 48 44 38 38 39

2004-PIPESWORLD-TANKAGE 50 12 38 38 38 41 22

2004-PIPESWORLD-NOTANKAGE 50 21 40 38 44 44 36

2004-OPTICAL-TELEGRAPH 14 14 14 14 3 14 13

2004-PHILOSOPHERS 29 29 29 29 12 14 14

2004-PSR-SMALL 50 50 50 50 50 50 43

2004-SATELLITE 36 30 35 35 31 36 36

2006-PATHWAYS 30 30 30 30 28 28 20

2006-ROVERS 40 40 40 40 40 40 40

2006-STORAGE 30 24 30 30 21 20 18

2006-TPP 30 30 30 30 30 30 28

2006-TRUCKS 30 23 24 18 8 15 11

2008-CYBER-SECURITY 30 30 30 30 29 29 4

2011-BARMAN 20 0 10 18 17 20 0

2011-ELEVATORS 20 1 20 20 20 20 20

2011-FLOORTILE 20 20 20 20 2 6 5

2011-NOMYSTERY 20 17 16 14 13 18 4

2011-OPENSTACKS 20 0 0 12 18 20 20

2011-PARCPRINTER 20 20 20 20 12 20 20

2011-PARKING 20 0 0 20 20 20 8

2011-PEGSOL 20 19 20 20 19 20 20

2011-SCANALYZER 20 13 20 18 20 20 20

2011-SOKOBAN 20 0 2 3 13 19 17

2011-TIDYBOT 20 3 17 17 14 16 15

2011-TRANSPORT 20 0 4 4 16 19 9

2011-VISITALL 20 0 0 8 20 7 4

2011-WOODWORKING 20 20 20 20 16 20 4

1998-ASSEMBLY-ADL 24 23 24 24 24 23 24

2000-ELEVATOR-SIMPLE 150 150 150 150 149 150 150

2000-SCHEDULE-ADL 150 150 150 150 134 138 134

2002-SATELLITE-ADL 20 20 20 20 20 20 20

2004-AIRPORT-ADL 50 44 48 48 31 45 30

2004-OPTICAL-TELEGRAPH-ADL 48 42 33 25 19 1 17

2004-PHILOSOPHERS-ADL 48 48 48 48 23 14 14

2006-TRUCKS-ADL 29 20 16 12 17 14 11

2008-OPENSTACKS-ADL 30 15 18 30 30 30 30

total 1646 1293 1406 1470 1332 1414 1238

weighted score 47 34.05 38.88 41.10 37.97 40.48 34.11

domain	instances	M	Mp	MpX	LAMA08	LAMA11	FF
1998-GRID	5	3	5	5	5	5	5
1998-GRIPPER	20	20	20	20	20	20	20
1998-LOGISTICS	30	29	30	30	29	30	30
1998-MOVIE	30	30	30	30	30	30	30
1998-MPRIME	20	18	20	19	20	20	19
1998-MYSTERY	19	18	19	18	19	14	16
2000-BLOCKS	102	84	63	94	54	95	80
2000-FREECELL	60	30	43	46	59	59	60
2002-DEPOTS	22	22	22	22	18	22	22
2002-DRIVERLOG	20	18	20	19	20	20	16
2002-ZENO	20	18	20	20	19	20	20
2004-AIRPORT	50	45	48	44	38	38	39
2004-PIPESWORLD-TANKAGE	50	12	38	38	38	41	22
2004-PIPESWORLD-NOTANKAGE	50	21	40	38	44	44	36
2004-OPTICAL-TELEGRAPH	14	14	14	14	3	14	13
2004-PHILOSOPHERS	29	29	29	29	12	14	14
2004-PSR-SMALL	50	50	50	50	50	50	43
2004-SATELLITE	36	30	35	35	31	36	36
2006-PATHWAYS	30	30	30	30	28	28	20
2006-ROVERS	40	40	40	40	40	40	40
2006-STORAGE	30	24	30	30	21	20	18
2006-TPP	30	30	30	30	30	30	28
2006-TRUCKS	30	23	24	18	8	15	11
2008-CYBER-SECURITY	30	30	30	30	29	29	4
2011-BARMAN	20	0	10	18	17	20	0
2011-ELEVATORS	20	1	20	20	20	20	20
2011-FLOORTILE	20	20	20	20	2	6	5
2011-NOMYSTERY	20	17	16	14	13	18	4
2011-OPENSTACKS	20	0	0	12	18	20	20
2011-PARCPRINTER	20	20	20	20	12	20	20
2011-PARKING	20	0	0	20	20	20	8
2011-PEGSOL	20	19	20	20	19	20	20
2011-SCANALYZER	20	13	20	18	20	20	20
2011-SOKOBAN	20	0	2	3	13	19	17
2011-TIDYBOT	20	3	17	17	14	16	15
2011-TRANSPORT	20	0	4	4	16	19	9
2011-VISITALL	20	0	0	8	20	7	4
2011-WOODWORKING	20	20	20	20	16	20	4
1998-ASSEMBLY-ADL	24	23	24	24	24	23	24
2000-ELEVATOR-SIMPLE	150	150	150	150	149	150	150
2000-SCHEDULE-ADL	150	150	150	150	134	138	134
2002-SATELLITE-ADL	20	20	20	20	20	20	20
2004-AIRPORT-ADL	50	44	48	48	31	45	30
2004-OPTICAL-TELEGRAPH-ADL	48	42	33	25	19	1	17
2004-PHILOSOPHERS-ADL	48	48	48	48	23	14	14
2006-TRUCKS-ADL	29	20	16	12	17	14	11
2008-OPENSTACKS-ADL	30	15	18	30	30	30	30
total	1646	1293	1406	1470	1332	1414	1238
weighted score	47	34.05	38.88	41.10	37.97	40.48	34.11