Benchmarks suite and Benchmarks selection


The domains employed in the completion are summarized in Section 3 of the LPNMR report .

In the following table, details are reported for each domain.

Domain Authors Problem Track Description Download**
 Graph Coloring Johannes Wallner, Marcello Balduccini*, Yuliya Lierler, Martin Gebser*   Decision  1 view  get
 Knight Tour with Holes  Francesco Calimeri, Neng-Fa Zhou, Martin Gebser*  Decision  1 view  get
 Labirinth  Carmine Dodaro, Gb Ianni, Martin Gebser  Decision  1  view  get
 Stable Marriahe  Mario Alviano, Carmine Dodaro, Francesco Ricca, Martin Gebse*  Decision  1  view  get
 Visit-all  Giovambattista Ianni,Nir Lipovetzky, Carlos Linares López, Martin Gebser*  Decision  1  view  get
Combined Configuration  Anna Ryabobon, Gottfried Schenner  Decision  2  view  get
Consistent Query Answering  Carmine Dodaro  Query  2  view  get
 Graceful Graphs  Christian Drescher  Decision  2  view  get
 Incremental Scheduling  Marcello Balduccini, Yuliya Lierler, Martin Gebser*  Decision  2  view  get
Nomystery  Giovambattista Ianni, Carlos Linares López, Hootan Nakhost, Martin Gebser*  Decision  2  view  get
Partner Units  Anna Ryabokon, Andreas Falkner, Gerhard Friedrich, Martin Gebser*  Decision  2  view  get
Permutation Pattern Matching  Martin Lackner, Andreas Pfandler, Martin Gebser*  Decision  2  view  get
Qualitative Spatial Reasoning  Jason Jingshi Li, Martin Gebser*  Decision  2  view  get
Reachability  Carmine Dodaro, Giorgio Terracina  Query  2  view  get
Ricochet Robots  Julius Höfler, Martin Gebser, Philipp Obermeier, Roland Kaminski, Torsten Schaub  Decision  2  view  get
Sokoban  Giovambattista Ianni, Wolfgang Faber, Carlos Linares López, Martin Gebser*  Decision  2  view  get
Connected Still Life  Christian Drescher  Optimization  3  view  get
Crossing Minimization  Carmine Dodaro, Graeme Gange, Peter Stuckey, Martin Gebser*  Optimization  3  view  get
Maximal Clique  Guenther Charwat, Martin Kronegger, Johan Wittocx, Martin Gebser*  Optimization  3  view  get
MaxSAT  Carmine Dodaro  Optimization  3  view  get
Steiner Tree  Joachim Janser  Optimization  3  view  get
System Synthesis  Benjamin Andres, Martin Gebser  Optimization  3  view  get
Valves Location  Andrea Peano,   Optimization  3  view  get
Video Streaming  Bruno Biermaumer, Kostyantyn Shchekotykhin  Optimization  3  view  get
 Abstract Dialectical Frameworks  Stefan Ellmauthaler, Johannes Wallner  Optimization  4  view  get
 Complex Optimization  Roland Kaminski, Torsten Schaub, Martin Gebser*  Decision  4  view  get
Minimal Diagnosis  Marcello Balduccini, Martin Gebser*  Decision 4  view  get
Strategic Companies  Mario Alviano, Marco Maratea, Francesco Ricca  Query 4  view  get

 A "*" indicates that the encoding devised in 2014 by the organizers (mainly Martin) was used instead of the one provided in the 2011/2013 editions. For details about the encodings please refer to the full competition report published in Artificial Intelligence.

(**) Organization of the downloadable directory can be found here.

(***) Checkers for all domains can be found here.


Differently from past years, the selection of the evaluated instances has not been completely random, but a selection process has been applied to the instances available in order to classify the instances w.r.t. the expected hardness.

Details on the selection can be found in Section 4 of the LPNMR report .

Interestingly, the selection is then implemented in ASP! Please find here the files used for the selection.





You are here: Home Benchmarks suite and selection