User:AndreaWest/WDQS Testing/Explaining the Benchmark Queries Spreadsheet
The Wikidata SPARQL queries are defined in the Wikidata-Benchmark-Queries.xlsx in the wikidata-tests repository. There are two types of tests, static ones for compliance and dynamic ones for stress and workload testing, and two worksheet pages (one sheet for each type). The WikiTech page, WDQS Testing defines how testing will be executed.
Note that over time, additional queries will be added to the workload testing to better mimic required query characteristics.
The following sections overview the contents of the "Compliance" and "Stress" worksheets. Each row of a worksheet defines one test.
Compliance
The columns of the Compliance worksheet are:
- Static Query
- SELECT, ASK, CONSTRUCT, DESCRIBE
- Federation
- GeoSPARQL
- Truthy or Statement Predicates
- Solution Modifiers (Distinct, Limit, Order by, …)
- BIND, VALUES
- Algebraic Operators (Filter, Optional, Exists, …)
- Aggregation Operators (Count, Min/Max, Group by, ...)
- SPARQL Functions
- Property Paths
- Subquery
- # of Triples
- # of Join Vertices
- Largest Join Degree
- # of Variables
- Longest Chain
- Selectivity (High, Equal, Low)
- Result Set Size (Large, Medium, Small)
- Comments
- The source or inspiration for the query is listed. The following sources are used:
- Maintenance query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples/maintenance
- Joal query examples - https://wikitech.wikimedia.org/wiki/User:Joal/WDQS_Queries_Analysis
- Science query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Science
- Simple query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Simple_queries
- Showcase query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Showcase_Queries
- Example queries from https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries
- Wikibase + Wikicite + xxx from same pages as Simple queries
- Lexeme queries from https://en.wikibooks.org/wiki/SPARQL/WIKIDATA_Lexicographical_data or https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Lexeme_queries
- The source or inspiration for the query is listed. The following sources are used:
- Future Revision
Stress
The columns of the Stress worksheet are:
- Stress Test Query
- Based on Static Query
- SELECT, ASK, CONSTRUCT, DESCRIBE
- % of Queries
- Comments