Commons:Structured data/GLAM/Tools

Here is a list of tools that can be used by users or GLAM-Wiki initiatives to add and query Structured data on Wikimedia Commons media files: tools for batch uploads or campaigns and for analytics and visualizations.

A number of other lists of tools exist:

See also the GLAMwiki Toolset, a formerly widely-used upload tool, abandoned in 2022.

For batch uploads or campaigns

OpenRefine

OpenRefine is a tool that you can use to accomplish edits, batch edits, and uploads to Wikimedia Commons, including adding and editing structured data and structured templates.

The process is intricate and it is described in detail on Commons:OpenRefine:

QuickStatements and Minefield

One alternative to inserting Structured data into media files that are already on Wikimedia Commons is the combined usage of the Minefield and QuickStatements tools.

The Minefield tool allows the user to convert the Commons file page titles to media ids (MIDs). QuickStatements version 2 support Structured Data on Commons if the user changes the field Create new command batch for from Wikidata to Commons and, at the commands, uses M numbers (MIDs) instead of Q numbers (QIDs).

ISA Tool

ISA is a tool for enrichment and micro-contributions that might be useful for some GLAMs. It allows anyone to add structured data to files on Commons in an easy and fun way. You can read more about it on its project page, and read the initial blog post about it: "Introducing ISA—A cool tool for adding structured data on Wikimedia Commons".

For adding structured data

Other tools for adding structured data to files on Commons include:

  • AC/DC ("Add to Commons, Descriptive Claims") - a gadget that allows adding statements to, and removing statements from, a group of files (for example a category).
  • Cat2Data - a beginner-friendly user script for adding statements to, and removing statements from, all files in a category
  • Depictor - lets you add depicts statements using a game-like interface. You can customize it using specific categories or SPARQL queries.
  • Image Annotator - a tool that runs image annotation campaigns on Wikimedia Commons
  • SDC - a user script similar to Cat-a-lot that allows adding limited number of structured data statements to files in a category


For analytics and visualizations

Wikimedia Commons Query Service

The Wikimedia Commons Query Service (WCQS) is an external application that allows for querying the entire set of Structured Data on Commons via SPARQL. More information about is available at this page. The Wikidata Query Help page, for the very similar Wikidata Query Service, provides more in-depth information about SPARQL querying.

You can find example queries based on Commons at the page Commons:SPARQL query service/queries/examples.

  • Images depicting Van Gogh works

Files that are tagged as "depicts (P180)" a painting that, on Wikidata, are tagged as having creator (P170) set to Vincent van Gogh (Q5582):

#defaultView:ImageGrid
select ?image ?painting ?paintingLabel ?paintingDescription ?thumb with {
  select * {
    service <https://query.wikidata.org/sparql> {
      ?painting wdt:P170 wd:Q5582;
                rdfs:label ?paintingLabel;
                schema:description ?paintingDescription.
      filter (lang(?paintingLabel) = "en")
      filter (lang(?paintingDescription) = "en")
    }
  } 
} as %paintings where {
  include %paintings. 
  ?image wdt:P180 ?painting.
  
  # This is a hack to make ImageGrid work
  ?image schema:contentUrl ?url. 
  bind(iri(concat("http://commons.wikimedia.org/wiki/Special:FilePath/", wikibase:decodeUri(substr(str(?url),53)))) AS ?thumb)
}

Try it!

  • Depictions of bridges

Files with depicts (P180) set to bridge (Q12280):

# Map of some images tagged with "depicts" (P180) = "bridge" (Q12280)
#defaultView:Map
SELECT ?file ?pov_coords ?image WHERE {
  ?file wdt:P180 wd:Q12280 ;
        wdt:P1259 ?pov_coords ;
        schema:contentUrl ?url ;
  bind(iri(concat("http://commons.wikimedia.org/wiki/Special:FilePath/", wikibase:decodeUri(substr(str(?url),53)))) AS ?image)
}

Try it!

Structured Data on Commons can be searched and visualized on Wikimedia Commons using the search bar, on both the standard MediaWiki search page and the Commons-specific page Media Search.

In either page, you can search on structured data by using the code haswbstatement:, followed by the properties and QIDs you want to search.

Example: If you want to search for a file in which the digital representation of (P6243) is the painting Almond Blossom (Q1432536), by Vincent van Gogh, you should search for: haswbstatement:P6243=Q1432536.

It's also possible to search within Commons categories for files that use Structured Data. Apply the code incategory, followed by the category's name, the haswbstatement: code, and lastly the property you want to search related to the category.

Example: If you want to look for files using depicts (P180) in the Images from Metropolitan Museum of Art category, you should search for: incategory:Images_from_Metropolitan_Museum_of_Art haswbstatement:P180.

This is not only useful for the visualization and search of files, but it's also an easy way to get the number of files that use certain metadata. In the Images from Metropolitan Museum of Art category, for example, there are 54,389 results (as of July 2021).

For more information about the development of Media Search, see Commons:Structured data/Media search. Access this page for more examples on how to search Structured Data on Commons.

Commons Walkabout

The site Commons Walkabout offers possibly the easiest way to query and browse the structured data on Commons: by clicking on various property names and their values, you can both see the set of data in its entirety, and drill down to find specific combinations of values.

Here, for example, you can see a listing of all files tagged as having digital representation of (P6243) for the painting Portrait of Dr. Gachet.

Category:Structured Data on Commons Category:Structured Data on Commons Category:GLAMWiki
Category:GLAMWiki Category:Structured Data on Commons