Nov 17

November 17, 2021, English, virtually

BYOD workshop (Bring your own dataset) – How to use Wikibase, OpenRefine and Linked Data

Registration is closed!

Wednesday, 3-6 pm

This workshop aims to help researchers and data managers with making their datasets compatible with linked data. Participants will work with their own datasets and learn how to use OpenRefine to transform their data and Wikibase to store their data. This workshop is organized by NFDI4Culture and is part of our efforts to establish a Linked Open Data Working Group and a community of Wikibase users within the consortium.

Information for participants

  • Participants should come with their own dataset in machine readable form (for example csv, json or xml)
  • Participants are asked to install OpenRefine (3.5 beta version) before the workshop
  • Participants do not need to be experts in linked data – but they should be open to learning about it and to work with a very powerful and complex tool
  • Participants can expect to learn basics about linked data in 4Culture, OpenRefine and Wikibase and do some hands-on work by themselves

Registration

Registration is closed. Thanks for your interest!

Preliminary schedule

  • Introduction to  the LOD WG and the Wikibase community
  • Introduction of the participants and their datasets
  • Introduction to OpenRefine
  • Hands-on session
  • Break
  • Hands-on session
  • Evalutation and wrap-up

About the Linked Open Data Working Group (LOD-WG)

The Linked Open Data Working Group (LOD-WG) has been established in the 4Culture consortium as a place to discuss ongoing work as well as new approaches to working with linked data in 4Culture and external communities . In addition to regular meetings, we also organize workshops and tutorials for the wider public.

OpenRefine (previously Google Refine) is “a powerful tool for working with messy data: cleaning it; transforming it from one format into another; and extending it with web services and external data.” (Source: https://openrefine.org/) Most crucially for projects intending to use Wikibase and/or Wikidata as a final data repository, OpenRefine allows direct manipulation of data in Wikidata via a reconciliation service and an editing extension, all available within a graphical user interface and requiring no coding skills.

OpenRefine is a desktop tool, which users need to download and work with locally on their own machines. The official releases of OpenRefine can be downloaded directly from the app’s website here: https://openrefine.org/download.html. Make sure to download the 3.5 beta version as this will allow you to connect to any Wikibase instance. Once OpenRefine is downloaded, you can follow a simple set of installation instructions to set it up. Although OpenRefine is a desktop app that runs locally, it is actually a browser-based tool: launching it will open a new tab in your default browser and you will be able to access OpenRefine’s user interface directly via a browser tab.

About Wikibase

Wikibase and Wikidata are two related software packages from the Wikimedia family of applications. They allow the storage and management of structured machine-readable data (i.e. LOD), besides featuring other common characteristics of wikis, such as collaboration and version control features. Wikidata is the public-facing instance of the software – a type of Wikipedia for structured data; it is maintained by Wikimedia Germany. Wikibase is the open source software environment built to run Wikidata. Crucially, Wikibase can be deployed independently from Wikidata (and Wikimedia) and can be customized to suit the needs of individual data domains and data repositories.

Wikibase and Wikidata are two related software packages from the Wikimedia family of applications. They allow the storage and management of structured machine-readable data (i.e. LOD), besides featuring other common characteristics of wikis, such as collaboration and version control features. Wikidata is the public-facing instance of the software – a type of Wikipedia for structured data; it is maintained by Wikimedia Germany. Wikibase is the open source software environment built to run Wikidata. Crucially, Wikibase can be deployed independently from Wikidata (and Wikimedia) and can be customized to suit the needs of individual data domains and data repositories.

NFDI4Culture prototype

Within NFDI4Culture Task Area 1 we are using Wikibase to pilot new use-cases, and this workshop will draw on lessons learned from this work in order to showcase the benefits and challenges of  working with a custom Wikibase instance. Specifically, we will use the example of an MVP (minimum viable product) being developed within TA1/M4 for the enrichment of 3D media objects with annotations. The MVP is a partnership with the Corpus der barocken Deckenmalerei in Deutschland project team based at TUM. The MVP demonstrates a workflow starting from an existing data set (provided by the data partners) which goes through an OpenRefine transformation in order to be uploaded in a custom Wikibase instance. The data is then reused inside a 3D viewer and annotation tool (Kompakkt). The workshop will focus on the processes of data wrangling in OpenRefine, working with data in Wikibase and lastly uploading the data via OpenRefine that were established during the MVP development.

There will also be time to discuss how private Wikibase instances can be used in conjunction with Wikidata, taking advantage of its role as a big LOD hub.