The construction of data

A lesson on historical data criticism.

see assignments

George P. Lewis. A woman changes jacquard cards in a lace machine while working in a Nottingham factory during the First World War. September 1918. Imperial War Museum

about the lesson

Introduction

This lesson is based on the assumption that data are not neutral givens but rather structured representations shaped by cultural conventions, technical choices and research objectives. It begins by exploring the meaning and main characteristics of data before focusing on the specific nature of digital data.

More about the lesson

watch this animation

S The construction of data

A short video animation on Lea’s story and why we are all creators of data

Through the discovery of her grandmother’s forgotten archives, Lea learns that preserving memories involves more than saving objects. The animation explores how cultural digital data are created, documented, interpreted, and shared, while emphasizing the importance of ethics, consent, and long-term access to cultural heritage.

Created by Gorille.

complete these assignments M

M Assignments (5)


1 out of 5 — What are data?

The word “data” comes from Latin and means “that which is given” (this is also reflected in the French word for data, données). In fact, what we call “data” might more accurately be described as “capta” – “that which is taken”, as Johanna Drucker (2011) argues. Data are not simply found in the world; they are actively constructed through assumptions and choices that are cultural, historical, political and social (Drucker 2011, Loukissas 2019). Let’s explore the meaning and main characteristics of data.

Instructions

30 mins

1.a Objects becoming data

15 mins

1.b Understanding the core characteristics of data

20 mins

1.c Understanding data as cultural constructions

Reading/viewing suggestions

learning outcomes

  • Understand that data are structured representations with specific characteristics
  • Recognise the role of formats, conventions and standards in data representation
  • Reflect on the historical and cultural dimensions of data formats

2 out of 5 — Encoding and digital representation

How is reality translated into data? Encoding, the process of converting information from one format into another, lies at the heart of data recording.

One of the simplest forms of encoding is a physical mark on a surface, such as a notch in wood or a punched hole in paper, used to represent a simple meaning like “yes” or “no”. Similar principles still appear today in tickets, gift cards and punched cards. For example, punched train tickets are a manual system for recording travel information using small holes made in a paper ticket. A hole isn’t random, as it registers something specific, for example the validation of a ticket to prevent reuse by its holder.

The term “digital” originally meant numerical: data expressed through digits (Haigh 2023). Digital does not necessarily mean electronic. Early telegraphy, for example, encoded letters and words through just two types of signal: short and long impulses in Morse code.

Early computers followed similar principles. Punch cards stored information through the presence or absence of holes in specific positions. IBM punch cards, widely used from the 1930s onwards, encoded text, numbers and commands using standardised hole patterns. These systems already relied on a central principle of digital data: complex information can be represented through combinations of a limited set of distinct symbols.

15 mins

2.a Making sense of encoding with punch cards

25 mins

2.b Exploring text encoding

25 mins

2.c Images as encoded data

20 mins

2.d Why encoding schemes matter for historians

Reading/viewing suggestions

learning outcomes

  • Understand how encoding mediates the transformation of information into machine-readable digital data
  • Recognise that digital representations depend on technical standards, formats and encoding schemes
  • Critically reflect on how encoding shapes the preservation, interpretation and accessibility of historical sources

3 out of 5 — From sources to data

We will now explore how data are produced to describe and study the world around us. Texts, people, animals, places and historical events can all be transformed into descriptive data. By creating such data, historians turn sources into structured representations that can be organised, searched and analysed. This process is both conceptual, involving research choices and categories, and technical, relying on tools such as spreadsheets and databases, which also introduce their own constraints.

25 mins

3.a Designing descriptive categories

40 mins

3.b Creating descriptive data

30 mins

3.c Creating datasets

Reading/viewing suggestions

learning outcomes

  • Select descriptive categories and attributes that are appropriate for a specific research purpose
  • Organise information about people or objects into a table of records, attributes and values.

4 out of 5 — Understanding the relational database

The previous section highlighted the creation of single tables to describe one type of object. But historical sources usually involve many different kinds of objects at once – people, places, organisations, events, etc. – and various connections between these objects. Furthermore, if historians need to analyse hundreds or thousands of documents, the information may quickly become repetitive and complex to manage. When spreadsheets are no longer sufficient to effectively work with sources, relational databases come into play. Based on specific software, databases were designed to organise large amounts of information while preserving the connections between the described objects.

This section focuses on the concept of data models and the principles underpinning their implementation, using a simple example of a historical source (a newspaper article). Technical notions are explained briefly, but mastering them in depth is beyond the scope of this lesson. Help can be found in the resources proposed in the reading suggestions.

Instructions

35 mins

4.a Designing a data model

10 mins

4.b Extracting historical information from sources

25 mins

4.c Organising complex historical information

30 mins

4.d Implementing a data model in a relational database

60 mins

4.e Example database – Sources

20 mins

4.f Linking the database

30 mins

4.g Extending the database

Reading/viewing suggestions

learning outcomes

  • Understand a simple data model designed for historical sources
  • Recognise relationships and how they are implemented in a data model
  • Understand the transition from the abstract data model to the physical database

5 out of 5 — Converting data: the example of JSON format

Historians increasingly work with digital tools that require data in specific formats. A format represents the way data are encoded, stored and displayed; it can be important for how data can be used, exchanged and shared. The format is reflected in the extension of the data file (for example .csv).

When working with digital tools, structured formats make it easier to exchange data between information systems. Structured formats use standardised rules regarding the architecture and form of the data they contain, commonly called the data schema.

For example, in assignment 3, we worked with data in the form of a table. Tabular data are best stored, displayed, used and shared in CSV (comma-separated values) format. Tables are extremely useful, but data often need to be converted from one format to another.

Why is this useful?

  • Different tools require different formats (for example web applications)
  • Some formats are better suited to storing and exchanging large volumes of data
  • Some formats allow more complex structures than tables

All data formats are based on a simple principle: they employ a small set of agreed-upon rules (a syntax) for marking the beginning and end of one piece of information after another, allowing the data to be read by machines and expanded or manipulated as long as the rules are known to the specific software and system.

Several formats are commonly used in digital humanities and digital history. XML (Extensible Markup Language) is mainly used to annotate text or describe layout (it underlies all Microsoft Word documents). Most formats, for example JSON (JavaScript Object Notation), can be adapted to store and structure any sort of information. We will work with JSON in the following sections of this lesson because it is widely used and works well for the hierarchical data often employed by historians.

JSON is designed to:

  • represent structured data in a way that computers can easily process
  • allow more flexible organisation of information (for example nested data)

In this assignment, you will learn how to convert your tabular data into JSON and explore what this format makes possible.

20 mins

5.a Recognising structure in JSON

10 mins

5.b Understanding how JSON organises data

35 mins

5.c Creating your own JSON

30 mins

5.d Exploring JSON rules

20 mins

5.e Critiquing data formats

Reading/viewing suggestions

learning outcomes

  • Understand the principle and aims of converting data between formats.
  • Convert a CSV table into another structured format and validate the result using JSON as a worked example.