CCF Observatory
A lighthouse on Canada’s climate coverage
0 %
Lighting the lighthouse…
Chapter 03 · Database & method

From collection to publication,
six operations, every day.

One processing chain reads the corpus: it collects, annotates sentence by sentence, extracts the people, organisations and places named, groups converging coverage into events, and publishes the result in the live observatory. It runs on today’s news and on nearly fifty years of archives alike.

6operations
4×a day
22outlets
2languages
The processing chain

Our method, in a nutshell

Our methodological steps are presented below in the order they were carried out. The first two ran once, when the models were built; the other four run every day, over breaking coverage and over an archive that reaches back to 1978.

Where the result lands

Every annotated article joins the live observatory as soon as it clears the chain, feeding the daily journal, the media pulse and the provincial map. The real-time processing view shows the chain at work, article by article.

The processed corpus

What our method has produced, 1978 to today

287,227 annotated articles

Every article is cut into two-sentence units before the models read it.

10.0M two-sentence units

The reading grain: each label is set on one of these units.

65 annotation categories

Events, frames, quoted voices, emotions: the grid applied to every unit.

0.866 macro F1, gold standard

Measured on a thousand hand-coded sentences never seen in training.

What 0.866 means

We set aside one thousand sentences, hand-coded by an expert and never shown to the models during training. On those sentences the models find the right code roughly 87 times out of 100, all categories taken together. That is an average: some categories are recognised almost every time, others far less often. Each category therefore carries its own reliability tier, A, B or C, published with it. The Validation chapter gives them one by one, along with how closely the two annotators who coded those same sentences agreed without seeing each other’s work (0.894).

The heart of the method

From labelled sentences to events, waves and voices

Each reading crosses the labelled sentences across the whole corpus. Several outlets converging on the same facts become a dated, typed event; a frame climbing above its historical baseline and staying there becomes a cascade; a person’s measured presence, crossed with the type of voice they carry, becomes a figure of the day; and the arguments about the science itself become a balance sheet, side by side. The What we extract chapter opens the animated demonstration for each of them.

Published in Scientific Data · 2026

The technical paper and the code

The paper, published in Scientific Data (Nature Portfolio, 2026), sets out how the corpus is built, how the models were trained and how their reading is checked against human annotators. The public repository holds the code that applies them.

Next step The dimensions
Go to the observatory