Newswire: A Large-Scale Structured Database of a Century of Historical News
Paper • 2406.09490 • Published
How to use dell-research-harvard/topic-antitrust with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="dell-research-harvard/topic-antitrust") # Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("dell-research-harvard/topic-antitrust")
model = AutoModelForSequenceClassification.from_pretrained("dell-research-harvard/topic-antitrust")This model is a finetuned RoBERTa-large, for classifying whether news articles are about antitrust.
from transformers import pipeline
classifier = pipeline("text-classification", model="dell-research-harvard/topic-antitrust")
classifier("Merger is approved")
The model was trained on a hand-labelled sample of data from the NEWSWIRE dataset.
| Split | Size |
|---|---|
| Train | 329 |
| Dev | 70 |
| Test | 70 |
| Metric | Result |
|---|---|
| F1 | 0.9375 |
| Accuracy | 0.9429 |
| Precision | 0.9091 |
| Recall | 0.9677 |
You can cite this dataset using
@misc{silcock2024newswirelargescalestructureddatabase,
title={Newswire: A Large-Scale Structured Database of a Century of Historical News},
author={Emily Silcock and Abhishek Arora and Luca D'Amico-Wong and Melissa Dell},
year={2024},
eprint={2406.09490},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2406.09490},
}
We applied this model to a century of historical news articles. You can see all the classifications in the NEWSWIRE dataset.