Novelty dataset (animal health, food security, climate change)

Version 1.0
Menya, Edmond; Interdonato, Roberto; Owuor, Dickson; Roche, Mathieu, 2025, "Novelty dataset (animal health, food security, climate change)", https://doi.org/10.18167/DVN1/8C9ZTN, CIRAD Dataverse, V1
Learn about Data Citation Standards.
Contact Owner Share
Dataset Metrics
10 Downloads
Description
This dataset contains sets of news article segments in English related to three domains namely animal health, food security and climate change and has been used to fine-tune and evaluate GPT3.5-turbo, GPT4o, DeepSeek-V3, DeBERTa, RoBERTa, BERT, EpidBioELECTRA and EpidGPT models for novelty detection tasks in the three domains. It is composed of 10,660 animal disease, 1,100 food security and 2,200 climate change article segments in csv format with information about the parent articles (segment, doc id, seg id, title, source url, publication date, article domain, article subdomain).

Animal health domain is made up of 22 subdomains inclusive of article segments on Avian Influenza (AI) 2310, Highly Pathogenic Avian Influenza (HPAI) 3060, African Swine Fever (ASF) 1000, Foot-and-Mouth disease (FMD) 1165, Bovine Spongiform Encephalopathy (BSE) 770, Brucellosis 435, Peste des Petits Ruminants (PPR) 160, Bluetongue 165, Newcastle disease 155, Glanders 160, Disease X 140, Anthrax 120, West Nile Virus (WNV) 145, Middle East respiratory syndrome (MERS) 215, Infectious Salmon Anaemia (ISA) 110, Equine Influenza (EI) 200, Eastern Equine Encephalitis (EEE) 50, Porcine Reproductive and Respiratory Syndrome (PRRS) 85, Rift valley Fever (RVF) 30, Classical Swine Fever (CSF) 40, Rabies 30, Venezuelan Equine Encephalitis (VEE) 55, Viral Haemorrhagic Septicaemia (VHS) 15.

Climate change domain is made up of 7 subdomains inclusive of article segments on flash floods 340, drought 394, wildfires 184, hurricanes 349, heatwaves 385, global warming 299 and tsunamis 340.

The original articles dataset (corpus) contains documents from which created segments (drawn from original PADI-Web articles (relevant articles only) and those gotten from GDELT database (for news articles on food security events and climate change events)). (2025-05-02)
Subject Agricultural Sciences; Computer and Information Science; Earth and Environmental Sciences; Medicine, Health and Life Sciences
Keyword animal health, food security, climate change
License/Data Use Agreement

CC BY-NC-SA 4.0

Table
Tree
Filter by
1 to 6 of 6 Files
 Request Access
animal_health.csv
Novelty dataset/Comma Separated Values - 4,1 MB
Published 5 mai 2025
4 Downloads
MD5: 098a5fd265eec3fa478dbdcbf9ef96f8
Data
Preview "Novelty dataset/animal_health.csv"
climate_change.csv
Novelty dataset/Comma Separated Values - 1,4 MB
Published 5 mai 2025
4 Downloads
MD5: 61454dd4176023c8652ccf914dce8768
Data
Preview "Novelty dataset/climate_change.csv"
food_security.csv
Novelty dataset/Comma Separated Values - 671,3 KB
Published 5 mai 2025
1 Download
MD5: 9a24b0ba04aea52c86419dada00841fc
Data
Preview "Novelty dataset/food_security.csv"
merged_data.csv
Novelty dataset/Comma Separated Values - 6,2 MB
Published 5 mai 2025
1 Download
MD5: f2eeb18b6aa7d000cabe49913c6bfaf6
Data
Preview "Novelty dataset/merged_data.csv"
gdelt_articles_foodsecurity_climatechange.csv
Original articles padiweb gdelt/Comma Separated Values - 9,1 MB
Published 5 mai 2025
0 Downloads
MD5: 5948a0acc0e91624b3913de4a74e0e4b
Original articles dataset (corpus)
Data
padi_web_relevant_articles_animalhealth.csv
Original articles padiweb gdelt/Comma Separated Values - 957,1 KB
Published 5 mai 2025
0 Downloads
MD5: 21662aac3cf166bc5e63a730a74bb96a
Original articles dataset (corpus)
Data
Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Enable access request
You must enable request access or add terms of access to restrict file access.
Save Changes
Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.
Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Continue
Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.
Restricted Files Selected

The selected file(s) may not be downloaded because you have not been granted access.

You may request access to the restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 100,0 MB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Restricted Files Selected

The restricted file(s) selected may not be downloaded because you have not been granted access.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Private URL

Private URL can only be used with unpublished versions of datasets.

Unpublished Dataset Private URL

Are you sure you want to disable the Private URL? If you have shared the Private URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? This is permanent an it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details
 
Version:
Last Updated:
Version:
Last Updated:
Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

  You need to Log In to request access.

Dataset Terms

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

CC BY-NC-SA 4.0

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

https://dataverse.cirad.fr/api/access/datafile/

Compute Batch
Clear Batch
Dataset Persistent Identifier Change Compute Batch
Compute Batch
Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Select if this is a minor or major version update.

Publish Dataset

This dataset cannot be published until UMR TETIS is published by its administrator.

Publish Dataset

This dataset cannot be published until UMR TETIS and CIRAD Dataverse are published.

Return to Author

Return this dataset to contributor for modification. The reason for return entered below will be sent by email to the author.