Hugging Face's logo

Datasets:
jordiclive
/
scored_summarization_datasets

Modalities:
Tabular
Text
Formats:
parquet
Size:
1M - 10M
Libraries:
Datasets
Dask
Dataset card Data Studio Files
xet
 Community
Dataset Viewer
The dataset viewer is not available for this dataset.
Unexpected token '<', "<html> <h"... is not valid JSON

Need help to make the dataset viewer work? Make sure to review how to configure the dataset viewer, and open a discussion for direct support.

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Dataset Card for "Scored-Summarization-datasets"

A collection of Text summarization datasets geared towards training a multi-purpose text summarizer.

Each dataset is a parquet file with the following features.

default

  • text: a string feature. The source document
  • summary: a string feature. The summary of the document
  • provenance: a string feature. Information about the sub dataset.
  • t5_text_token_count: a int64 feature. The number of tokens the text is encoded in.
  • t5_summary_token_count : a int64 feature. The number of tokens the summary is encoded in.
  • contriever_cos: a float64 feature. The Cosine Similarity of the Contriever text embedding and Contriever summary embedding.

Sub-datasets

  • billsum
  • cnn_dailymail/3.0.0
  • multixscience
  • newsroom
  • samsum
  • scitldr/AIC
  • tldr-challenge
  • wikihow
  • xsum

Information about the Contriever model can be found here: https://github.com/facebookresearch/contriever.
Downloads last month
325
Total file size:
7.07 GB

Models trained or fine-tuned on jordiclive/scored_summarization_datasets