The current state-of-the-art on GigaWord is Pegasus+DotProd. See a full comparison of 39 papers with code.

Text Summarization is a natural language processing (NLP) task that involves condensing a lengthy text document into a shorter, more compact version

31 янв. 2023 г. · To better evaluate LLMs, we perform human evaluation over high-quality summaries we collect from freelance writers. Despite major stylistic ...

31 янв. 2024 г. · This work benchmarks LLMs on news summarization using two popular benchmarks, CNN/DM (Hermann et al., 2015) and XSUM (Narayan et al., 2018).

This repository contains the data release for the paper Benchmarking Large Language Models for News Summarization.

We compare various methods on this benchmark and discover that on multiple tasks, moderately-sized fine-tuned models consistently outperform much larger few- ...

23 мая 2023 г. · We introduce a Wikipedia-derived benchmark, complemented by a rich set of crowd-sourced annotations, that supports 8 interrelated tasks.

In this benchmark, we compare the runtime performance of EvaDB and MindsDB on a text summarization application operating on a news dataset. In particular, we ...

2024. Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles.

Summarization creates a shorter version of a document or an article that captures all the important information.