polish-dynaword / data /sejm_api /sejm_api.md
kacperwikiel's picture
Add source: sejm_api — contemporary parliamentary speeches (2023 onward) (#16)
8d04201
|
Raw
History Blame Contribute Delete
2.72 kB

sejm_api

Contemporary official Polish Sejm speeches, supplementing existing parliamentary sources.

Dataset description

  • Source (upstream): https://api.sejm.gov.pl/
  • Source documentation: https://api.sejm.gov.pl/sejm.html
  • Domain: political/spoken
  • Language: Polish (pl)
  • License: public-domain (official documents)
  • Created (range): 2023-01-11, 2026-07-03
  • Added: 2026-08-22
  • Contributor: Piotr Styła (PiotrSty on Hugging Face; PiotrStyla on GitHub).

Licensing — traceable basis

Official parliamentary documents and materials are excluded from copyright by article 4(2) of the Polish Copyright Act: https://eli.gov.pl/api/acts/DU/2025/24/text/O/D20250024.pdf.

Reuse of public-sector information is governed by articles 2(12), 5, 6, 14, 15 and 17 of the Polish Open Data Act: https://eli.gov.pl/api/acts/DU/2023/1524/text.html.

The per-document value intentionally matches the existing parliamentary source. No unverified upstream Creative Commons license is asserted.

Provenance and reproducibility

  • Official provider: Kancelaria Sejmu RP.
  • Immutable source release: PiotrSty/sejm-speeches-corpus@v1.0.1.
  • Pinned source commit: 124557799608ce4212cf22fa90ca7904618de1b6.
  • Reviewed DynaWord base commit: 8cc48a3c564ac9edabfbbf012842ad11f70a3e5c.
  • Rebuild: python src/fetch_sejm_api.py --help.
  • Source URLs and speech-level provenance are in sejm_api.attribution.jsonl.
  • Slayer contribution digest: sha256:38e42a791d68d593f82e1125f2bb94cd8f68212433e71d3e3da90f82d78eaf32.

Temporal novelty and deduplication

parliamentary ends on 2019-12-31 and registered parlamint_pl ends on 2022-12-31. Every contributed record is dated on or after 2023-01-01, so its date range overlaps neither source. Exact duplicate speech texts within the contribution are removed using SHA-1 fingerprints; this is not a claim of global cross-domain near-deduplication.

Statistics

Measure Value
Source rows inspected 157,714
Rows before 2023-01-01 118,902
Exact duplicate texts removed 0
Documents published 38,812
Characters 96,596,566
Tokens (cl100k_base proxy) 36,335,587
Documents with speaker attribution 38,812

Statistics are recomputed from the released Parquet file. The canonical schema is id, text, source, added, created, token_count, license, author.

Privacy and limitations

The upstream release heuristically redacts email addresses, PESEL identifiers and unambiguous Polish telephone numbers. Public-official names and speech attribution remain. Regex redaction is not a guarantee of zero personal data. Downstream users must review applicable privacy, third-party and source terms.