Dataset Factory★ EST. 2026 · BEST AT 800×600 ★
★ WELCOME TO THE DATASET FACTORY ★ PUBLIC DATA → CHECKED BUILDS → HONEST BASELINES ★ NO POP-UPS ★ NO COOKIES ★ NO TRACKERS ★ HAND-MADE HTML ★ UNDER CONSTRUCTION SINCE THE NINETIES ★
Release notes · 2026-10-19 · announcement

A citation-prediction task from MSHA's enforcement record

Suitability and evaluation

Retained for retrospective model-development research with documented timing limitations. Later evaluation rows expose earlier outcomes; predictions require restricted access.

Supported uses: Retrospective train/validation model-development experiments under the documented timing and selection limitations; Final evaluation only under a protocol that isolates holdout data from development and prevents later rows influencing earlier predictions

Not supported: Claims of verified real-time or operational forecasting validity; Treating development/validation scores as untouched final-test results; Forecasting scores from unrestricted cross-row access to this artifact

Historical feature availability
assumed
Training-label timing
unverified
Data vintage
current snapshot
Row selection
unverified
Required evaluation access
chronological

Cross-row audit: recovery demonstrated. Independent operator-commissioned audit; predictions frozen before labels were opened; holdouts sealed; two AUC implementations in exact agreement

The labeled eval split is development/validation data. Isolate final holdout data from development and prevent later rows influencing earlier predictions. Published data is not a secure hidden test service.

  • reverse-history join through days_since_previous: a later inspection S ships prev_target_cited for T
  • The labelled holdout is presumed to carry the same self-answering structure by construction; it was never opened by the audit and must be treated as compromisable by the same join class.
  • Historical feature/label availability at the declared instant is assumed from current snapshots, not verified against release vintages.
  • The current scorer passes the complete feature frame to predict_proba; prediction-time isolation is instructed but not mechanically enforced, so any framework score on these files is gameable.
  • Prior outcomes are ordered by inspection start date, without checking when citations became known. Current mine attributes are applied to historical events. The scored pool includes inspections with recorded violations, not every inspection.

Corrections to historical documentation

  • Public site page, Hub card and repository README must state the restricted suitability once rendered; no frozen package bytes change.

Reviewed 2026-10-24. Applies to this artifact; original data and tags are preserved.

This release packages 497,897 mine inspections into 45 per-section research tasks. Inspection start is the intended prediction instant. History is ordered by earlier inspection start dates, which does not establish that those inspections' citations were already available; current mine attributes also lack historical-vintage verification. The original leakage checks missed later-row outcome exposure, now documented in the suitability notice.

The task is binary and per-section: will this inspection cite 30 CFR 56.12004? The label is the set of sections the inspector actually wrote, taken from the violation rows, so this is an enforcement outcome - what the inspector found - and not a hazard measurement. Each of the 45 shipped sections is a complete task instance over the identical pool: train 2001-2020, eval 2021-2023, holdout 2024-2025.

The numbers are published with their floor. On the reference section sec_56_12004 the baseline reaches 0.8036 eval AUC, identical from the training path and an independent validation re-run. The persistence reference - the same model using only whether that section was cited at the mine's previous inspection - reaches 0.5831, so the full feature set clears it by 0.2205. Section prevalence ranges around 9-11% on the reference task; score AUC, not accuracy.

→ Open the dataset page for numbers, files and checksums

★ THANKS FOR VISITING · BOOKMARK THIS PAGE · TELL A FRIEND ABOUT THE DATASET FACTORY · SIGN THE GUESTBOOK BEFORE YOU LEAVE ★