Dataset Factory★ EST. 2026 · BEST AT 800×600 ★
★ WELCOME TO THE DATASET FACTORY ★ PUBLIC DATA → CHECKED BUILDS → HONEST BASELINES ★ NO POP-UPS ★ NO COOKIES ★ NO TRACKERS ★ HAND-MADE HTML ★ UNDER CONSTRUCTION SINCE THE NINETIES ★

EIA861 Reliability Deterioration

Given three years of published distribution-reliability history and utility attributes, will a U.S. electric distribution utility's day-to-day outage duration (SAIDI excluding major event days) jump by at least 50% above its own recent norm in the next calendar year?

Versioned research data. Read the suitability requirements before interpreting scores.

Suitability and evaluation

Evaluation setting: retrospective research. Read the prediction setting and limitations below. Public validation is development data; downloadable holdout labels must stay outside the evaluated agent workspace.

At a glance

QuestionGiven three years of published distribution-reliability history and utility attributes, will a U.S. electric distribution utility's day-to-day outage duration (SAIDI excluding major event days) jump by at least 50% above its own recent norm in the next calendar year?
FieldU.S. Energy Information Administration (EIA), U.S. Department of Energy / binary-classification
Rows5,809
Documented splits3
This versionv-498e55482c3ed94b
Released2026-11-13
Validation ROC AUC0.6963780731791774
Validation Brier0.1190485278420198
Artifact6aa939acba34270679973c9e8b5ea12984814b146a32ca50ec71d3b23ac2790a

Get this dataset

How to load it

from datasets import load_dataset
ds = load_dataset('earino/factory-eia861-reliability-deterioration', revision='v-498e55482c3ed94b')

The version links and checksums identify this artifact. Exclude the labelled holdout from the agent's workspace when running an evaluation.

What is inside

SplitRowsPositive labels
eval1,294—
holdout2,062—
train2,453—

Files and checksums

DownloadBytesSHA-256
LICENSE-EVIDENCE.json820e42a16e9013a232d5a73a5ffc1db6197aa7417d7cf573d88612cf3211c74fed9
LICENSE.md1,4443a6aa6fe2a62707ee51429f107f3255567836b96c3e6d41d071e251179e1f65e
README.md7,7922b032e6f12130f1b8ca4771864c2a374d4a3965e4c1860ec6813297ab3059e78
SOURCES.json4,2586f062650ffce5320e2b6da73fff1edd6d2b2f5cd33510387388698b51aa89a9f
evaluation.json1,84673b4951b670f6482eea54ea9e5b3ff4c99c886860275be3f616112c8de81bdaf
extract__meta.json1,9985623e36dec6ec0a313cb0e3d0b2cd033b4731519423d433cb3a7dea42d8e785d
extract__private__holdout.csv290,700721984dd348b46d1a1e468cf170d7a6e28e3ecf744919a51d7211183972061ff
extract__public__eval.csv182,5627a6310d4685523a3655cec1b57dd9e1dcf2df739d4bac4540a6bf45b84ce6d78
extract__public__train.csv341,95352107eccf49ebf0d76599065baa13c9c7dcad721a27e4e446273470b404c8782
extract__quality.json23,057f8f15851b6407e76888e87180f338f5e7a0b66994a7ac2517e02cba0a26703b3
get_dataset.py3,680fad89222d50f9d9709225c34909be74c591df409c08b8b5951eba9d3cadfdd48
qualification.json20,3136f7982722ce91800a467deb1fc3f681cedc3a247802b0360fd70f8e5fd174331
reproduction__LICENSE-CC0-1.0.txt7,048a2010f343487d3f7618affe54f789f5487602331c0a8d03f49e9a7c547cf0499
reproduction__LICENSE-MIT.txt1,12456b932ff064e5da113ae10175c8546325f64f26e1ece71683ffcbf8b2304fe1c
reproduction__artifact_scrub.py11,3698c663253e691a7b8751f9c853b40a3752a833360caafb1ea8e8f534e64af4b68
reproduction__build.py47,905268e7e918df63581a60e1596426520f0901317c3e3d9fb6a97309a8458b4abb7
reproduction__construction.json22,6944ba0e46f119e0524f2dbff39e36f50f0d22cdb939efc9cfd8b3f582b9adab1f0
reproduction__dataset_package.py7,927c2364defe58dcc99322be59a1bb04894ce00e823ce37afeb37bc31012f744327
reproduction__dataset_run.py12,3818085fae14d6e93b852e692e18c1ef72113a3601f48f78901b6d1ae6db278de57
reproduction__get_dataset.py3,680fad89222d50f9d9709225c34909be74c591df409c08b8b5951eba9d3cadfdd48
reproduction__leakage_battery.py17,379adbf7ee0aca0012b78cc1f1e4aeb968a23717cae30f66a02e080215e75f830e3
reproduction__provenance.json573c4b7e3bae1aa9b5152d0080fd6ef89ce05da483deaa897e8ffa979063150217c
reproduction__qualify_dataset.py66,067bff6d43d0904182e2612c32bab702e41addbf389904a236c209e78be39e37a6b
reproduction__recovery_recipes.py17,609f64c542fcda232169c95ace17421b45275194b934938c0ea4c9b68e6f844ad0e
reproduction__requirements.txt1605c72f3268174d20364624f76680e189c408a05dba2e7b8cfe12d077b3865e7f0
reproduction__source.json20,77811411e17d4813c8115c5b8c79fba1ce04fca81879ce7162ec21ebab38b8bc819
reproduction__source_io.py5,6070c60eed4968cd342148efbaac7e4fa98f00708d8e6c14c0929928687b9af1ea3
reproduction__train.py2,500a3c6bcf13735bc85c52129ded68f839090dffdc266ebc3810dc61b2e6ea5e7e8
reproduction__validate.py1,277b597e7f84fed614e64b4a86fbecbd6ec0145916a24d0d221a796586976418e7b
reproduction__validate.sh4823f06ca48f11c2e05d331b4d8394284925de660c1d4b086d2f8243959e83b7e6d
source-checks.json9,335ce545f3813bf6e09a7d13fc04e2bea36b5e78c4bdbe087df0c5ef5c746d2ba82
source-snapshot.tar.gz60,145,1190ededf1f2b306f524d2aa3111541d041c2542ff2651d1ec9031adda7050cabe6
verify_dataset.py1,276f4a4bb7f565cdbd075c520621f881876b491eaed91a5e6e70afb31e4753f9834

Release notes · 2026-11-13

Given three years of published distribution-reliability history and utility attributes, will a U.S. electric distribution utility's day-to-day outage duration (SAIDI excluding major event days) jump by at least 50% above its own recent norm in the next calendar year?

Population: U.S. electric distribution utilities identified by EIA utility number that report a non-missing SAIDI excluding major event days in CY Y-3, Y-2 and Y-1 under one consistent reporting standard, report at least 1,000 customers in CY Y-1, carry an ownership code among investor-owned, municipal, cooperative, political subdivision, federal or state, appear with exactly one reliability record in each of those years, and report a SAIDI excluding major event days for CY Y+1. Utilities filing multiple state rows or changing utility number are dropped for that cohort. Missing CY Y+1 outcomes are dropped, never coded negative. No CY Y or later value enters features.

Target: Binary y=1 if the utility's reported SAIDI excluding major event days for calendar year Y+1 is greater than or equal to 1.5 times the median of its three reported SAIDI-excluding-major-event-day values for CY Y-3, Y-2 and Y-1; y=0 otherwise. Utilities with a missing CY Y+1 SAIDI-excluding-MED value are dropped, never coded 0.

Prediction time: 31 December of forecast year Y, using only Form EIA-861 reliability and utility attribute filings for calendar years Y-3, Y-2 and Y-1. Exact historical publication dates are assumed rather than verified. No CY Y or later value enters features.

Splits: Cohorts are forecast years Y = 2016, 2017, ..., 2024 (labels in CY 2017 ... 2025). Fixed chronological boundaries: train = Y 2016-2019, eval = Y 2020-2021, holdout = Y 2022-2024. No random reassignment and no re-splitting after measurement. Purge rule enforced in code: every feature year is <= Y-1, so the newest training feature year is 2018 while the earliest scored label year is 2021; therefore no training row's feature vector contains a year used to compute any eval or holdout label. Rows whose four-year window (Y-3 ... Y+1) spans a utility-number change or a change of reporting standard are dropped rather than carried across splits.

Outcome horizon: Calendar year Y+1, i.e. the twelve months beginning immediately after the decision instant; the outcome is observed when the CY Y+1 EIA-861 reliability file is published (roughly 9-12 months later).

Inputs: saidi_nomed_lag1: SAIDI excluding major event days for CY Y-1: minutes of non-momentary interruption the average customer experienced.; saidi_nomed_lag2: SAIDI excluding major event days for CY Y-2.; saidi_nomed_lag3: SAIDI excluding major event days for CY Y-3.; saidi_nomed_trend: Ratio of lag1 minus lag3 to lag3, a three-year level trend in non-storm outage duration. Missing when lag3 is zero; no interpolation.; saidi_with_med_lag1: SAIDI including major event days for CY Y-1, showing how much recent duration came from storm-scale days.; saifi_nomed_lag1: SAIFI excluding major event days for CY Y-1: non-momentary interruptions per customer-year.; saifi_with_med_lag1: SAIFI including major event days for CY Y-1.; caidi_nomed_lag1: CAIDI excluding major event days for CY Y-1: average minutes to restore an interruption. Derived from SAIDI divided by SAIFI when the reported CAIDI is absent and SAIFI is positive.; customers_lag1: Customer or meter count reported with the CY Y-1 Reliability schedule, used as a scale control.; reporting_standard: Whether the utility reported under IEEE 1366 or an internally defined other method in CY Y-1, normalized to IEEE or OTHER. A utility must carry one consistent value across the four filings used by a cohort.; ownership_code: Utility ownership type among investor-owned, municipal, cooperative, political subdivision, federal or state, from the CY Y-1 Reliability filing or the annual utility data file.; state: Utility reported state, used for calendar and regulatory-regime controls.

Recorded structural checks and baselines

PASSED Gate 1.6.1.

Existing unmodified runner baseline on public validation only; no holdout scoring

These historical checks do not establish availability at each prediction time or protection against every shortcut. Scores below describe the recorded protocol.

Limits

Source, licences, and citation

U.S. Energy Information Administration (EIA), U.S. Department of Energy

Source: U.S. Energy Information Administration, Form EIA-861, Annual Electric Power Industry Report.

Source: U.S. government work, public domain under 17 U.S.C. Sec. 105 as stated by EIA: data and files may be used and distributed; EIA requests an acknowledgment naming EIA and a publication date. No publisher licence grant is required or implied for third-party material EIA hosts (photographs, logo).. Compilation: CC0-1.0. Code and documentation: MIT.

Our additional compilation rights only; upstream terms remain in force.

Suggested citation

U.S. Energy Information Administration, Form EIA-861, Annual Electric Power Industry Report.

Versions

★ THANKS FOR VISITING · BOOKMARK THIS PAGE · TELL A FRIEND ABOUT THE DATASET FACTORY · SIGN THE GUESTBOOK BEFORE YOU LEAVE ★