feature: provenance-safe post-abliteration recovery pipeline

Author: jmaglyCreated Aug 21, 2026Updated Aug 21, 2026
Labelsenhancement

Context

PR #127 bundled a QLoRA recovery trainer and a four-source dataset downloader with the blending feature. The proposal crosses separate model-loading, remote-code, dataset-license/provenance, network, GPU, persistence, and training-correctness boundaries. It had no relevant tests, implicitly trusted remote model code, trained on padding labels, swallowed all dataset-source failures, and could publish a partial or empty corpus as if it were complete and refusal-free.

Primary class: feature-track; dataset acquisition and resulting claims are research-integrity surfaces.

Acceptance criteria

  • define a versioned recovery-data schema and validate every message, role, source identifier, license field, and provenance locator;
  • pin dataset repositories/configurations/splits/revisions and record content hashes plus allowed redistribution/use terms;
  • describe refusal filtering as a tested heuristic, not a guarantee, with false-positive/false-negative evaluation;
  • fail closed on unavailable, truncated, malformed, or underfilled sources unless an explicitly labeled partial mode is requested;
  • write dataset and metadata atomically and make the exact corpus reproducible from seed plus pinned inputs;
  • keep remote model code disabled by default and expose an explicit, tested opt-in;
  • mask padding labels with -100, validate tokenizer padding behavior, reject empty datasets and invalid hyperparameters, and preserve prior outputs on failure;
  • provide CPU unit/contract tests plus separately marked network/download and Titan GPU runtime validation;
  • add locked optional dependencies and update risk-map, supply-chain, contributor, and operator documentation before merge.

The corrected delivery for PR #127 will not place this unvalidated pipeline in the importable package.

Source: elder-plinius/OBLITERATUS