Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Changelog

Changelog

All notable changes to PARQONAUT are documented here.

0.9.2 - 2026-09-21

S3 multipart correctness at the default 5 MiB part boundary.

Fixed

  • MultipartAsyncWrite: do not re-buffer bytes when poll_write returns Poll::Pending during part flush; split full parts at the configured threshold and verify byte accounting on shutdown.

0.9.1 - 2026-09-20

Remote pipeline completeness: bounded streaming S3 publication and full local/S3 routing for convert, transform, and fused specs.

Added

  • Authoritative 6×4 remote pipeline matrix tests (remote_pipeline_matrix) on RustFS
  • S3 publication regression tests (roundtrip, visibility, failure/retry, conditional create conflict)
  • just pipeline-s3-demo — CSV drift → S3 convert → fused rewrite/partition with zero intermediate objects

Fixed

  • S3 multipart finalize on stream shutdown (committed objects visible after finish)
  • prqnt convert remote Parquet sinks stream via write_parquet_batch_stream (no full-object buffer)

Changed

  • s3-integration CI job runs storage roundtrip, remote convert, and transform matrix tests

0.8.1 - 2026-09-20

Patch release correcting transform demo recipes; no intended runtime behavior change from v0.8.0.

Fixed

  • just transform-demo aligned with prqnt flags (--output, --by, Parquet glob for merge)
  • S3 batch verify sees Parquet under committed publication prefixes; s3-resume demo uses non-overlapping sources

0.8.0 - 2026-09-20

Transform and streaming workflow release.

Added

  • prqnt partition, prqnt merge, prqnt split, and prqnt transform --spec (YAML pipelines)
  • Typed spec compilation (Spec → ExecutablePlan → execution → TransformReport)
  • Schema discovery, unification, and batch alignment in prqnt convert with conflict policies
  • Resumable streaming conversion with checkpoint identity, stale detection, and staged output
  • parqonaut-workflow progress and plan contracts; progress observer implementations
  • Transform/stream fixtures, demos (just transform-demo, stream-demo, stream-resume-demo)
  • Public docs: transform, streaming, roadmap

Changed

  • Workspace version 0.8.0; golden repair plans regenerated for version field

Note

Apache Arrow / Parquet stack convergence remains planned for v0.9.0 (see docs/development/columnar-convergence-plan.md).

0.7.1 - 2026-09-19

Documentation and delivery infrastructure release. No intended runtime behavior changes.

Added

  • GitHub Pages documentation site (mdBook)
  • Documentation CI workflow and just docs-build / just docs-check
  • Generated CLI reference (cargo xtask docs cli)
  • OpenAPI and Rustdoc publishing as part of the site build
  • Internal Markdown link checker

Changed

  • Reorganized public documentation navigation (docs/SUMMARY.md)
  • README links to the canonical documentation site
  • Release notes are committed before tagging (v0.7.1 discipline)

0.7.0 - 2026-09-19

Unified application server: CLI and HTTP share parqonaut-app; durable jobs for scan, repair, and batch orchestration.

ADDED

  • prqnt serve — PARQONAUT HTTP API at /api/v1 (OpenAPI, metrics, health live/ready).
  • parqonaut-app — transport-neutral scan, repair, and batch use cases.
  • Durable application_jobs model (scan, repair, batch_repair, batch_resume) with lease/recovery and cancellation.
  • Server storage policy (allowed local roots, S3 buckets/prefixes); PRQNT_BOOTSTRAP_ADMIN_TOKEN.
  • API integration scripts (scripts/api-test/), just api-test, api-demo, api-restart-demo.
  • CI jobs api-integration and postgres-integration.

CHANGED

  • CLI repair/batch commands delegate to parqonaut-app (scan already did).
  • OpenAPI title PARQONAUT API; metrics namespace parqonaut_; new bearer tokens use prqnt_ prefix.
  • SQLite scan_jobs migrated to application_jobs (data preserved).

SECURITY

  • Default bind 127.0.0.1; location policy enforced before storage I/O.

DEFERRED

  • Idempotency-Key, distributed workers, SDKs, web UI/TUI, TLS termination, plugin execution.

0.6.0 - 2026-09-19

Interface normalization: one public executable (prqnt), capability-oriented repository layout, and removal of legacy product entrypoints.

BREAKING

  • The parqonaut executable is renamed to prqnt. Update scripts, CI, and documentation accordingly. There is no compatibility alias.

REMOVED

  • paraclete-http legacy HTTP binary (service crate remains library-only; prqnt serve deferred).
  • Product-scoped fixture generator binaries (generate-phase2-fixtures, generate-phase3-fixtures, generate-phase4-fixtures, generate-phase5-fogbank-fixtures, generate-golden-plans).

CHANGED

  • Developer automation consolidated under cargo xtask (fixtures, golden plans).
  • Active tests, fixtures, scripts, Just targets, and CI jobs use capability names (scan, repair, schema, orchestration, object-storage, s3-integration) instead of numbered implementation phases.
  • paraclete-core scan modules renamed: scan_rules, scan_findings, schema_findings; evaluate_scan_rules replaces evaluate_phase1_rules.
  • CLI help describes PARQONAUT capabilities without predecessor engine branding.

ADDED

  • scripts/check-active-naming.sh and just naming-check (also wired into just ci and GitHub Actions).

0.4.1 - 2026-09-18

Release metadata correction only — no functional changes from v0.4.0.

Fixed

  • Workspace crate version aligned with the published v0.4.0 release tag (0.3.0 → 0.4.1)
  • CHANGELOG.md updated with missing release notes for v0.2.0–v0.4.0
  • README.md updated to describe current Phase 4 capabilities and batch workflow

0.4.0 - 2026-09-18

Multi-dataset batch orchestration with bounded concurrency, durable journal, resume, and verification.

Added

  • parqonaut-orchestrator crate — batch plan contracts, scheduler, SQLite run journal, locking, resume
  • prqnt batch check|plan|repair|status|resume|verify CLI commands with JSON output
  • SHIPWRECK Phase 4 fixture fleet and integration tests
  • Plan-bound authorization, output path mapping, and overlap detection for batch runs
  • Cooperative SIGINT cancellation and idempotent resume semantics
  • ADRs 0011–0014 and Phase 4 documentation
  • data/dummy.parquet sample dataset for scan/inspect tests

0.3.0 - 2026-09-18

Policy-governed schema reconciliation and explicit authorization for review-required repairs.

Added

  • Deterministic schema compatibility model and lossless schema widening
  • Explicit --authorize for ReviewRequired repair operations
  • prqnt doctor --policy, prqnt check, prqnt plan diff
  • Durable repair plan contract v1, execution manifests, staged publication
  • FRANKENLAKE v2 laboratory fixtures and Phase 3 demo
  • ADRs 0007–0010 and Phase 3 documentation

0.2.0 - 2026-09-18

Evidence-driven diagnose, plan, repair, and verify for single datasets.

Added

  • parqonaut-repair crate — scan → diagnose → plan → repair → verify pipeline
  • Dataset fingerprints and stale-plan rejection
  • Repair safety classification (Safe, ReviewRequired, Blocked)
  • prqnt doctor, prqnt plan, prqnt repair, prqnt verify
  • FRANKENLAKE Phase 2 fixtures and golden repair plans
  • ADRs 0004–0006 and Phase 2 documentation

0.1.0 - 2026-09-18

Initial unified release consolidating Paraclete, parqknife, and streaming-parquet (maw).

Added

  • Cargo workspace with Paraclete-derived scan chassis (paraclete-* crates)
  • parqonaut-transform — parqknife-derived inspect/rewrite/filter pipeline (Apache Arrow 54)
  • parqonaut-stream — maw-derived streaming CSV/Parquet conversion (arrow2)
  • Unified prqnt CLI with scan, inspect, rewrite, and convert commands
  • End-to-end demo: CSV → Parquet → scan → rewrite → rescan (just demo)
  • Integration tests covering all three engine families
  • Fixtures, Python plugin contracts, and migration documentation
  • GitHub Actions CI (fmt, clippy, test)
  • Provenance and architecture ADRs