performance-testkit/dev.s7a.strata.performance/JmhPerformanceEvidence

JmhPerformanceEvidence

JVM-only evidence validation, aggregation and comparison over standard JMH output. JMH owns collection; this API consumes preserved receipts and never times an operation itself.

Functions

compare

fun compare(baseline: List<Path>, candidate: List<Path>, collector: Path, repetitions: Int = 3): JsonObject

Revalidates both raw sides; only target bytes may differ and invocation IDs cannot be reused. Absolute operation times never determine validation success.

summarize

fun summarize(directories: List<Path>, collector: Path, repetitions: Int = 3): JsonObject

Requires independent complete matrices with identical collector, fixture, inputs, targets and host conditions. SampleTime preserves per-run percentile medians; AverageTime summarizes only scores.