Skip to content

Conformance regression on main since 2026-07-08 ~08:15 UTC: 30 untriaged gap failures (7/8 shards) — window 3a46815aa..d6635879c, misattributed to innocent PRs #6124

Description

@proggeramlug

Every PR merge-ref built after 2026-07-08 ~08:15 UTC fails 7 of 8 conformance shards (shard 6 passes) plus compiler-output-regression, with 30 NEW untriaged gap failures — a mix of compile errors and output mismatches. Since main pushes don't run conformance, the failures show up misattributed on whatever PR runs next (first victims: #6115, a Dependabot console bump that only touches perry-container-compose, and the in-flight runs 28939125930 / 28940216860 / 28940322061).

Evidence for the regression window

Failing gap tests (union across shards, untriaged in known_failures.json)

Several of the compile-error tests (diagchannel, zlib_3285_params, …) need non-default feature-combo static-lib builds, so a perry-runtime/perry-stdlib compile error under specific --features combos would explain the "compile error" class while default-combo tests keep passing (and shard 6 stays green).

30 tests
test_gap_1831_yield_star_array               (compile error)
test_gap_arguments_object_3553plus           (compile error)
test_gap_1840_class_iterator_for_of_spread
test_gap_2021_json_stringify_grown_array
test_gap_2308_unrolled_loop_var
test_gap_2438_object_key_order
test_gap_2442_object_literal_accessors
test_gap_2792_2814_2794_2796_array_validation
test_gap_2823_2825_2822_promise_semantics
test_gap_5345_dup_static_field
test_gap_5588_object_assign_proxy_source
test_gap_5592_yield_star_value_get_abrupt
test_gap_array_callbacks_2797_2798_2799
test_gap_array_iterator_manual_next
test_gap_array_methods
test_gap_async_advanced
test_gap_class_field_named_stack_index
test_gap_class_ref_numeric_array_canon
test_gap_class_symbol_async_iterator
test_gap_closures
test_gap_fetch_response
test_gap_fn_prototype_own_keys_5024
test_gap_for_of_untyped_map_set
test_gap_generators
test_gap_http_overloads_3226plus
test_gap_json_stringify_replacer_tojson
test_gap_map_instance_reflection_4576
test_gap_mapset_iter_2831_2830_2856
test_gap_param_prop_array_index
test_gap_typed_array_proto_methods

Suggested next steps

  1. Diff 1cf73c105..1061eb4a5 on fix(runtime): arm64_32 ILP32 — box oversized thread_locals, guard GC pointer classifier #6118's branch — that delta was never conformance-tested.
  2. For attribution across the batch: byte-compare perry outputs across the four commits (CI node is constant, so perry-vs-perry comparison avoids node-version noise).
  3. Check the shelled-out feature-combo builds (cargo build --release -p perry-runtime-static -p perry-stdlib-static --features <combo>) for the compile-error tests — likely a straight rustc error under a non-default combo.

Until fixed, expect every newly-rebased PR to fail conformance-smoke-complete through no fault of its own.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions