feat: Move reg IT to parallel + blacksmith and have MIT only run on merge q…

Merged
WE
1y ago
+431-182

…ueue

Description

[Provide a brief description of the changes in this PR]

How Has This Been Tested?

[Describe the tests you ran to verify your changes]

Backporting (check the box to trigger backport action)

Note: You have to check that the action passes, otherwise resolve the conflicts manually and tag the patches.

  • This PR should be backported (make sure to check that the backport attempt succeeds)
  • [Optional] Override Linear Check

Summary by cubic

Parallelize regular integration tests across directories using Blacksmith ARM runners and a private registry to cut wall time and flakiness. Move the MIT workflow to run only on the merge queue.

  • Refactors
    • Discover test dirs and run as a matrix (tests and connector_job_tests).
    • Build backend, model server, and test images on arm64; push to a private registry; retag locally for compose.
    • Generate OpenAPI once and reuse in the integration image build.
    • Start only required compose services; add robust health checks; upload logs per matrix shard.
    • Add authenticated Docker Hub pulls and 3x retry for flaky shards.
    • Change pr-mit-integration-tests to trigger on merge_group (checks_requested) only.