fix(indexing): keep one failing document from failing its batch (#15563) to release v4.9

Merged
DA
3d ago
+402-105

Cherry-pick of commit 4194b87e4c8468b362628d9ede4cc17346793b1a to release/v4.9 branch.

Original PR: #15563

  • [Optional] Override Linear Check

Summary by cubic

Cherry-picks the indexing reliability fix so one failing document no longer fails its entire batch.

When a batch indexing attempt raises, the handler retries each document individually and reports only the documents that failed. Documents the batch had already prepared skip the change gates on retry via a new force_update flag. A failed push to the external sink is not retried, because the documents were already written and a retry would silently skip them as unchanged. Contextual RAG summary and chunk-context LLM failures now fail the document instead of silently indexing it without context.