Skip to content

Keep handling support requests when the AI service fails

Separate request intake from the AI step. Plan bounded retries, uncertain save outcomes and a route for the team to continue the work.

Lukas Schneider2 min read
Blue handbook with an alarm icon, person and speech-bubble symbols, and a stopwatch.

A support request should remain actionable for the team when automatic summarisation fails. The application needs a defined workflow without that function. Repeated model calls alone do not keep the work process running.

Separate intake from the AI step

In this fictional portal, a technical request is first saved in the case store. Its intake identifier is F-81. An acknowledgement appears only after storage is confirmed. An AI service is then supposed to create an internal summary. The original message remains readable by the responsible team.

If summarisation fails, the saved case can continue through the designated work queue. The interface shows the pending summary; it must not report a completed case. This design requires storage, permissions and the manual handling route to work independently of the failed AI step.

Connect failure types to next steps

Microsoft’s Retry pattern distinguishes transient failures from cases where retrying is not useful. Define suitable time and attempt limits for the specific service. The table describes expected responses in this example:

Problem

Planned response

Visible state

AI query times out

Retry a limited number of times with delays; then leave it to the team

Summary pending

Access to the AI service is denied

Stop automatic attempts and have the integration checked

The team can still handle the case

Confirmation of the original save is missing

First establish the existing save outcome

Intake not yet confirmed

When access is denied, the responsible technical contact checks configuration and permissions. The application does not expand its own rights in response.

Resolve an uncertain write outcome first

A lost response can mean that storage has already succeeded. Microsoft highlights repeated effects when non-idempotent operations are executed again. Here, idempotent means that repeating the same task produces no additional business effect.

The storage route must handle repeats of the same intake identifier within the appropriate permission scope and be able to return an existing outcome. An identifier alone does not ensure this. An unknown state must not trigger a second case with a new identifier.

Define resumption and ownership

The NIST profile for generative AI discusses recovery plans, contact routes and alternative processes. Decide who takes over open cases and when automatic work may resume. The application must check a late AI text before allowing it to overwrite manual work that has since been reviewed.

Test an outage, denied access, an unknown save outcome and the service returning after manual handling. For each, check the original message, visible case state and next usable step. A reachable interface alone does not show that all open cases have resumed correctly.

Sources

Written by

  • Lukas SchneiderTechnical EditorLukas Schneider writes about cloud technologies and running applications at ASES. His articles range from choosing infrastructure to maintenance and backups to monitoring live systems.

Follow ASES

Read more

All articles

AI & Automation with ASES

AI assistants and automated workflows