Skip to main content
Execute multiple AI approaches or strategies simultaneously and return the result from whichever completes first successfully. This pattern is ideal when you have multiple ways to solve the same problem and want to minimize latency by racing them against each other. Useful for:
  • Querying multiple AI models (e.g., GPT-4, Claude, Gemini) and returning the fastest response
  • Running different agents, prompts or strategies in parallel and using the first successful outcome

​
How does Restate help?

The benefits of using Restate for competitive racing patterns are:
  • Durable coordination: Restate turns Promises/Futures into durable, distributed constructs that persist across failures and process restarts. Race multiple approaches and return the first successful result.
  • Cancel slow tasks: Failed or slower approaches can be cancelled, preventing resource waste
  • Serverless scaling: Deploy racing strategies on serverless infrastructure for automatic scaling while the main process remains suspended
  • Works with any LLM SDK (Vercel AI, LangChain, LiteLLM, etc.) and any programming language supported by Restate (TypeScript, Python, Go, etc.).

​
Example

Select your preferred SDK: When you need a quick response and have access to multiple AI models, race them against each other to get the fastest result:
This pattern is implementable with any of our SDKs and any AI SDK. If you need help with a specific SDK, please reach out to us via Discord or Slack.