Core Concepts

The essential features you need to build AI-powered applications with ModelRelay.

Guides

  • Streaming — Real-time response streaming for better UX
  • Tool Use — Let models call functions in your application
  • Structured Output — Get typed JSON responses from AI models
  • Error Handling — Handle errors gracefully with retries and fallbacks