Inference Router (Public Preview)
The Inference Router is a public preview service from DigitalOcean designed to route inference requests to various foundation models. It allows users to create and configure routing logic for their AI workloads. This tool serves as a central point for managing how requests are directed to different underlying AI models, simplifying the integration process for developers building applications that rely on generative AI capabilities.
Choose this service when you need a straightforward way to direct inference traffic to foundation models without managing complex infrastructure. Be aware that the service is currently in public preview and offers no free tier. You will pay on a pay-as-you-go basis, meaning costs will accrue immediately upon usage without any initial free allowance to test the service before billing begins.