AI Model Serving

STACKIT AI Model Serving provides a fully managed hosting environment tailored for AI models, focusing especially on large language models (LLMs) like Llama and Mistral.

Get Started

Content

Basics

Understand the basic architecture of STACKIT's AI Model Serving, learn about the service and its features.

Getting started

Create your first inference AI Model Serving. Follow the guide to get from start to a fully usable model.

How-tos

Learn how to use AI Moel Serving for your data and AI projects.

Tutorials

Go from theory to a working application which utilises STACKIT's AI Model Serving. Combine multiple concepts and build complex projects using LangChain and other popular tools.

Reference

Get a structured view on available chat and embedding models and on the API reference.

FAQ

Quickly find answers to frequently asked questions about STACKIT AI Model Serving.

Release notes

Discover what's new in AI Model Serving, including added features, bug fixes and deprecation notices.