Generative AI

omega-ml provides built-in capabilities for Generative AI workflows. This includes retrieval augmented generation (RAG), document embeddings, text generation and agentic workflows.

Added in version 0.17.0.

Contents:

• Concepts in omega-ml Generative AI
  • Generative AI model
  • Model Provider
  • Pipelines and Guardrails
  • Documents storage
  • Conversation history
  • Tools
  • Generative AI runtime and REST services
  • Multi-model Repository
  • Monitoring
• Tutorial for Generative AI
  • Deploy a generative AI model
  • Document storage
  • Building a RAG pipeline
  • Adding tools
  • Adding custom pipeline actions
  • Serving a model
  • Tracking model interactions
  • Using a third-party LLM framework