Getting GenAI to Production with Mosaic AI Gateway in Databricks
Summary
The video demonstrates how to productionize GenAI applications using Databricks' Mosaic AI Gateway, highlighting features like usage tracking, inference tables, AI guardrails, rate limits, and model fallbacks. It shows how to configure these features through the Databricks UI and monitor application performance and costs using built-in dashboards.
Summary from the captured archive. Follow the original source for full context.
More from Advancing Analytics
TutorialsPractical Use Cases for Jev | System One Models - Part Three
Jev utilizes structured, non-generative AI systems for energy billing and customer service workflows with built-in safety controls. It also automatically tags and extracts sections from complex documents like insurance quotes and claims, significantly reducing token usage and manual review effort.
EventsS2 Ep2: All About Data Conferences | Ash Warren
Data conferences offer professionals a platform to learn technical skills, share knowledge, and build community connections. Attending these events helps data practitioners stay updated on industry trends and improve their problem-solving abilities.
NewsS2 Ep1: All About Data Products | Ust Oldfield
Successful organizations focus on building data products that solve real problems and deliver value, rather than just investing in data platforms and technology. To ensure these data products are successful, organizations must change their mindset and treat their data users as customers, focusing on their needs and problems.
TutorialsDemo: Intelligent Document Processing in Databricks | Feat. Databricks' Sepi
The video demonstrates how to use Databricks for intelligent document processing by parsing, classifying, and extracting information from documents using AI functions. It shows an end-to-end workflow where documents are uploaded to a volume, parsed, classified by type, and used for data extraction and automated workflows.
TutorialsJev Pokemon Battle!? And How to Get Started with Jev | System One Models - Part Two
The video demonstrates how to use the Jev API with simple examples such as yes-or-no classification and multiple-choice routing. It then showcases a more complex application by implementing a Jev-powered bot to play and win Pokémon battles.
NewsIntelligent Document Processing in Databricks: Everything You Need to Know - feat. Databricks' Sepi
The video teaches how Databricks Intelligent Document Processing extracts information from unstructured data sources like PDFs and images using built-in AI functions. It demonstrates the use of AI parse, AI classify, and AI extract to systematically bring enterprise data into the lakehouse.