Databricks as the Backbone of MLOps: From Orchestration to Inference
Description
As machine learning (ML) models scale in complexity and impact, organizations must establish a robust MLOps foundation to ensure seamless model deployment, monitoring and retraining. In this session, we’ll share how we leverage Databricks as the backbone of our MLOps ecosystem — handling everything from workflow orchestration to large-scale inference. We’ll walk through our journey of transitioning from fragmented workflows to an integrated, scalable system powered by Databricks Workflows. You’ll learn how we built an automated pipeline that streamlines model development, inference and monitoring while ensuring reliability in production. We’ll also discuss key challenges we faced, lessons learned and best practices for organizations looking to operationalize ML with Databricks. Talk By: Cyd Kristoff Redelosa, Senior Expert - MLOps, Globe Telecom ; Reinier Veral, Asst. Director MLOps, Globe Telecom Here’s more to explore: Production ready data pipelines for analytics and AI: https://www.databricks.com/solutions/data-engineering The Big Book of Data Engineering: https://www.databricks.com/resources/ebook/big-book-data-engineering-2nd-edition See all the product announcements…
Description from YouTube. Full content on the video page.
More from Databricks
NewsCreating a Digital Twin with Spark Real-Time Mode and Lakebase
This video demonstrates how to create a real-time digital twin for a manufacturing cell using Databricks tools such as Spark Real-Time Mode, Lakebase, Databricks Apps, and Unity Catalog. It explains how processing sensor readings instantly allows operators to detect and act on equipment faults, such as a hot spindle, before they negatively impact production quality and efficiency.
NewsRespond to Airport Disruptions Using Lakehouse//RT
Lakehouse//RT and Zerobus enable low latency query processing to help airline operations quickly manage flight disruptions and rebook passengers. This technology allows multiple teams to access real-time data simultaneously without creating a duplicate system, significantly improving decision-making speed during emergencies.
TutorialsLakebase Search: Build AI Retrieval for Agents with Lakebase Postgres
Lakebase Postgres introduces lakebase vector and lakebase text extensions to support hybrid search for AI agents. It leverages the Databricks Lakehouse architecture to synchronize and index data for efficient vector and full text search without requiring external databases.
TutorialsGoverning AI Agents with Unity Catalog and Unity Gateway on Databricks | Unity Catalog Demo
The video demonstrates how to govern AI agents using Unity Catalog and Unity Gateway on Databricks. It shows setting up access policies, user defined functions, and role filters to control data and model interactions.
TutorialsDatabricks Pipelines: Write to One Unity Catalog Table from Multiple Sources with FLOWs
Databricks pipelines now allow writing to a managed Unity Catalog table from multiple sources by using one flow per source. Users can migrate existing structured streaming jobs without reprocessing the source data by utilizing checkpoint import features.
