Summary
This release adds Databricks Runtime 16+ support, fixes cluster policies on UC-enabled workspaces, introduces HMS Federation Glue credential migration, and refactors pipeline migration from skip-pipeline-ids to include-pipeline-ids. The migration progress workflow now runs automatically daily at 5 AM UTC while improving dashboard migration tracking and Python error reporting.
Summary from the captured archive. Follow the original source for full context.
More from databrickslabs/ucx
Assessment export now handles large files through zip compression to prevent export failures. Workflow assessment has been split into a standalone run-assess-workflows task, giving users independent control over its execution instead of it being bundled with the main Assessment workflow.
Added Excel export format for assessment results and optional skip for workflow assessment tasks via configuration. Fixed multiple migration issues including federated catalog creation to include all external locations, external location name sanitization, GLUE credential lookup for external HMS, and improved error handling throughout the create-missing-principals and migrate-locations workflows.
The assessment workflow now includes a force-refresh parameter to rerun assessments and obtain updated results, and a new experimental workflow converts Azure WASBS URLs to the more performant ABFSS format. Dashboard management is now more resilient, automatically recreating dashboards when permission issues occur or they're trashed, and service principals are now supported as members of account groups.
UCX now includes an experimental workflow assessment feature that analyzes workflows from the last 30 days to identify migration issues, with findings available in the assessment dashboard. The release requires Databricks SDK 0.56 or later and includes updated documentation for installation and getting started guidance.
Assessment workflows require account groups to be created beforehand, and Service Principal is no longer supported for workspace installations—account-level installations now require Service Principal with Account Admin and Workspace Admin privileges. Table migration with default catalogs is fixed, workflow assessment filters to the last 30 days, migration progress workflows pause by default, and account group conflicts produce warnings instead of errors.
UCX v0.58.0 adds offline installation support for restricted-access environments and enables creation of account-level groups from nested workspace groups for improved governance. The release also enhances dashboard navigation with hyperlinks to table and cluster resources, and includes fixes for assessment exporters and improved error handling in the Workflow linter.