Databricks Jobs Monitoring in Your Custom Databricks App
A new Databricks app has been developed to enhance job monitoring for users. The app aims to provide a more user-friendly dashboard that consolidates job statuses in one location. It allows for timezone adjustments and can be installed locally or within Databricks, with varying costs depending on usage.
- ▪The app retrieves job information via the API SDK and displays it in a single dashboard.
- ▪Users can filter jobs by command and set a default display timezone to avoid confusion.
- ▪The application can be installed within Databricks or run locally, with costs ranging from $10 to $300 per month.
Opening excerpt (first ~120 words) tap to expand
Databricks Jobs Monitoring in your custom Databricks AppMaksim Pachkouski4 min read·22 hours ago--ListenShareYou're an active Databricks user and have already scheduled several dozen jobs. By default, there are two ways to monitor job failures: set up alerts via email or Teams, or check the Monitoring dashboard in Databricks. But sometimes you forget to set up alerts, and with a large number of jobs, the dashboard becomes inconvenient.To solve this problem, I created a small Databricks app on Streamlit, which works through the API SDK.Press enter or click to view image in full sizeWhy doesn't the current Databricks dashboard meet our needs? It only displays the last five launches and a large number of pages to navigate:Press enter or click to view image in full sizeI like Databricks, it's…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Medium.
Discussion
0 commentsMore from Medium
