Capping VLM spend per CV researcher: hierarchical budgets in practice
Prophesee's CV team faced high VLM spending without clear accountability for costs. They implemented a hierarchical budget system using Bifrost to cap individual researcher spending and improve visibility. This change led to better management of resources and reduced unexpected expenses.
- ▪The CV team was spending €3-4k weekly on VLM without tracking individual contributions.
- ▪Bifrost was deployed to manage spending by mapping virtual keys to researchers with monthly caps.
- ▪The new system provided visibility into spending patterns and allowed for automatic failover during provider outages.
Opening excerpt (first ~120 words) tap to expand
try { if(localStorage) { let currentUser = localStorage.getItem('current_user'); if (currentUser) { currentUser = JSON.parse(currentUser); if (currentUser.id === 3851217) { document.getElementById('article-show-container').classList.add('current-user-is-article-author'); } } } } catch (e) { console.error(e); } Marco Rinaldi Posted on May 26 Capping VLM spend per CV researcher: hierarchical budgets in practice #machinelearning #computervision #mlops #llm TL;DR: Our 11-person CV team at Prophesee was burning through €3-4k weeks of VLM spend on dataset annotation with no idea which researcher caused which spike. We put Bifrost between the labelling scripts and the providers, mapped one virtual key per person with monthly caps, and the receipt-chasing stopped. Took an afternoon to wire up.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at DEV.to (Top).
Discussion
0 commentsMore from DEV.to (Top)
