X's Feed Ranking Algorithm: How Grok Ranks 500M Posts in 200ms
X's Feed Ranking Algorithm, developed by xAI, efficiently ranks 500 million posts in under 200 milliseconds. The system utilizes a Grok-based transformer to predict engagement types and eliminate manual features. It consists of four main components that work together to deliver personalized content to users swiftly.
- ▪xAI has open-sourced the production code for X's For You feed, which has garnered 22.5k stars on GitHub.
- ▪The algorithm processes 500 million daily posts, narrowing them down to approximately 1,500 candidates for ranking.
- ▪The Grok-based transformer predicts 14 engagement types and combines them into a weighted score for ranking.
Opening excerpt (first ~120 words) tap to expand
try { if(localStorage) { let currentUser = localStorage.getItem('current_user'); if (currentUser) { currentUser = JSON.parse(currentUser); if (currentUser.id === 1140118) { document.getElementById('article-show-container').classList.add('current-user-is-article-author'); } } } } catch (e) { console.error(e); } Ramsis Hammadi Posted on May 21 X's Feed Ranking Algorithm: How Grok Ranks 500M Posts in 200ms #webdev #architecture #llm #ai X's Feed Ranking Algorithm: How Grok Ranks 500M Posts in 200ms TL;DR Summary xAI open-sourced the full production code behind X's For You feed on GitHub — 22.5k stars, Apache 2.0, commercial use allowed The system pulls from 500 million daily posts, narrows to candidates, and ranks them in under 200 milliseconds using a Grok-based transformer Zero…
Excerpt limited to ~120 words for fair-use compliance. The full article is at DEV.to (Top).
Discussion
0 commentsMore from DEV.to (Top)
