Meta introduces the 'Index as Model' paradigm, unifying all retrieval microservices into a single neural network, achieving 23.7x higher throughput and 20.9x better cost efficiency within strict latency budgets.
Meta engineers reveal how a seemingly simple 'Friend Bubbles' feature required complex ML models and cross-platform behavioral insights, uncovering design principles for large-scale social recommendation systems.
A SQLite database running on a living room gaming PC serves 70,000 users for $30/month, demonstrating the potential of algorithmic democratization and minimalist architecture in the decentralized era.
A bilingual LLM trained with semantic IDs as vocabulary tokens can recommend items and be steered through natural conversation.
Replace random hash IDs with semantic tokens so LLMs can natively understand items and enable conversational recommendations.