What Happens Inside an AI Chatbot Between Enter and the First Word?
In this article, we are going to look at this entire journey in detail.
MAPS: Netflix’s Multimodal Asset Personalization at Scale
By Emma Yanyang Kong, Aditya Deshpande, Asad Abbasi, Bowei Yan, David Fagnan, Ashish Rastogi, Dhaval Patel, Ray ZhangIntroductionThe Netflix experience is a journey of discovery. Every[…]
Background Work: From Cron Jobs to Distributed Systems
In this article, we will look at various such strategies to perform background work in detail.
Making Your Data Ready for Agentic AI
Lots of organizations are excited about what AI can do to streamline their processes, save money, and juice margins. But AI's capabilities are founded on[…]
Gallup scales real-time coaching for thousands with Amazon Bedrock
Gallup transformed 90 years of workplace science into Gallup AI, a generative AI assistant powered by Amazon Bedrock that delivers real-time, personalized coaching to leaders[…]
Closing the AI agent trust gap with graduated autonomy
Most teams give AI agents either full access or read-only, leaving value unused or risk unmanaged. This post describes graduated autonomy, an architectural pattern in[…]
How to Make LLMs 3X Faster
In this article, we will look at how speculative decoding works.
Fragments: August 24
I was listening to Ezra Klein’s interview with Helen Toner about the recent OpenAI hack of Hugging Face and the subsequent discovery that there were[…]
How a global payment processor preserved AWS RAM shares and Lake Formation permissions during an AWS Organizations migration
When AWS accounts move between organizations, organization-bound AWS RAM resource shares break and control-plane access is lost. Learn how a global payment processor used temporary[…]
A Tale of Two Flink Autoscalers
Samuel Yeboah, Francesco Di Chiara and Mingliang LiuToday, Netflix runs two Flink autoscalers. That is exactly one more than we want. We built the first[…]