Engineering insights, architecture deep dives, and technical solutions
1 posts tagged "rate limiting"
以系統設計視角拆解多租戶 AI Agent 系統的資源隔離問題:為什麼傳統 RPM 限流不夠、Token-Aware Rate Limiting 的設計原理、分散式令牌桶架構,以及如何防止 Noisy Neighbor Effect 影響其他租戶