← Back to Main Site
YennJ12 Engineering Blog

Engineering insights, architecture deep dives, and technical solutions

Home Engineering Architecture Data All Posts FDE Series FDE Core Topics About Search
↑↓ navigate · ↵ open · esc close View all results →

#AsyncDesign

1 posts tagged "asyncdesign"

11

Part 11 — FDE core topic - Async Event-Driven Pipeline:解耦同步 HTTP 與保護後端連線池

深入剖析如何以非同步訊息傳遞取代同步 HTTP 請求,防止 LLM 推論延遲(2–30 秒)耗盡 Web Server 連線池,支撐 50,000+ 並發用戶,改善幅度達 250 倍。

Jun 8, 2026 ·18 min

About

  • About me
  • Blog home
  • All posts
  • Authors
  • GitHub
  • Contact

Categories

  • Engineering
  • AI & ML
  • DevOps
  • Cloud & AWS
  • Data Engineering
  • Tools & Productivity

Resources

  • All tags
  • Archives
  • Series
  • Documentation

Community

  • GitHub profile
  • Blog repository
  • Report an issue
  • RSS feed
English
Taipei

© 2026 YennJ12 Engineering Team. All rights reserved.

Built with Hugo