#Performance

10 posts tagged "performance"

1

Part 1 — Kubernetes Autoscaling Complete Guide (Part 1): Horizontal Pod Autoscaler

Part 1 of the Kubernetes Autoscaling series: Deep dive into Horizontal Pod Autoscaler (HPA) approaches, comparing resource-based, custom metrics, external metrics, and event-driven autoscaling with KEDA. Learn when to use each approach with real-world examples and production best practices.

·28 min
4

Part 4 — AI Forward Deployed Engineer 必備技能指南（四）：生產環境 AI 系統監控與最佳化

深入探討生產環境 AI 系統的全方位監控策略、效能最佳化技術、故障診斷流程與成本管理實務

·20 min
5

Part 5 — Kubernetes Autoscaling Complete Guide (Part 5): Vertical Pod Autoscaler & Resource Optimization

Part 5 of the Kubernetes Autoscaling series: Deep dive into Vertical Pod Autoscaler (VPA), resource right-sizing strategies, combining VPA with HPA, and production-grade resource optimization techniques for cost-effective Kubernetes operations.

·35 min
7

Part 7 — Kubernetes Autoscaling Complete Guide (Part 7): Production Troubleshooting & War Stories

Part 7 of the Kubernetes Autoscaling series: Real-world production incidents, debugging workflows, common failure scenarios, and hard-learned lessons from operating autoscaling at scale. Battle-tested troubleshooting guides and postmortem analysis.

·45 min
14

Part 14 — FDE core topic - Speculative Tool Execution：大扇出控制與投機雙發防禦

深入剖析 Agent 並行 15 個工具呼叫時如何以投機雙發（Hedged Request）壓制 P99 尾部延遲、用硬截止時間搭配優雅降級回傳部分結果，將整體等待從 30 秒壓到 1.5 秒（20 倍改善）。

·18 min
16

Part 16 — FDE core topic - TTFT & Throughput Optimization：首字延遲與推理吞吐量的硬體級優化

深入解析 LLM 推理服務的兩大核心指標——首字時間（TTFT）與每秒 Token 吞吐量——以及 Quantization、Continuous Batching、PagedAttention、Speculative Decoding、Flash Attention 五大硬體級優化技術的原理與取捨。

·18 min

把站台從 3.1GB 砍到 503MB：finance_data 部署效能調校全紀錄

finance_data 是一個由 ~42 個每日分析任務自動產生報告的 MkDocs 站台，膨脹到搜尋索引 195MB、首頁 1MB、單次部署 752MB、CI 跑 15 分鐘。這篇拆解我們用六個改動把它降到搜尋索引 0.86MB、首頁 53KB、部署 387MB、CI 6.5 分鐘的完整過程與設計取捨。

·16 min

AWS DynamoDB Complete Guide: Architecture, Indexing & Performance Optimization

Comprehensive guide to AWS DynamoDB covering data structures, architecture, indexing strategies, secondary indexes, sort keys, and performance optimization techniques for high-speed I/O operations.

Database Performance Optimization: From Slow Queries to Sub-millisecond Response Times

A comprehensive guide to database performance optimization techniques that helped us reduce query response times from seconds to milliseconds.

·15 min

Java Concurrency and Threading: Complete Guide to Runnable, Callable, and Modern Thread Patterns

Comprehensive guide to Java concurrency and threading mechanisms. Learn Runnable vs Callable, ExecutorService, CompletableFuture, and advanced threading patterns with practical examples and performance analysis.

·35 min