Engineering
214 posts in engineering
finance_data 是怎麼運作的:用 Cron + LLM 全自動生成股票研究報告
finance_data 是一個全自動的 AI 投資研究平台:每天靠 GitHub Actions cron 定時觸發,用 yfinance 抓市場數據、爬 Finviz/StockAnalysis/Roic.ai 補齊基本面,再餵給 Claude / OpenAI / Gemini 生成繁體中文研究報告,最後由 MkDocs 建置部署。本篇完整拆解這條 pipeline 的每一個環節。
ChatPDF RAG 優化（三）：可觀測性與評估 —— Langfuse 追蹤、評估歷史、即時評分
沒有量測就沒有優化。本篇拆解 chatPDF 如何補上 RAG 的可觀測性最後一塊:opt-in 零開銷的 Langfuse 追蹤、執行緒安全的 singleton、評估歷史持久化、即時答案評分(faithfulness/relevance)、relevance gate,以及無外部依賴的 SVG 趨勢圖表。
ChatPDF RAG 優化（二）：後端強化與進階 RAG —— 安全、資源邊界、多查詢擴展
RAG demo 能跑,不代表能上線。本篇拆解 chatPDF 如何補上 production 該有的防線:上傳的 PDF magic bytes 驗證與 OOM 防護、BM25 的 LRU 快取、多查詢擴展、檢索評分過濾、頁碼級引用、LLM gateway 重試退避——把 RAG pipeline 從「能跑」變成「能扛」。
ChatPDF RAG 優化（一）：語意切塊與混合檢索 Semantic Chunking + Hybrid Retrieval
RAG 的成敗，八成決定在「切塊」與「檢索」這兩步。本篇拆解 chatPDF 如何從寫死的固定切塊，升級成 embedding 偵測語意轉折的 Semantic Chunking，以及如何把 dense 向量檢索與 BM25 關鍵字檢索融合成 Hybrid Retrieval——附完整 Python 實作與設計取捨。
把站台從 3.1GB 砍到 503MB：finance_data 部署效能調校全紀錄
finance_data 是一個由 ~42 個每日分析任務自動產生報告的 MkDocs 站台，膨脹到搜尋索引 195MB、首頁 1MB、單次部署 752MB、CI 跑 15 分鐘。這篇拆解我們用六個改動把它降到搜尋索引 0.86MB、首頁 53KB、部署 387MB、CI 6.5 分鐘的完整過程與設計取捨。
Cloudflare AI 安全稽核系統（三）：LLM Agent 的安全反模式——十個讓報告失去公信力的做法
從 Cloudflare security-audit-skill 的設計原則出發，系統化整理 LLM agent 做安全稽核時最常見的十個反模式，以及如何在 agent pipeline 設計中從根源消除這些問題
Cloudflare AI 安全稽核系統（二）：Agent 設計深潛——Hunt 策略、Sub-Agent Spawning、Adversarial Validation
深入拆解 security-audit-skill 的 Agent 設計：Hunt phase 怎麼派 agent、sub-agent 什麼時候 spawn、adversarial validation 為什麼是 multi-agent 系統的核心防線
Cloudflare AI 安全稽核系統（一）：六階段 Multi-Agent Pipeline 全解析
Cloudflare 開源了內部 AI 安全稽核系統 security-audit-skill——一個教科書級的六階段 Multi-Agent Pipeline：Recon→Hunt→Validate→Report→Structured Output→Verify，本篇拆解整個架構設計與核心設計決策
SpotifyMCP2: Control Spotify with Claude via the Model Context Protocol
A deep dive into SpotifyMCP2, an open-source Model Context Protocol server that integrates Claude with the Spotify Web API. Learn how it works, how to set it up, and how to extend it. Covers MCP architecture, OAuth2 flow, TypeScript design, and all 8 exposed tools.
finance_data: A Python Toolkit for Downloading SEC Financial Filings from EDGAR
A complete guide to the finance_data open-source project: a Python-based toolkit for downloading SEC EDGAR financial reports including 10-K annual reports, 10-Q quarterly filings, and 13-F institutional holdings. Covers setup, usage examples, and the underlying architecture.
InvestSkill: Professional Investment Analysis Plugin for Claude Code
Complete guide to InvestSkill, a Claude Code plugin that provides six powerful analytical tools for stock evaluation, fundamental analysis, technical analysis, economics research, portfolio review, and sector analysis. Learn how to integrate AI-powered financial analysis into your development environment.
Everything Claude Code: The Ultimate Production-Ready Plugin Collection Guide
Deep dive into the everything-claude-code repository by an Anthropic hackathon winner. Discover how to set up, customize, and leverage production-ready agents, skills, hooks, commands, and MCP configurations for maximum productivity with Claude Code.
Building a Sentiment-Driven US Stock Trading System with X.com Real-Time Analysis
Learn how to architect a production-ready sentiment-driven stock trading platform that streams X.com posts in real-time, analyzes market sentiment using AWS Bedrock and HuggingFace, and automatically executes trades on US stocks based on social media signals.
Building an Intelligent Bitcoin Trading System with AWS CDK and ML Models
Learn how to architect and deploy an intelligent cryptocurrency trading system on AWS using CDK, with historical price analysis, ML-powered predictions from AWS Bedrock and HuggingFace, and event-driven trade execution.
Building Centralized Grafana + Prometheus Monitoring with AWS CDK: Multi-Service Observability Platform
Comprehensive guide to architecting a production-ready centralized Prometheus + Grafana monitoring platform using AWS CDK that aggregates metrics from multiple services, clusters, and infrastructure components with federation, remote storage, and advanced alerting.
Building AI Music Generation Platform: AWS CDK Architecture with SageMaker and Bedrock Comparison
Complete guide to architecting a production-ready AI music generation platform on AWS using CDK, comparing SageMaker and Bedrock approaches with detailed pros, cons, and implementation strategies for generating music from text prompts.
Deploying Apache Superset at Scale: Production-Ready BI Platform with AWS CDK and ECS Fargate
Comprehensive guide to architecting a highly available, production-grade Apache Superset deployment using ECS Fargate, RDS PostgreSQL, and AWS CDK for enterprise business intelligence at scale.
Building a Centralized Monitoring System with AWS CloudWatch and Grafana using CDK
Design and implement a production-ready centralized monitoring and observability platform using AWS CloudWatch, Grafana, and CDK (TypeScript). Learn cross-service log aggregation, metric collection, IAM permissions, dashboard creation, and alerting strategies for monitoring distributed systems.
Building a Centralized User Access Control System with AWS Cognito and CDK
Design and implement a production-ready centralized authentication and authorization system using AWS Cognito and CDK (TypeScript). Learn multi-tenant strategies, user pool management, RBAC/ABAC patterns, and how to integrate with multiple services and applications.
Deploying Hugging Face Models to AWS: A Complete Guide with CDK, SageMaker, and Lambda
Learn how to deploy production-ready Hugging Face AI models to AWS using CDK (TypeScript), SageMaker, and Lambda. Comprehensive guide covering system design, infrastructure setup, model deployment, API creation, and best practices for scalable ML applications.
Express.js Best Practices: Building Production-Ready Node.js Backend Applications
Master Express.js development with comprehensive best practices covering configuration, middleware, routing, security, error handling, and performance optimization. Learn to build scalable, maintainable, and secure Node.js backend applications.
TypeScript Best Practices: A Comprehensive Guide to Type-Safe Development
Master TypeScript development with comprehensive best practices covering configuration, type system, design patterns, code style, and advanced techniques. Learn to write type-safe, maintainable, and scalable TypeScript applications.
Docker Mount Complete Guide: Volumes, Bind Mounts, and tmpfs Comparison
Comprehensive guide to Docker mount types including volumes, bind mounts, and tmpfs. Learn the differences, use cases, pros/cons, and best practices for persisting data in Docker containers with practical examples.
AWS Load Balancers: Complete Guide - Application, Network, Gateway, and Classic Load Balancers Comparison with Implementation
Master AWS Load Balancers with comprehensive comparisons of ALB, NLB, GWLB, and CLB. Learn when to use each type, advanced features, health checks, auto-scaling integration, and production-ready configurations with real-world examples.
AWS API Gateway: Complete Guide with Load Balancer Comparison, Microservices Architecture, and Java Implementation
Master AWS API Gateway with comprehensive comparisons to load balancers, microservices integration patterns, and production-ready Java implementations. Learn when to use API Gateway vs Load Balancer, security best practices, and scaling strategies.