Production GenAI & RAG
Taking LLM systems from prototype to production—RAG pipelines, function-calling routing, evaluation, Langfuse observability, and per-feature token cost tracking.
AI SOLUTIONS & ENGINEERING LEADER
I take LLM systems from prototype to production—and build the backend, data, and platform infrastructure they depend on. 14+ years across backend, data, and platform engineering, including 6 years leading engineering teams.

Core stack: Go, Java/Spring Boot, Python · GCP, Kafka, Redis, BigQuery · RAG, Langfuse, Gemini, Claude.
Taking LLM systems from prototype to production—RAG pipelines, function-calling routing, evaluation, Langfuse observability, and per-feature token cost tracking.
Embedding LLM workflows into how the business runs—executive reporting, Microsoft Teams agents, MCP servers, and cross-region process mapping.
Go and Java/Spring Boot microservices on GKE/GCP with Kafka, Redis, BigQuery, and ClickHouse—load-tested, observable, and shipped through CI/CD.
6 years leading teams of up to 10+ engineers across enterprises and startups—from design to deployment, delivery gates, and shared on-call.
A chronological overview of key roles and impact.
Integration Team Lead → AI Pod, AI Transformation Office
Engineering Manager
Tech Lead
Tech Lead
Let’s build systems that deliver impact.
taiwanliu@gmail.com linkedin.com/in/jhihweiliuNew Taipei City, Taiwan · Available remotely
Talk about your project