MP
Home
About

Minglong Pan

AI Platform Engineer

Seattle, WA

minglongpan51@gmail.com

Summary

Software engineer building production AI infrastructure for large-scale, customer-facing systems. I own multi-tenant LLM serving, model guardrails, and rollout infrastructure for real-time GenAI translation at Amazon, serving many languages across multiple regions. ~8 years building distributed backend systems across AWS, production operations, and large-scale data processing.

8 yrs

distributed backend & AI infrastructure on AWS

Multi-tenant

designed & own the LLM-serving platform for GenAI translation

Multi-region

real-time LLM translation serving in production

MCP

reusable AI-agent infrastructure adopted across teams
Experience
Software Engineer, Amazon

Jun 2021 — Present

Customer Service · GenAI Translation · Chat Infrastructure

  • Designed and own multi-tenant LLM serving for real-time GenAI translation on AWS Bedrock — automated tenant onboarding, request routing, and per-tenant cost tracking across regions, with faster tenant onboarding and improved serving efficiency at production scale.
  • Built the multi-tenant serving and staged-rollout infrastructure used to migrate production traffic from legacy machine translation to GenAI translation on Bedrock — eval-gated dial-up rollouts across many languages and regions.
  • Built an MCP resource-layering framework (Python FastMCP) on Anthropic's Model Context Protocol — generic base server + team-specific overlays with path-ordered override semantics; adopted by peer teams without forking shared infrastructure.
  • Built MCP-based internal AI agents for developer-productivity and incident-response workflows.
  • Led an enterprise onboarding across European and Japanese marketplaces — large-scale terminology and multilingual configuration, delivered as a staged production change.

  • Built guardrails on AWS Bedrock for the GenAI translation stack, screening model output before it reaches customers; extended the translation evaluation framework with standard MT-quality metrics (chrF++, COMET) and LLM-as-judge meaning-preservation checks.
  • Built a direction-aware SageMaker scaling tool with dry-run and rollback that significantly right-sized GenAI inference capacity during the MT→GenAI cutover, materially cutting compute cost.
  • Built staged prompt-rollout controls with a safe kill-switch and per-tenant gating; hardened batch inference with retry/backoff and concurrency limits for reliability under throttling.

  • Migrated a regional voice channel to Amazon Connect — resolved cross-region TLS and IAM integration challenges and coordinated multiple partner teams to bring customer-service agents online at scale.
  • Migrated a core chat service to a container-based architecture on ECS/Fargate; built load- and stress-testing infrastructure for active chat monitoring, throttling, and persistence across regions.
  • Led the cross-organization transfer of a suite of chat services between engineering teams — authored knowledge-transfer documentation and ramped the receiving team with no major operational incidents.

  • Authored internal engineering write-ups on AI developer tooling and MCP-based workflows to socialize reusable AI-infrastructure patterns across teams.
Software Engineer, Viridien (formerly CGG Geophysics)

Jun 2018 — Jun 2021

U.S. Seismic Imaging Department · 3D subsurface imaging workflows for major Oil & Gas clients

  • Built signal-processing and seismic-imaging pipelines in Perl / Java / Python — Fourier transform, Tau-P transform, filter design — on petabyte-scale seismic data spanning 120+ km³ subsurface volume; improved image SNR by 5+ dB.
  • Developed tree-based classification algorithm in Java and released to production; improved workflow throughput, contributing to major proprietary client engagements.
Skills
AI / LLM Systems
multi-tenant LLM serving
Bedrock Guardrails
production evals
chrF++ / COMET / LLM-as-judge
prompt rollout
MCP / FastMCP
AWS Bedrock
SageMaker
Distributed Systems & Cloud
ECS/Fargate
Lambda
DynamoDB
Aurora/RDS
Step Functions
CloudWatch
CDK
event-driven architectures
multi-region
observability
incident response
Languages
Python
Java
TypeScript
JavaScript
SQL
Perl
Shell
Education

Rice University — M.S. in Geophysics, Houston, TX

Jul 2016 — May 2018

Yangtze University — B.Eng., Hubei, China

Aug 2012 — Jun 2016

Research & Publications
  • Co-author, Geophysical Research Letters (Carlson et al., 2021) — "Impacts of engineered diversions and natural avulsions on delta-lobe stability." doi:10.1029/2021GL092438
  • Presentations at American Geophysical Union (AGU) Fall Meeting (2019, 2021) on channel diversion characteristics and delta-lobe stability.