LLM Optimization & Evaluation
Info Way Solutions LLC • Austin, Texas, United States • Posted May 16, 2026
About the Role
LLM Optimization & Evaluation
Austin, TX
Job Summary
We are seeking a highly skilled LLM Optimization & Evaluation Specialist to design, optimize, and evaluate large language model (LLM) systems in production. This role focuses on prompt optimization, RAG tuning, inference efficiency, and modern evaluation frameworks to ensure high-quality, scalable, and cost-effective GenAI solutions.
The ideal candidate has hands-on experience with LLM-as-a-Judge evaluators, RAG pipelines, observability, and enterprise-grade GenAI systems.
Austin, TX
Job Summary
We are seeking a highly skilled LLM Optimization & Evaluation Specialist to design, optimize, and evaluate large language model (LLM) systems in production. This role focuses on prompt optimization, RAG tuning, inference efficiency, and modern evaluation frameworks to ensure high-quality, scalable, and cost-effective GenAI solutions.
The ideal candidate has hands-on experience with LLM-as-a-Judge evaluators, RAG pipelines, observability, and enterprise-grade GenAI systems.