Senior AI Backend Engineer

ob Title: Senior AI Backend Engineer
Key Skills: Python, FastAPI, REST APIs, Distributed Systems, LLM Orchestration, AWS, Docker, CI/CD, AI Evaluation Frameworks, STT Pipelines
Experience: +7 YOE
Location: LATAM (Exclusive)
Mode: Remote

We at Coforge are hiring a Senior AI Backend Engineer (21736) with the following skill set.

Key Responsibilities

Build and operate the production backend for a Voice-to-Action AI pipeline, including Speech-to-Text (STT) and LLM orchestration services

Design scalable and reliable backend systems within an existing distributed architecture

Develop instrumentation, evaluation, and regression frameworks for AI workflows and LLM-based systems

Define and monitor key quality metrics such as transcription accuracy, normalization drift, edit rate, and field-audio performance

Establish feedback loops and calibration practices to optimize non-deterministic AI systems in production

Evaluate and benchmark STT and LLM providers against internal performance metrics

Build and maintain scalable cloud-native services using AWS, Docker, and CI/CD pipelines

Collaborate with backend engineering teams to improve operational excellence and platform scalability

Support the adoption of AI-assisted and agentic engineering workflows across the organization

Contribute to broader backend platform initiatives after the Voice-to-Action pipeline reaches production readiness

Required Skills & Qualifications

7+ years of experience in backend engineering with strong expertise in Python

Hands-on experience with FastAPI or similar backend frameworks

Strong understanding of REST API development, service architecture, and distributed systems

Proven experience deploying and operating production systems on AWS, GCP, or Azure

Strong knowledge of Docker, CI/CD pipelines, cloud infrastructure, and operational best practices

Experience building and maintaining production-grade AI/LLM systems

Proven track record of implementing instrumentation, evaluation, regression testing, and monitoring for non-deterministic AI components

Strong analytical and problem-solving mindset with focus on measurement and reliability

Ability to quickly learn new domains and adapt to evolving technologies

Experience working in fast-paced engineering environments with changing requirements

Preferred Skills

Deep experience with LLM orchestration frameworks and AI evaluation infrastructure

Experience with hosted LLM APIs such as OpenAI, Anthropic, Bedrock, or Vertex AI

Familiarity with STT/ASR providers such as Whisper, Deepgram, or AssemblyAI

Knowledge of MLOps and AI observability/monitoring tools

Experience with agentic coding workflows such as Claude Code, Cursor, or similar platforms

Backend experience in TypeScript or Node.js environments

Experience with mobile voice pipelines or audio processing systems

Bilingual or multilingual NLP experience

Strong technical leadership and mentorship capabilities

Posted On: 05-06-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.