AI Platform Engineer – LLM Agents & RAG- job post

posted 8 months ago

Apply for this job

Shortlist

Job Description

3.03.0 out of 5 stars

United States•Remote

Full-time

Job details

Job type

  • Full-time

Full job description

About the Role

The AI Engineer – Platform will build and optimize company AI platform and intelligent agents that automate workflows across the organization. This role sits at the intersection of production software engineering and applied generative AI—delivering agentic applications, RAG capabilities, evaluation frameworks, and guardrails that ensure safe, reliable, and compliant AI outcomes.

What you will do

  • Build AI-powered agents that automate multi-step workflows and integrate with internal tools and data sources
  • Implement Retrieval-Augmented Generation (RAG) solutions to ground responses in trusted knowledge
  • Develop and maintain AI platform components and reusable services (APIs, pipelines, orchestration)
  • Design evaluation frameworks to measure quality (accuracy, relevance, safety) and improve performance over time
  • Monitor production AI systems; optimize latency, cost, reliability, and user outcomes
  • Engineer datasets and support fine-tuning and model selection decisions (RAG vs fine-tuning vs prompting)
  • Implement guardrails and security controls (prompt injection resistance, sensitive data handling, safe output behaviors)
  • Partner with Security/Legal/Compliance to align AI implementations to governance and regulatory expectations
  • Document designs, standards, and operational runbooks; participate in code reviews and knowledge sharing

Preferred Qualifications

  • 5+ years of software engineering experience with strong proficiency in Python and production systems
  • 2+ years building and deploying AI/ML or LLM-based applications in production
  • Hands-on experience with prompt engineering and context management for LLM apps
  • Proven experience implementing RAG systems and using vector databases/knowledge stores
  • Experience building evaluation metrics/frameworks for AI quality and reliability
  • Strong engineering fundamentals (APIs, distributed systems, Git, CI/CD, testing)
  • Solid understanding of AI safety and security principles (guardrails, hallucination mitigation, prompt injection prevention)

Desired Qualifications

  • Experience with autonomous/agentic workflows (tool use, planning, state management)
  • Experience optimizing model inference (performance/cost trade-offs; deployment optimization)
  • Observability experience for AI systems (monitoring, logging, alerting, dashboards)
  • Experience operating in regulated environments (GDPR, HIPAA, SOC2 or similar)
  • Healthcare, life sciences, or clinical trial technology experience
  • Experience with AI safety testing/red-teaming approaches
  • Familiarity with common AI platforms/frameworks and model providers (agent frameworks and managed LLM services)
  • Willingness to collaborate across teams and communicate clearly with technical and non-technical stakeholders

Why
At company, your work has real impact. Everything we build, support, and deliver helps advance clinical research and bring new treatments to patients faster — improving lives around the world. Our teams combine science, technology, and operational expertise to solve complex clinical trial challenges, and every role contributes to that mission. We offer a collaborative, global environment where you can grow your career while working alongside experts across clinical, technology, data, and operations, with opportunities to learn, take ownership, and drive meaningful innovation — not just maintain the status quo. If you are looking for purpose-driven work, smart colleagues, and the opportunity to help shape the future of clinical research and digital health, company is the place to do it. #LI-AS1 #LI-Remote

At company, accepting difference isn’t enough—we celebrate it, we support it, and we nurture it for the benefit of our team members, our clients and our community. Signant Health is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, colour, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran statu