AI Engineer - Certa

Certa (certa.ai) is an AI-native third-party risk management platform that unifies the full third-party lifecycle, from onboarding through continuous monitoring and offboarding. Enterprises from the Fortune 500 to fast-growing startups use our no-code platform to manage vendors, suppliers, and partners across risk, compliance, and ESG.

We're looking for an experienced, innovative AI Engineer to push the boundaries of LLM technology and build intelligent features for our enterprise platform.

What You'll Do

• Design & ship AI features: Lead the design, development, and deployment of generative AI and LLM-powered services — intelligent chatbots, AI-driven recommendations, workflow automation - that deliver engaging, human-centric experiences.
• Build RAG pipelines: Design, implement, and continuously optimize end-to-end RAG pipelines (data ingestion and parsing, chunking, vector indexing, prompt engineering) so our systems retrieve and use knowledge accurately.
• Build LLM agents: Develop and refine LLM-based agentic systems for complex, multi-step tasks - incorporating planning, memory, and tool use, and applying emerging best practices to make agents more reliable.
• Evaluate & iterate: Rigorously evaluate models and pipelines on accuracy, latency, and hallucination rate, using thorough testing and user feedback to improve prompts, parameters, and data processing.
• Engineer for production: Write clean, maintainable, testable code with strong monitoring and logging, ensuring AI components are scalable and fit the overall system architecture.
• Collaborate & innovate: Partner with product, design, and engineering to integrate AI seamlessly into products, mentor teammates on generative AI best practices, and continuously explore new AI advancements to bring into the platform.

What You'll Need

• Software engineering: 3+ years (mid-level) / 5+ years (senior) of backend engineering, with expert Python, scalable API/service design, strong system design, and experience deploying on AWS or similar cloud platforms.
• LLM application experience: Proven experience building real products on LLMs/generative AI (chatbots, semantic search, AI assistants), with hands-on RAG and agent work and a solid grasp of model behavior and failure modes.
• Applied AI depth: Strong in prompt design, function calling/structured outputs, tool use, context-window management, and the RAG levers that matter (parsing/chunking, metadata, re-ranking, embedding/model selection); pragmatic model/provider trade-offs; product-aligned evaluation; and fundamentals of embeddings, tokenization, vector search, and transformers.
• Tooling: Hands-on with LLM orchestration libraries (LangChain, LlamaIndex) and vector databases (Pinecone, Chroma, Milvus).
• Cloud & DevOps: Able to productionize LLM/RAG services as high-availability, low-latency backends on AWS with IaC, strong observability, security, and cost/latency strategies.
• Communication & autonomy: Excellent communication to explain complex AI concepts to non-technical stakeholders, plus a self-directed approach to troubleshooting and rapid prototyping.

Compensation and Benefits

• Compensation: Top of market salary
• Time off: 49 days paid time off
• Benefits: Full benefits, retirement and wellness plans
• Growth: Professional development support, remote workspace setup bonus
• Team building: Annual company offsites in exciting locations around the world