Senior Software Engineer, Applied AI - Syllo

About Syllo

Syllo is on a mission to transform litigation. Our product is a unified litigation platform that enables lawyers and paralegals to safely harness the power of language models and agentic AI throughout the litigation life cycle. Since going to market, we have gained a diverse group of enterprise customers, including some of the biggest law firms and corporations in the country, and we are quickly expanding. By reducing the expense of litigation industry-wide, we aim to improve access to high-quality representation and promote the alignment of legal outcomes with merit.

About the Role

We are seeking a skilled and fast-moving Applied AI Engineer to join our team. This role is focused on the practical application of AI, specifically leveraging Large Language Models (LLMs), to build robust, scalable, and impactful user-facing features. This is an engineering-centric role. You will be an expert at building and integrating production systems, not primarily a research scientist.

Responsibilities

• Design and build high-performance, production-level AI-powered features and services, with a focus on reliability and scalability.
• Develop robust engineering solutions to mitigate the inherent unreliability of LLMs, including implementing effective guardrails, validation pipelines, error handling, caching, and failover/fallback mechanisms.
• Design long-running batch processing that is idempotent, resumable, and resilient to individual item failures.
• Focus on optimizing latency, throughput, and cost efficiency for all AI-powered services.
• Serve as an engineering expert in integrating models and data feeds with existing business logic and APIs.
• Define and implement evaluation for AI feature output quality, not only system correctness.
• Implement rigorous testing strategies, including unit, integration, and performance testing, to ensure robustness of AI features.
• Champion and enforce high standards for code quality, architectural design, and system documentation, participating actively in peer code reviews.
• Take ownership of the full lifecycle of new AI features, from initial design and prototyping through API design, integration, persistent storage, deployment, and monitoring.
• Quickly onboard onto our existing codebase to maintain and enhance existing data and feature pipelines.
• Work closely with product managers and engineers to scope, estimate, and deliver features on a fast iterative cycle.

Qualifications

• Deep Engineering Fluency: Proven ability to build and deploy complex, high-quality software systems with an emphasis on maintainable code and rigorous testing.
• Python Proficiency: Fluent in Python and its ecosystem for backend services and data processing.
• System Design Expertise: Strong grasp of system design principles, distributed systems, and API design.
• AI/ML Feature Experience: Experience directly building, shipping, and maintaining AI-powered products, agents, or intelligent features commercially.
• LLM Production Experience: Hands-on experience integrating Large Language Models into production environments, including prompt engineering, vector databases, RAG systems, and context windows.
• Codebase Agility: Excellent ability to read, understand, and navigate an unfamiliar codebase quickly.

Great to Have

• Experience fine-tuning or distilling smaller task-specific models.
• Familiarity with agent frameworks and their failure modes.
• Familiarity with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes).