About Us
Launched in 2019, Constructor is an AI-first ecommerce search and discovery platform that helps shoppers find the right products at the right time and enables leading global e-commerce brands to drive meaningful revenue and conversion gains.
As a Senior Machine Learning Engineer in the Search Quality team, you will improve the e-commerce experience for hundreds of millions of users across the world by building the systems that power relevance for global retailers—from fashion and grocery to electronics and hardware.
The mission is to measure search quality, push it higher, and catch degradations before the user does. You will achieve this through a blend of fine-tuned LLMs for relevance judgment, real-time models, and deep offline analysis of query logs.
About the Job
Your primary focus will be relevance evaluation and quality improvements:
- LLM-based evaluation: Fine-tune models to assess relevance, understand query intent, represent catalog data, and align judgments with real user behavior.
- Real-time quality in production: Implement reranking, filtering, and signal computation under strict latency requirements.
- Automated quality monitoring and agentic insights: Build pipelines to detect degradations and leverage agent-based systems to generate actionable recommendations for product data and search configurations.
What Makes This Interesting
- Multi-domain, multi-language at scale: 40+ languages and 20+ domains without per-customer rules or overrides.
- No universal ground truth: Navigate varying definitions of relevance across different domain contexts (e.g., grocery vs. fashion).
- Efficiency at scale: Optimize and scale LLM inference across the entire customer base.
Requirements
- 4+ years shipping production ML systems
- Experience with search, information retrieval, or recommendation systems
- Hands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments
- Strong Python and PyTorch skills; fluency in SQL and data orchestration tools (Spark, Airflow)
- Experience designing and running A/B tests to validate model impact
- Excellent English communication skills
- Experience collaborating in cross-functional teams (ranking, product, data engineering)
Benefits
- Fully remote work setup with flexibility to choose where you live
- Base salary ($80k–$120K USD) plus stock options
- Unlimited vacation time (minimum 3 weeks/year encouraged)
- Work-from-home stipend for home office setup
- Apple laptop provided
- Annual training and development budget
- Paid maternity & paternity leave
- Regular team offsite events
Benefits
Equity, Unlimited PTO, Home office, Equipment, Learning, Parental leave
Open to
Worldwide
Sign in to track applications and earn points.
