Software Engineer - Data Infrastructure - Kafka

About the Role

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team develops managed solutions for a full range of data technologies, including big data, NoSQL, cache-layers, analytics, and structured SQL engines.

We are looking for candidates from junior to senior levels with a passion for distributed systems, specifically event-stores like Kafka and parallel computing frameworks like Spark. This role focuses on the creation and automation of infrastructure features for data platforms, rather than data analysis or processing.

What You Will Do

• Collaborate proactively with a distributed, global team.
• Write high-quality, idiomatic Python code to create new features.
• Debug complex issues and interact with upstream open-source communities.
• Work with talented engineers across various domains.
• Participate in global travel for 2 to 4 weeks per year for internal and external events.

Requirements

• Proven hands-on experience in software development using Python.
• Proven hands-on experience in distributed systems (e.g., Kafka, Spark).
• Bachelor’s degree or equivalent in Computer Science, STEM, or a similar field.
• Willingness to travel up to 4 times a year for company events.

Preferred Qualifications

• Experience operating data platform technologies (SQL/NoSQL) at a DBA level.
• Experience with Linux systems administration, package management, and infrastructure operations.
• Experience with public or private cloud solutions (e.g., OpenStack).
• Experience operating Kubernetes clusters for persistent data services.

Benefits

• Fully remote working environment (remote-first since 2004).
• Personal learning and development budget of $2,000 USD per annum.
• Annual compensation review and recognition rewards.
• Comprehensive benefits including parental leave and Employee Assistance Programme.
• Opportunities for international travel for company events.