Senior Backend Software Engineer - Loki

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale. We are a 100% remote company with team members across 40+ countries.

This role is available for candidates located in Australia or Singapore.

The Opportunity

Grafana Cloud is our composable observability platform that integrates metrics, logs, traces, and profiles with Grafana. The Databases team owns the telemetry databases that are Mimir for metrics, Loki for logs, Tempo for traces, and Pyroscope for profiles.

Our databases are OSS projects that we also offer as a Cloud service supporting Grafana Cloud, and as an on-premise solution. They are multi-tenant distributed systems implemented in Go and running on Kubernetes across all major Cloud service providers (GCP, Azure, AWS).

What You'll Be Doing

• Design, build, operate, and maintain critical systems, owning the reliability, performance, and availability.
• Take an active role in influencing our roadmap and your own career objectives.
• Work with your team to deliver new features, then use the results to iterate and improve.
• Drive projects from initial ideation all the way to operations once it is in the hands of customers.
• Embrace our open-source culture and contribute to other projects that may not directly fall within your team’s scope.
• Be a part of your team’s on-call rotations and take ownership of the services you’re running.
• Mentor and support other team members, participate in design discussions, and collaborate with the team.
• Learn new skills by gaining a deeper understanding of our cloud product and our customers and getting to know the codebase of a large distributed system.

What Makes You a Great Fit

• Solid experience with at least one programming language (Go preferred, or Python, C, C++, Rust, etc.).
• Some experience with delivering projects from gathering requirements and brainstorming ideas, all the way to shipping a product to the customer’s hands in a self-driven way.
• Some experience with developing software that runs in the Cloud or some experience with systems engineering.
• Experience writing clean, robust, and performant software that is easily maintained by others.
• A motivated self-starter with a bias towards action and strong customer focus.

Bonus Points For

• Experience writing low-level code for databases, storage layers, or query engines.
• Experience working with Kubernetes.
• Experience as a user of Grafana and/or Prometheus in operational roles.
• Exposure to microservices architecture and distributed systems.
• Familiarity with being on-call and performing operations/SRE tasks.