Senior Backend Software Engineer - Loki

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale.

Note: This role is open to candidates located in the United States or Canada.

The Opportunity

Grafana Cloud is our composable observability platform that integrates metrics, logs, traces, and profiles with Grafana. It allows customers to leverage open-source observability software—including Prometheus, Mimir, Loki, Tempo, and Pyroscope—without the overhead of maintaining and scaling their own stack.

The Databases team owns the telemetry databases: Mimir for metrics, Loki for logs, Tempo for traces, and Pyroscope for profiles. These multi-tenant distributed systems are implemented in Go and run on Kubernetes across all major cloud providers (GCP, Azure, AWS).

We invest heavily in developer productivity. You can utilize modern AI coding assistants as part of your daily workflow with a company-funded usage budget, alongside access to frontier models from OpenAI, Anthropic, and Google.

What You'll Be Doing

• Design, build, operate, and maintain critical distributed systems, owning reliability, performance, and availability.
• Take an active role in influencing the engineering roadmap and your professional objectives.
• Work with your team to deliver new features and iterate based on real-world results.
• Drive projects from ideation through operational production in customers' hands.
• Contribute to open-source projects across Grafana's ecosystem.
• Participate in on-call rotations and take ownership of running services.
• Mentor and support other team members, participate in design discussions, and collaborate across teams.

Requirements

• Solid experience with at least one programming language (Go preferred; Python, C, C++, Rust or similar translate well).
• Proven experience delivering projects end-to-end, from gathering requirements to shipping production software.
• Experience developing software that runs in the Cloud or hands-on systems engineering experience.
• Demonstrated ability to write clean, robust, performant, and maintainable software.

Bonus Points

• Experience writing low-level code for databases, storage layers, or query engines.
• Hands-on experience working with Kubernetes.
• Prior operational experience using Grafana or Prometheus (including on-call or personal homelab environments).
• Exposure to microservices architecture and large-scale distributed systems.
• Familiarity with SRE practices, operations, or Infrastructure as Code (IaC).

Benefits & Rewards

• Base compensation range (Canada): CAD 164,500 – CAD 197,000 (US market ranges discussed during interview process).
• Equity package and bonus eligibility.
• 30 days of annual leave per annum (including 3 Grafana Shutdown Days).
• In-person onboarding experience with your onboarding cohort.