Site Reliability Engineer - Telemetry

About Kraken

Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. Payward—the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services, and CF Benchmarks—operates spot trading, margin, futures, staking, and OTC services.

The Team

Join our engineering team as a Site Reliability Engineer focused on the shared telemetry platform that helps teams understand, operate, and improve production services. You will work across metrics, logs, traces, alerting, dashboards, and profiling systems that make our platform observable at scale.

As a member of the Telemetry team, you will keep the systems that collect, store, query, and route operational data reliable and scalable. This is a hands-on role for an engineer who enjoys distributed systems, automation, observability, and solving production problems. You will work with Software Engineers, Platform teams, Security Engineers, and SREs to improve operational practices and support mission-critical services.

The Opportunity

• Operate and improve the shared platform for metrics, logs, traces, alerting, dashboards, and profiling.
• Maintain metrics collection, long-term storage, querying, dashboards, and alerting using Prometheus-compatible systems, VictoriaMetrics, Grafana, and modern alerting tools.
• Operate log pipelines using Vector, Splunk, and Loki, focusing on reliability, throughput, and troubleshooting.
• Operate distributed tracing and profiling capabilities using Grafana Alloy, Tempo, OpenTelemetry, and Pyroscope.
• Deploy and manage telemetry services using Terraform, Terragrunt, and container orchestration across multiple environments.
• Troubleshoot missing data, slow queries, broken alerts, pipeline backpressure, and capacity issues.
• Build reusable configuration and automation that helps teams manage dashboards, alerts, and telemetry integrations safely.
• Participate in incident response and on-call rotations, write runbooks, and improve the platform using lessons learned from incidents.

What You Bring

• 3+ years of experience as a Site Reliability Engineer, Platform/Infrastructure Engineer, Observability Engineer, or similar production engineering role.
• Experience managing production systems at scale that collect, process, store, and serve telemetry data (metrics, logs, traces, or profiles).
• Solid experience with Prometheus or a Prometheus-compatible monitoring stack, including metrics collection, querying, and alerting.
• Experience troubleshooting distributed production systems, including availability, latency, data flow, and capacity issues.
• Proficiency with Infrastructure as Code (specifically Terraform) and CI/CD pipelines.
• Experience operating containerized workloads with Nomad, Kubernetes, or similar platforms.
• Strong scripting/programming ability and comfort using AI tools and agents (e.g., Claude) to accelerate delivery.
• Strong incident response, documentation, and collaboration skills.

Nice to Haves

• Experience with VictoriaMetrics, Grafana, Tempo, Loki, Vector, Splunk, Alertmanager, or OpenTelemetry.
• Experience with PromQL, LogQL, or dashboards/alerts as code.
• Experience maintaining Kubernetes operators and custom resource definitions (CRDs).
• Experience with Consul, Vault, AWS, and on-premises or datacenter infrastructure.
• Experience operating high-volume logging, streaming, or data pipelines.
• Experience balancing trade-offs between observability data volume, performance, and cost.
• Background in highly regulated or financial services environments with strict change management and audit trails.