Senior Data Engineer - Lumin Digital

Role Overview

The Senior Data Engineer is responsible for designing, building, and optimizing the foundational data infrastructure and tools that support Lumin Digital’s data ecosystem. Focusing heavily on the Databricks data platform, this role develops scalable, reliable, and cost-effective solutions that enable engineering and analytics teams to accelerate development and delivery.

Key Responsibilities

• Design, develop, and maintain scalable, reliable, and cost-effective data platform architecture and foundational capabilities, with a primary focus on Databricks.
• Build and optimize data pipelines, integrations, and reusable tools that streamline data processing, improve developer productivity, and accelerate delivery across engineering and analytics teams.
• Monitor and optimize data platform performance, reliability, and resource utilization, identifying opportunities to improve efficiency and reduce operational costs.
• Collaborate with security and engineering teams to ensure data platform solutions align with established security standards, data governance practices, and applicable regulatory and compliance requirements.
• Partner with cross-functional stakeholders to identify shared platform needs, prioritize foundational improvements, and contribute to technical planning and architectural decisions.

Qualifications & Experience

• Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
• 5+ years of experience in software engineering, data engineering, or related technical disciplines.
• 5+ years of hands-on Databricks experience designing, developing, administering, and maintaining scalable cloud-based data platforms.
• Experience building data pipelines, integrations, automation, and reusable tools that support data processing and improve engineering productivity.
• Experience configuring, monitoring, troubleshooting, and optimizing data platform infrastructure for performance, reliability, scalability, and cost efficiency.
• Experience working with cloud infrastructure and services, preferably AWS (Azure or Google Cloud also valued).
• Experience developing and maintaining solutions using Scala, Python, SQL, Apache Spark, or similar data engineering technologies.
• Experience implementing automated infrastructure provisioning, configuration management, and deployment processes using infrastructure-as-code and CI/CD practices.
• Experience supporting production environments, resolving complex technical issues, and implementing improvements that increase platform stability and operational efficiency.
• Familiarity with streaming data platforms and event-driven architectures, such as Apache Kafka or Confluent, is preferred.

About Lumin Digital

Lumin Digital is a 100% cloud-native digital banking trailblazer empowering credit unions and banks with cutting-edge digital experiences. Our culture thrives on curiosity, innovation, trust, and continuous improvement.

Travel: Minimal, generally 12 days or less per year, with ~2 team get-togethers annually.