Staff Engineer – Data platform

Staff Engineer – Data platform Overview

At Kpler, we are committed to assisting our clients in navigating complex markets with ease. By simplifying global trade information and offering valuable insights, we empower organizations to make informed decisions in the commodities, energy, and maritime sectors. Since our inception in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 850 experts from 69 countries works diligently to transform intricate data into actionable strategies, ensuring our clients remain competitive in a dynamic market landscape.

The Data Platform tribe is responsible for building the tools and foundational datasets that support the rest of Kpler’s products. They lead the development of large-scale, distributed, real-time pipelines for geospatial data using technologies such as Flink and Iceberg. As a Staff Engineer, you will play a crucial role in the engineering leadership at Kpler, aligning priorities and ensuring the successful delivery of key initiatives across various teams and departments.

Your key responsibilities will include:

• Designing, developing, and maintaining real-time and batch data pipelines.
• Improving the reliability and observability of data pipelines, while taking ownership of their operational excellence.
• Managing complex cloud-based infrastructure, adhering to the principle of ‘you build it, you run it.’
• Collaborating with a diverse set of stakeholders to manage data products.
• Providing strategic and technical leadership, while mentoring other engineers in the team.
• Gaining a deep understanding of a complex domain with many cross-team dependencies.
• Owning features from end to end.

To be a suitable candidate, you should possess:

• 10+ years of experience in Data Engineering or Software Engineering roles, ideally with DevOps exposure.
• Strong technical foundations in backend, data, or distributed systems, with significant experience in Java.
• Proven experience with streaming technologies such as Kafka or Flink.
• The ability to work effectively with Product, Engineering, and domain stakeholders to translate business priorities into clear technical and delivery outcomes.
• A deep understanding of distributed systems and architectural trade-offs.
• Significant professional experience with AI agents.
• Experience in a cloud environment (AWS, GCP, Azure).
• A strong command of written and spoken English.

Desirable qualifications include:

• Proven experience with batch technologies such as Spark.
• Exposure to Infrastructure as Code tools like Terraform or Pulumi.
• Professional experience with Python or Scala.

We are a dynamic company dedicated to fostering connections and innovating solutions to address market challenges. If you are passionate about customer satisfaction and turning ideas into reality, we encourage you to apply. At Kpler, we value diverse perspectives and are committed to creating an inclusive work environment. We welcome applicants from all backgrounds and experiences, and we are an equal opportunity employer.

Degree Requirement: Not Specified

Visa Sponsorship May be