Senior Software Engineer

Senior Software Engineer Overview

A well-funded AI engineering organization is seeking a Senior Software Engineer to join their team remotely. This role involves deploying, extending, and optimizing a leading open-source LLM inference engine across two key initiatives: a scaling inference project and a high-assurance initiative in a regulated environment.

Responsibilities

• Deploy, instrument, and monitor open-weight models served via the inference engine.
• Build new engine features to support novel hardware architectures.
• Extend the engine for accuracy, explainability, and accountability in regulated settings.
• Contribute upstream to the relevant open-source community.
• Optimize inference performance focusing on latency, throughput, and hardware utilization.

Requirements

• Senior-level proficiency in Python and low-level programming languages such as C/C++, Rust, or CUDA.
• Direct contributions to a major inference or serving engine or a similar machine learning infrastructure project.
• Strong grasp of LLM inference internals, including KV caching, batching, and quantization.
• Experience in upstreaming to active open-source software communities.
• Expertise in optimizing hardware accelerators like GPUs or TPUs.
• A genuine enthusiasm for AI-assisted development, particularly with LLMs and agents as core tools.

Benefits

• Competitive salary package.
• Opportunity to work in a well-funded AI engineering organization.
• Remote working flexibility.

Degree Requirement: Not Specified

Visa Sponsorship May be