AI Platform Engineer

Who are we: Graviton Research Capital is one of the largest quantitative trading firms emerging out of APAC, with a strong footprint across global exchanges and a rapidly growing presence across Europe and the USA. Were long-term focused, and deeply invested in building high-performance teams that operate at scale in some of the most competitive markets globally. You will be part of the team that builds and manages AI platforms.

What youll do:

• Deploy and operate open-weight LLMs on our internal servers.
• Build and run an internal LLM gateway/router between in-house and external models.
• Size and manage internal infrastructure capacity across teams: scheduling, monitoring and utilization.
• Tune serving for throughput and latency: KV cache management, batching, quantization and context-length trade-offs.
• Evaluate new models and inference techniques as they appear, and advise on what to adopt.
• Support fine-tuning of models on internal data and help evaluate the results.
• Help teams use the platform with coding assistants, internal tools, retrieval over documentation.

What Were Looking For:

• 7+ years of engineering experience, preferably in Python.
• Hands-on experience deploying and serving LLMs on on-prem servers.
• Experience with or strong working knowledge of LLM gateways/proxies (LiteLLM, OpenRouter or in-house).
• Understanding of inference concepts: KV cache, batching, quantization, memory limits.
• Working knowledge of fine-tuning and how tuned models are evaluated.
• Actively follows AI developments and can discuss recent models and techniques.

Why Join Us

• Work on challenging and advanced engineering problems
• Flat, engineering-centric culture with peers from strong technical backgrounds
• Fast paced decision-making, high ownership, and long-term focus
• Competitive compensation with strong growth opportunities