Role in brief
Kraken is looking for a Staff Site Reliability Engineer to enhance the AI Gateway's reliability and performance. This role is suited for experienced engineers with strong SRE backgrounds and expertise in Kubernetes and infrastructure as code.
About the role
As a Staff Site Reliability Engineer at Kraken, you will focus on the AI Gateway, a key service that supports various operations across the company. Your responsibilities will include ensuring the service's reliability, availability, and performance through effective SLOs and incident management practices.
You will be part of the Dev Platform team, which is responsible for building the internal tools that Kraken's engineers rely on. Success in this role means creating a resilient architecture, automating operations, and mentoring team members to elevate the overall engineering standards.
Skills that matter here
- Kubernetes: This role requires deep hands-on experience with Kubernetes for managing containerized applications.
- Terraform: You will use Terraform for infrastructure as code to automate operations.
- Rust: Proficiency in Rust is necessary for contributing to the production codebase.
- Python: Python is another programming language you will need to be comfortable with.
- API gateways: Experience with API gateways is essential for managing traffic and ensuring service reliability.
- Consul and Vault: You will utilize Consul and Vault for service discovery and secrets management.
Who this role suits
- You have extensive experience in site reliability or infrastructure engineering.
- You are comfortable leading cross-team initiatives and influencing technical direction.
- You possess strong judgment when balancing reliability, cost, and developer velocity.
- You thrive in a collaborative environment and enjoy mentoring others.
From the employer
- Own the reliability, availability and performance of the AI Gateway as a production-critical service used across the company, including SLOs, error budgets and on-call practices
- Design the gateway's resilience: multi-provider routing, failover, retries, rate limiting and graceful degradation when an upstream model provider is slow or unavailable
- Set the technical direction for gateway architecture, capacity planning and scaling as LLM traffic grows and more workloads move onto the gateway
- Build observability for LLM traffic, covering latency, errors, token usage and cost, attributed by team and use case
- Partner with Security, Finance and AI governance stakeholders to put access controls, budgets, audit logging and data-handling requirements into the platform
- Lead incident response and blameless post-incident reviews, and turn what you learn into lasting reliability improvements
- Automate operations through infrastructure as code, safe deployments and progressive rollouts
- Mentor engineers and raise the operating standard across Dev Platform
- Extensive experience in site reliability, infrastructure or platform engineering, with a track record of owning high-traffic, business-critical services in production
- Deep hands-on experience with Kubernetes, a major cloud provider and infrastructure as code (for example Terraform)
- Strong command of SLOs, observability and incident management, and the judgment to know which reliability work matters most
- Proficiency in a language such as Rust or Python, and comfort reading and contributing to a production service's codebase
- Experience with API gateways, reverse proxies or traffic management: load balancing, rate limiting, failover and caching
- Experience with Consul and Vault for service discovery, configuration and secrets management
- Working knowledge of authentication and authorization mechanisms for internal platforms and APIs, such as OAuth 2.0/OIDC, JWT, mTLS and API keys, and how to apply them to a multi-tenant service
- Experience with model evaluations: building or operating eval pipelines to compare models, prompts and agents, and to catch quality regressions before and after rollout
- Familiarity with coding agents and agent harnesses (for example OpenHands, Claude Code or similar), including running them safely in sandboxed environments for engineering teams
- Experience with agent memory systems and the databases behind them (vector stores, search, relational and key-value stores), and operating them reliably
- Staff-level influence: you set direction across teams, write clear design documents and bring others with you
- Good judgment balancing reliability, cost and developer velocity for internal customers
Questions about this role
Is this position remote?
Yes, this role is fully remote.
What is the seniority level for this position?
This is a senior-level position.
How can I apply for this role?
You can apply through the Kraken website.
✓ Drop your CV once, then continue to the employer's application form. Your profile stays here for every recruiter hiring on web3vacancy.