Member of Technical Staff – Infra, k8s, Dynamo
Lyceum
Key skills
- Python
- Systems Engineering
- LLMs
Your mission
You will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time.
Your focusScalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters.
Reliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime.
Performance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer.
Infrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack.
Your KPIs
- Platform uptime and availability (SLA adherence)
- P50/P95/P99 latency and throughput under load
- Time-to-detection and time-to-resolution for incidents
- Scalability milestones (concurrent users, requests per second, GPU utilisation)
Your profile
We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.
Requirements
- 3+ years of experience in backend, infrastructure, or systems engineering
- Strong proficiency in Go and Python
- Experience building or operating a model serving platform or ML platform
- Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput
- Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar)
- Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy
Nice to have
- Experience with NVIDIA Dynamo or similar inference orchestration/routing frameworks
- Hands-on experience with GPU serving infrastructure (vLLM, Triton, TensorRT-LLM)
- Experience with Kubernetes in a production environment (deployment, networking, resource management)
- Experience operating at scale (10k+ RPS, multi-region, multi-cluster)
- Comfortable working on-call or in incident response when things break
Why us?
- Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities
- Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world
- Ownership: Shape how European AI companies access GPU compute
- European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech
Find Jobs in Switzerland on Arbeitnow
Similar jobs
Remote · via Turing
RemoteContractSoftware Engineering- Python
- LLMs
India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico · via Turing
RemoteContractSoftware Engineering- Python
- LLMs
- Docker
United States, Canada or Western Europe · via Turing
RemoteContractSoftware Engineering- LLMs
- Web Development
- Python
Lyceum · Zürich · via Arbeitnow
On-siteFull-timeOther- Systems Engineering
- Python
- Bash
Black Forest Labs · Freiburg (Germany) · via Arbeitnow
On-siteFull-timeOther- PyTorch
- Scientific Research
- LLMs
Remanence · Paris · via Arbeitnow
On-siteFull-timeSoftware Engineering- Kubernetes
- Python
- SQL
Open Source GitHub Maintainer
$150–$300/hr
Remote (worldwide) · via micro1
RemoteContractSoftware Engineering- Git
- LLMs
- Python
India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico · via Turing
RemoteContractWriting- Python
- Technical Writing
- Software Engineering
Norm · Remote · via Remote OK
RemoteFull-timeLaw- Python
- TypeScript
- LLMs
Salvo Software · Remote · via Remote OK
RemoteFull-timeSoftware Engineering- LLMs
- Python
- Docker
vCluster Labs · Remote (worldwide) · via Himalayas
RemoteFull-timeSoftware Engineering- Kubernetes
- Python
- Git
Graphcore · Bristol; Cambridge · via Arbeitnow
On-siteFull-timeSoftware Engineering- Systems Engineering
- Python
- Bash
Causa Prima · Munich · via Arbeitnow
On-siteFull-timeOther Engineering- LLMs
- SQL
- Python
Member of Technical Staff, Agents
$200,000–$300,000/yr
Clera · Remote — United States · via Himalayas
RemoteFull-timeOther Engineering- Python
- Machine Learning
- SQL

