Senior Software Engineer – Python (LLM Evaluation & Repository Validation)
via Turing
Key skills
- Python
- LLMs
- Docker
About the job
This is hands-on Python engineering work that helps measure how large language models handle real-world coding problems. It suits developers at tech-lead level who know their way around well-maintained open-source GitHub projects. The contract is with a fast-growing AI company that builds datasets to teach models practical software tasks.
What you'll do
- Review and prioritize issues from popular open-source libraries
- Prepare repositories for testing, including Docker and environment configuration
- Judge how thorough and reliable existing unit tests are
- Change and run code locally to see how well models fix bugs
- Work with researchers to choose repositories and issues that push model limits, with a chance to guide junior engineers
What you'll need
- At least 3 years of software engineering experience
- Strong Python skills
- Solid command of Git, Docker and basic pipeline setup
- Comfort reading and finding your way through large, complex codebases
- Open-source contribution or evaluation experience helps, and prior LLM evaluation or developer-tool testing is a bonus
Good to know
- Remote contractor assignment for 3 months, with no medical or paid leave
- Choose 20, 30 or 40 hours a week, working a minimum of 4 hours daily with 4 hours overlapping Pacific time
- Open to candidates in India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey and Mexico
- Screening is two technical interview rounds
Similar jobs
United States, Canada or Western Europe · via Turing
RemoteContractSoftware Engineering- LLMs
- Web Development
- Python
Remote · via Turing
RemoteContractSoftware Engineering- Python
- LLMs
United States, Canada and Europe · via AI platform
RemoteContractSoftware Engineering- LLMs
- Docker
- Git
Senior Engineer, Security Automation
$144,800–$181,000/yr
Twilio · Remote - US
RemoteFull-timeSoftware Engineering- LLMs
- Python
- Docker
Wehrtyou · London · via Arbeitnow
On-siteFull-timeSoftware Engineering- Python
- LLMs
- Software Engineering
Salvo Software · Remote · via Remote OK
RemoteFull-timeSoftware Engineering- LLMs
- Python
- Docker
North America · via Turing
RemoteContractSoftware Engineering- Python
- JavaScript
- TypeScript
Remote · via AfterQuery
RemoteContractSoftware Engineering- Web Development
- Docker
- JavaScript
Toptal · Remote — Anywhere in the World · via Remote OK
RemoteFull-timeSoftware Engineering- Python
- SQL
- Docker
Open Source GitHub Maintainer
$150–$300/hr
Remote (worldwide) · via micro1
RemoteContractSoftware Engineering- Git
- LLMs
- Python
Norm · Remote · via Remote OK
RemoteFull-timeLaw- Python
- TypeScript
- LLMs
MAIA · Remote — Berlin · via Arbeitnow
RemoteFull-timeSoftware Engineering- LLMs
- Python
- TypeScript
Software Engineer 5 – Agent Platform, AI Platform
$466,000–$750,000/yr
Netflix · Remote — United States · via Himalayas
RemoteFull-timeSoftware Engineering- LLMs
- Python
- SQL
Wisdomtree UK · London · via Arbeitnow
On-siteFull-timeSoftware Engineering- LLMs
- Docker
- Mathematics

