Backend ML Engineer

About the role

Prior Labs is building the next generation of tabular foundation models and needs a Backend ML Engineer to own the design, implementation, and scaling of the core serving systems. You will work closely with world‑class AI researchers to turn cutting‑edge models into reliable, high‑performance production services.

Key responsibilities

• Own the end‑to‑end inference serving path, optimizing latency, throughput, batching, memory usage and cost per prediction.
• Design, build and secure robust, scalable backend systems and production‑grade APIs for model serving.
• Develop high‑quality, maintainable code for core backend services.
• Design, deploy and manage core infrastructure on cloud platforms with a focus on reliability, observability and cost‑efficiency.
• Implement GDPR‑compliant security measures, data storage controls and usage tracking.
• Champion best practices for testing, CI/CD, documentation and security across the engineering team.

Required profile

• 3+ years of professional experience in machine learning and backend engineering.
• Proven experience deploying and operating ML models in production at scale.
• Strong hands‑on experience designing and building production‑grade APIs and backend services.
• Significant experience building services on cloud platforms, preferably GCP.
• Hands‑on expertise with Infrastructure as Code (e.g., Terraform) and container orchestration (Docker, Kubernetes).
• Proficiency in Python.

Required skills

• Python
• Google Cloud Platform (GCP)
• Terraform
• Docker
• Kubernetes
• PyTorch
• FastAPI
• Infrastructure as Code