Back to the stack

Member of Technical Staff (Infrastructure): World Models

Remote Worldwide Hiring now

What You'll Do

  • Collaborate with researchers and engineers to understand workload requirements and translate them into infrastructure decisions — not just run what you're given.

  • Design and improve scheduling and resource allocation for inference and training coexistence on shared GPU clusters.

  • Build, operate, and scale GPU infrastructure across clusters of thousands of GPUs.

  • Own GPU utilization and cost as first-class metrics.

  • Build automated tooling and observability that reduces friction for the AI team.

  • Participate in on-call rotation and drive reliability improvements.

  • Serve as the primary point of contact for GPU providers, managing relationships and coordinating infrastructure needs.

Over time, you'll take on broader ownership: setting scheduling policy, driving architecture decisions for compute and storage systems, and identifying when infrastructure no longer fits evolving workloads.

What We're Looking For

  • Deep Systems Foundation: Linux-native. Understands how machines work, can debug at the kernel level. Deep understanding of networking and storage stacks.

  • Cluster Engineering: Experience operating and scaling GPU infrastructure (hundreds to thousands of GPUs), Kubernetes, Slurm, and distributed storage systems.

  • Distributed Systems Fundamentals: Experience designing, building, and operating distributed systems at scale.

  • Production Discipline: Track record of running critical infrastructure reliably — monitoring, incident response, and automation that reduces toil.

  • ML Familiarity: Enough understanding of training and inference workloads to collaborate with researchers and make sound infrastructure decisions.

  • Bonus: Resource-Constrained Thinking. Experience in environments where allocation, scheduling, and prioritization of scarce resources was the core problem (e.g. HPC, trading, large-scale ML platforms).

Challenges You'll Tackle

  • Balancing latency-sensitive inference against long-running training workloads

  • Operating under tight GPU constraints with constantly shifting demand

  • Adapting infrastructure to rapidly evolving model architectures and scale

  • Making tradeoffs between cost, utilization, and reliability at scale

Traits of the Ideal Candidate

  • High ownership: Owns problems end-to-end, sets priorities, and escalates early.

  • Challenges systems: Questions what exists and drives improvements when it no longer fits.

  • Learns fast: Quickly builds context to make sound infrastructure decisions.

  • Thinks in systems: Understands dependencies, validates assumptions, and catches issues early.

  • Raises the bar: Shares context, surfaces risks, and helps the team move faster.

What we offer (compensation & benefits)

  • Competitive salary and equity

  • Private health coverage

  • Pension contribution (UK, Canada, US)

  • Unlimited paid vacation

  • Fully-distributed, async-first culture

  • Hardware setup of your choice

  • Stipends for phone, internet, and meals

In our team, we approach our work with the dedication similar to Olympic athletes. Anticipate occasional late nights and weekends dedicated to our mission. We understand this level of commitment may not suit everyone, and we openly communicate this expectation.

If you're motivated by deeply technical problems, a seemingly never-ending uphill battle and the opportunity to build (and own) a generational technology company, we can give you what you're looking for.

All business roles at Moonvalley are hybrid positions by default, with some fully remote depending on the job scope. We meet a few times every year, usually in London, UK or North America (LA, Toronto) as a company.

If you're excited about the opportunity to work on cutting-edge AI technology and help shape the future of media and entertainment, we encourage you to apply. We look forward to hearing from you!

The statements contained in this job description reflect general details as necessary to describe the principal functions of this job, the level of knowledge and skill typically required and the scope of responsibility. It should not be considered an all-inclusive listing of work requirements. Individuals may perform other duties as assigned, including work in other functional areas to cover absences, to equalize peak work periods, or to otherwise balance organizational work

Moonvalley AI is proud to be an equal opportunity employer. We are committed to providing accommodations. If you require accommodation, we will work with you to meet your needs.

Please be assured we'll treat any information you share with us with the utmost care, only use your information for recruitment purposes and will never sell it to other companies for marketing purposes. Please review our privacy policy and job applicant privacy policy located here for further information.

Apply To This Job
Apply for this role Opens the employer's application page — free, no JobStack account needed.

More from the stack

Junior Sales Representative

Remote Worldwide
View role

B2B Sales Representative Entry Level

Remote Worldwide
View role

Senior SMM Manager (Ohayu at Genesis)

Remote Worldwide
View role

Open Learning Faculty Member (Web): HRMN 3841: Employee and Labour Relations

Remote Worldwide
View role

Digital Marketing Specialist (Remote)

Remote Worldwide
View role

Principal Identity Security Architect / Identity Strategist

Remote Worldwide
View role

HR Systems and Operations Analyst

Remote Worldwide
View role

Detection Engineer

Remote Worldwide
View role

Product Manager - Data

Remote Worldwide
View role

Senior Product Manager - CRM

Remote Worldwide
View role

Sales Representative II

Remote Worldwide
View role

Business Information Analyst – Default

Remote Worldwide
View role

Academy Program Coordinator (Contract)

Remote Worldwide
View role

Contract Compliance and Procurement Analyst

Remote Worldwide
View role

Senior Analyst, Drug Pricing Surveillance

Remote Worldwide
View role

Program Reinsurance Contracting Manager - Eatontown, NJ or Remote

Remote Worldwide
View role

Dyson Director of Student Services, Charles H. Dyson School of Applied Economics, Cornell University

Remote Worldwide
View role

Territory Manager - Critical Care (Columbus, OH)

Remote Worldwide
View role

Experienced Full Stack Data Entry Specialist – Patient Care and Clinical Services

Remote Worldwide
View role

Experienced Customer Service Representative – Delivering Exceptional Experiences at arenaflex

Remote Worldwide
View role