Supercomputing Engineer

San Francisco, CA

Applications have closed

San Francisco Compute

Large, low-cost pre-training clusters you can rent by the hour. Get H100s with 3.2tb/s InfiniBand, with parallel storage, fast networking, and priority support.

View all jobs at San Francisco Compute

About the Role

ML training clusters are some of the most high performance computers on the planet. Even relatively small clusters would have been in the TOP500 5 years ago. Our supercomputing team is responsible for keeping our compute clusters running smoothly, monitoring hardware health, and fixing things when they go wrong. We believe strongly in automation — code is the only reliable way to manage hardware at scale. As we scale, this will become a more data-driven role, predicting failures before they happen. We’re a small team, so you’ll be spending time talking to customers as well.

About Us

We’re the San Francisco Compute Company. We’re building the first real-time compute exchange. We think that over the next decade, thousands of startups and labs are going to be training and serving large models. They need compute to do this, and we’re building an exchange on which that compute can be traded. If we’re successful, it will be possible to scale to tens of thousands of accelerators for hours at a time without having to build your own infrastructure. This will greatly increase the number of organizations that can afford to train large models, which will make the most important technology of our lifetime accessible to more people.

About You

  • You’ve managed at least one GPU training cluster in the past (ideally a cluster with >1k GPU’s but not required)

  • You appreciate and value good documentation

  • You deeply understand Linux, CUDA, NCCL, and Infiniband

  • You enjoy creating large self-correcting systems that keep hardware humming

Some Nice to Haves

  • Experience with Rust (our VM orchestrator is written in Rust)

  • Experience with distributed storage systems (Weka, VAST, Ceph, etc.)

  • Experience with HPC network architectures (eBGP, fat-tree, VXLAN, MCLAG, etc.)

  • Experience with Linux virtualization (KVM, QEMU, libvirt, etc.)

  • Experience with performance optimization of machine learning kernels

Funding

We recently raised a $12 million seed round led by Jack Altman (Alt Capital) with participation from Akshay Kothari (Co-founder & COO, Notion), Christina Cacioppo (Co-founder & CEO, Vanta), Terrence Rohan (Otherwise Fund), Noah Smith, and many others.

Benefits

Unlimited office book budget

You can buy as many books for the office as you want. You’re encouraged to spend time during the workday reading!

Generous equity grant

Team members are offered a competitive salary along with equity in the company

Retirement matching

We match 401(k) plans up to 4%

Medical, dental & vision

We offer competitive medical, dental, vision insurance for employees and dependents and cover 100% of premiums

Time off

We offer unlimited paid time off as well as 10+ observed holidays

Parental leave

We offer biological, adoptive, and foster parents paid time off to spend quality time with family

Daily lunch

We cover lunch daily for employees

Visa Sponsorships

Yes, we sponsor visas and work permits.

Press

We have been written about in BloombergThe New York TimesThe Verge, and on Hacker News.

Social

@sfcompute

The San Francisco Compute Company is committed to maintaining a workplace free from discrimination and harassment.

We make employment decisions based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, belief, national origin, social or ethical origin, age, physical, mental, or sensory disability, sexual orientation, gender identity or expression, marital status, civil union or domestic partnership status, past or present military service, HIV status, family medical history or genetic information, family or parental status including pregnancy, or any other status protected by law.

We welcome the opportunity to consider qualified applicants with prior arrest or conviction records. Our commitment to diversity includes hiring talented individuals regardless of their criminal history, in accordance with local, state, and federal laws, including San Francisco’s Fair Chance Ordinance and California’s ban-the-box laws.

Job stats:  6  0  0

Tags: Automation KVM Linux Machine Learning Monitoring Rust VXLAN

Perks/benefits: 401(k) matching Career development Competitive pay Equity / stock options Flex vacation Health care Insurance Medical leave Parental leave Unlimited paid time off

Region: North America
Country: United States

More jobs like this

Explore more career opportunities

Find even more open roles below ordered by popularity of job title or skills/products/technologies used.