Software Engineer ($140K - $250K + Equity) at Opal Security

Jack & Jill · San Francisco, CA

Senior$160,000 – $250,000

Apply directly on Jack & Jill’s careers site — no account needed.

About the role

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers.

She will pick the best candidates from Jack's network.

The next step is to speak to Jack.

===

Job Title

Senior Software Engineer, Infrastructure

Salary

$160k-$250k + Equity

Company Description

Well-funded AI video platform

Job Description

You will own the GPU inference infrastructure powering real-time AI conversations with sub-second latency. Managing multi-provider GPU deployments and EKS clusters, you'll optimize performance from CUDA hot paths to backend services. This role is critical for scaling a platform that enables seamless human-to-AI interaction across global regions.

Location

San Francisco, USA or Remote

Why this role is remarkable

  • Own the core infrastructure for a cutting-edge real-time AI video interface that operates at sub-second latency levels globally.
  • Join a well-funded Series B startup backed by top-tier VCs, operating with a small, high-impact team of roughly 40 people.
  • Work at the intersection of infrastructure and research, directly influencing how conversational AI humans are deployed and experienced.

What You Will Do

  • Design and manage multi-region GPU deployments across various providers to ensure reliable, high-performance inference.
  • Architect EKS clusters including custom routing and scheduling logic to optimize workload placement across a global GPU fleet.
  • Collaborate with researchers to optimize CUDA hot paths and reduce cold-start times for live, face-to-face AI conversations.

The ideal candidate

  • Possesses hands-on experience deploying and optimizing large-scale GPU inference workloads on cloud providers like CoreWeave or AWS.
  • Demonstrates deep expertise in Kubernetes and EKS, specifically regarding complex service routing and cluster management at scale.
  • Proven track record of senior technical leadership, taking ownership of ambiguous infrastructure challenges and delivering production-ready solutions.

===

Who are Jack & Jill?

Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.

And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.

How does this work?

  • Jack's an AI agent for job searching and career coaching. He works for you.
  • Jill is the AI recruiter working for the company. She recruits from Jack's network.
  • If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives.

We never post fake jobs

This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network.

Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description.

We appreciate this can make them look a bit suspect, but there isn't much we can do about it.

Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.

Description sourced from the public LinkedIn listing — this role isn't indexed from the company's career page yet.

Skills

  • Python
  • SQL
  • ClickHouse

Never be applicant #200 again

Every job here is indexed straight from company career pages — often hours after it opens, before it reaches the big boards. Create a free account and get your best matches in a twice-daily digest.

  • Your best matches, twice a day
  • No duplicates, no ghost jobs, no recruiter spam
  • Every job free to browse — pay only when you apply
Get my matched jobs

Free account — no card required

93 117 live jobs · 17 643 companies tracked · 105 added today

Similar jobs

Software Engineer ($140K - $250K + Equity) at Opal Security — Jack & Jill · Real Job Offers