YourAlly

NVIDIA Senior system design interview questions

These are the 4 system design questions YourAlly has tagged for NVIDIA at Senior. On the YourAlly ladder this is Senior, the same level as Google L5, Meta E5 and Amazon L6.

A system design round usually runs 45 to 60 minutes on one open-ended system. You agree on requirements and scale first, sketch the main components, then go further into whichever part the interviewer picks. At this level you should drive the design yourself and explain why each component is there.

Practice a mock NVIDIA Senior system design loopPractice NVIDIA system design questions

Design a Registry for Multi-GB AI ContainersFree to read

Design a container registry that serves GPU-optimized AI images of 10 to 30 GB to customer clusters, where a thousand nodes may pull the same new image within minutes.

What a strong answer covers

  • Content-addressed layers with deduplication of shared bases
  • Back-of-envelope on burst bandwidth
  • CDN plus request coalescing on cache miss
  • In-cluster pull-through cache or peer sharing
  • Immutable layers versus short-lived tag resolution
  • Revocation and garbage collection with a grace period

3 more system design questions

  1. Design GPU Driver Crash Telemetry Locked
  2. Design Model Rollout for an Inference Fleet Locked
  3. Design Over-the-Air Updates for a Vehicle Fleet Locked

Sign up free to practice all 4

Related pages

More NVIDIA Senior rounds

Other companies at this level