Senior Storage Engineer

Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU. If you'd like to build the world's best AI cloud, join us. *Note: This position requires presence in our San Francisco or San Jose office location 4 days per week; Lambda’s designated work from home day is currently Tuesday. Product Engineering at Lambda is responsible for building and scaling our cloud offering. Our scope includes the Lambda website, cloud APIs and systems as well as internal tooling for system deployment, management and maintenance. For distributed AI workloads, GPU compute power is only one factor. High-performance networking and storage are essential for interconnecting these systems and supporting AI training and inference at scale. Lambda’s Infrastructure Engineering team integrates advanced storage, networking, and compute hardware to build high-performance clusters. Our expertise lies at the intersection of: - High-Performance Distributed Storage Solutions: We deploy and maintain the storage systems that provide customer training and inference datasets at the speeds demanded by modern clustered GPUs. - Software Defined Networking: We deploy software defined network overlays that provide multi-tenant security and intelligent routing without compromising performance, using the latest in high-performance networking hardware. - Compute Virtualization: We enable virtualization that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure. - Cluster Integrity: We own the cluster integrity lifecycle: validating deployments, diagnosing performance and health across hardware and fabrics, and providing proactive remediation. About the Role: You will focus on design, standards, and domain expertise - Validation Design: Author comprehensive performance and correctness validation plans for new storage tiers. - Standardization: Draft Standard Operating Procedures (SOPs) and alerting/monitoring frameworks to scale operations. - Security & Access: Own the access-control lifecycle for storage solutions, managing both vendor and customer permissions. - Strategic Partnerships: Lead technical communications with vendors and act as a subject matter expert (SME) for customer success and complex account assistance. - Leadership: Identify and act on signals for operational ownership; mentor junior engineers in specific storage sub-domains. You Have: - 8+ years of experience designing, building, and operating large-scale multi-petabyte storage production environments - A strong understanding of diverse storage solutions and their ecosystems: - Familiarity with one or more storage solutions of the following vendors: Vast, Weka, DDN, NetApp, PureStorage, Dell, IBM, HPE - File, Block, and Object storage types - Storage Network Access Protocols such as NFS, SMB, and POSIX-compliant protocols. - NVMEoverFabricStorage Transport Protocols: NVME/TCP, NVME/IB, or NVME/RoCE - Storage performance via RDMA, GPUDirect Storage, parallel file systems - Encryption, storage security, and multi-tenancy strategies - Storage data-reduction, compression, and encryption - Backup and data protection - 5+ years of experience in Infrastructure as Code (e.g. Terraform, Ansible). Nice to Have - Experience with Kubernetes, including CSI and COSI drivers and CNI’s - Deep understanding of storage performance - Strong understanding of public cloud features (e.g., SDN, block storage, distributed file systems, identity management) - Experience deploying, operating, and maintaining Software Defined Storage - Have implemented either open-source or commercial monitoring solutions of storage and storage-adjacent solutions Salary Range Information The annual salary range for this position has been set based on market d