Berkeley Lab logo

System Infrastructure / Platform Engineer, HPC Technology Department

Berkeley Lab

Berkeley, CAHybridPosted 1 day ago$139,440 - $267,996/year
Full TimeSenior LevelTech & Data (Health IT)Research Institute
Original posting ↗

Summary

The National Energy Research Scientific Computing Center (NERSC) is seeking a System Infrastructure / Platform Engineer to help build and manage HPC systems and Linux-based infrastructure. NERSC operates some of the world's largest supercomputers, supporting thousands of researchers tackling major scientific challenges.

Job description

In this role, you will manage high-performance computing environments, including HPC systems, containers, virtual machines, and core infrastructure services. You'll work with cutting-edge technologies such as CPU/GPU clusters, parallel storage, high-speed networking, Slurm, and Kubernetes, balancing innovation with reliability, performance, and security at scale. Collaborating with engineers, researchers, vendors, and open-source communities, you will help develop scalable solutions that advance scientific discovery and the future of HPC.

What You Will Do if hired at a Level 3

  • Build and manage Linux systems and storage infrastructure
  • Troubleshoot complex technical issues with team members
  • Install, upgrade, and secure systems and services
  • Develop and maintain scripts and automation tools
  • Participate in a 24/7 on-call rotation
  • Lead small projects, upgrades, and service rollouts
  • Collaborate with vendors to improve technologies and user experience
  • Support reliable operations of NERSC's Perlmutter supercomputer and Spin Kubernetes platform
  • Develop and integrate services across NERSC and DOE facilities, including the upcoming Doudna supercomputer
  • Present technical work to the HPC community at conferences and industry events

Additional Responsibilities if hired at a Level 4

  • Solve complex technical problems with independent judgment
  • Develop team strategies and project plans
  • Provide technical leadership and mentorship
  • Lead system improvements for performance, reliability, and security
  • Evaluate emerging HPC technologies and capabilities
  • Represent NERSC in HPC and DOE technical communities and advocacy groups

What is Required to be hired at a Level 3

  • Typically, 8+ years of related experience with a Bachelor's degree; alternatively, 6+ years with a Master's degree; or equivalent career experience
  • 4+ years of experience managing large-scale Linux-based system deployments in a high-performance computing, cloud computing, or hyper-scale environment
  • Mastery of Linux concepts and operations (processes, networking, system logs, performance)
  • Proficiency with bash and Python scripting
  • Experience with some or all of our key technologies: containers (such as Docker or Kubernetes), virtualization (such as Proxmox or VMware), cloud-based deployment (such as AWS, Azure or GCP), identity and access management, database administration, tuning, and troubleshooting, storage systems technologies (such as iSCSI and NAS appliances), parallel filesystems (such as Lustre, GPFS, or VAST), high-speed networking/interconnect (such as InfiniBand, Slingshot, or RoCE), advanced performance analysis and debugging tools (such as strace, lsof, ebpf, or gdb), DevOps tools (such as Gitlab or Jira) and processes (such as issues, merge requests, and API/automation)
  • Familiarity with automated provisioning systems (such as Chef, Foreman, or Terraform)
  • Familiarity with configuration management systems (such as Ansible or Puppet)
  • Working knowledge of Linux system engineering and security practices
  • Ability to resolve complex issues in creative and effective ways and derive technical solutions in a collaborative environment to meet end user requirements or needs
  • Demonstrated ability to work independently as well as collaboratively in large projects, and contribute to an active and respectful intellectual environment
  • Creative, positive, and collaborative work style
  • Excellent oral and written communication skills

Additional Requirements to be hired at a Level 4

  • Typically, 12+ years of related experience with a Bachelor's degree; alternatively, 8+ years with a Master's degree; or equivalent career experience
  • Proven ability to lead troubleshooting and resolution of high-impact incidents in complex, large-scale environments
  • Demonstrated leadership in cross-team collaboration and mentoring
  • Experience in software engineering, Linux systems programming, or complex scripting
  • Experience managing one or more of the following: data center networking (TCP/IP, Ethernet, BGP, ECMP), batch workload managers (such as Slurm), including installation, configuration, routine operations, job lifecycle concepts, and troubleshooting common failure modes, Cray/HPE HPC ecosystems (e.g., CSM/COS, Slingshot interconnect, and related components)
  • Ability to lead and coordinate projects with traditional or Agile methodologies (such as Scrum or Kanban)
  • Ability to analyze and resolve significant and unique issues requiring evaluation of multiple intangible factors
  • Ability to exercise independent judgment in methods, techniques and evaluation criteria for obtaining results

Requirements

  • Typically, 8+ years of related experience with a Bachelor's degree; alternatively, 6+ years with a Master's degree; or equivalent career experience
  • 4+ years of experience managing large-scale Linux-based system deployments in a high-performance computing, cloud computing, or hyper-scale environment
  • Mastery of Linux concepts and operations (processes, networking, system logs, performance)
  • Proficiency with bash and Python scripting
  • Experience with containers (such as Docker or Kubernetes)
  • Experience with virtualization (such as Proxmox or VMware)
  • Experience with cloud-based deployment (such as AWS, Azure or GCP)
  • Experience with identity and access management
  • Experience with database administration, tuning, and troubleshooting
  • Experience with storage systems technologies (such as iSCSI and NAS appliances)
  • Experience with parallel filesystems (such as Lustre, GPFS, or VAST)
  • Experience with high-speed networking/interconnect (such as InfiniBand, Slingshot, or RoCE)
  • Experience with advanced performance analysis and debugging tools (such as strace, lsof, ebpf, or gdb)
  • Experience with DevOps tools (such as Gitlab or Jira) and processes (such as issues, merge requests, and API/automation)
  • Familiarity with automated provisioning systems (such as Chef, Foreman, or Terraform)
  • Familiarity with configuration management systems (such as Ansible or Puppet)
  • Working knowledge of Linux system engineering and security practices
  • Ability to resolve complex issues in creative and effective ways and derive technical solutions in a collaborative environment
  • Demonstrated ability to work independently as well as collaboratively in large projects
  • Creative, positive, and collaborative work style
  • Excellent oral and written communication skills
  • Level 4: Typically, 12+ years of related experience with a Bachelor's degree; alternatively, 8+ years with a Master's degree; or equivalent career experience
  • Level 4: Proven ability to lead troubleshooting and resolution of high-impact incidents in complex, large-scale environments
  • Level 4: Demonstrated leadership in cross-team collaboration and mentoring
  • Level 4: Experience in software engineering, Linux systems programming, or complex scripting
  • Level 4: Experience managing data center networking (TCP/IP, Ethernet, BGP, ECMP)
  • Level 4: Experience managing batch workload managers (such as Slurm)
  • Level 4: Experience managing Cray/HPE HPC ecosystems (e.g., CSM/COS, Slingshot interconnect)
  • Level 4: Ability to lead and coordinate projects with traditional or Agile methodologies (such as Scrum or Kanban)
  • Level 4: Ability to analyze and resolve significant and unique issues requiring evaluation of multiple intangible factors
  • Level 4: Ability to exercise independent judgment in methods, techniques and evaluation criteria for obtaining results

Benefits

  • Health Insurance
  • Retirement Benefits
  • Pension Plan
  • 401(k) Plans
  • Tuition Assistance Program
  • Vacation Time
  • Sick Time
  • Winter Holiday Shutdown
  • Parental Bonding Leave
  • Pet Insurance

Company overview

Lawrence Berkeley National Laboratory (Berkeley Lab) is a premier federally funded research and development center established in 1931 and managed by the University of California for the U.S. Department of Energy. With a distinguished history spanning over 90 years, Berkeley Lab has been awarded 17 Nobel Prizes and operates as a multidisciplinary research institution focused on discovery science and energy solutions. The laboratory's expertise encompasses six major research areas: Computing Sciences, Physical Sciences, Earth and Environmental Sciences, Biosciences, Energy Sciences, and Energy Technologies. Berkeley Lab operates five national scientific user facilities including the Advanced Light Source, Joint Genome Institute, Molecular Foundry, National Energy Research Scientific Computing Center (NERSC), and Energy Sciences Network (ESnet), serving over 14,000 researchers annually. The institution is renowned for its team science approach, pioneering research in particle physics, materials science, genomics, and climate science, while maintaining a strong commitment to addressing global energy challenges and advancing fundamental scientific knowledge.

Explore more jobs of your matchFind more biopharma roles with GetBioJob.