Platform Engineer (KBase Project)
Berkeley Lab
Summary
Berkeley Lab's Environmental Genomics and Systems Biology (EGSB) Division has an opening for a Platform Engineer to join the US Department of Energy's Systems Biology Knowledgebase (KBase) team. You will help develop and operate KBase 2.0, a DOE-supported platform advancing predictive biology, scientific data integration, and AI-enabled discovery.
Job description
What You Will Do
- Develop and maintain KBase 2.0 software, including Lakehouse services, data discovery, multi-tenant access, and AI-enabled research workflows.
- Build backend services, APIs, data integrations, and researcher-facing tools such as portals, catalogs, dashboards, and data browsers.
- Support Lakehouse technologies, including Apache Iceberg, Delta Lake, Spark, Trino, Kubernetes, JupyterHub, and S3-compatible storage.
- Develop agentic AI capabilities, including tool orchestration, MCP integrations, RAG, benchmarking, evaluation, and provenance tracking.
- Use AI-assisted coding tools (e.g., Claude Code) while maintaining code quality, testing, and engineering standards.
- Ensure secure, governed, auditable, and reproducible data access across the platform.
- Collaborate with scientists, engineers, and AI researchers to translate scientific needs into reliable software solutions.
- Maintain documentation, automated testing, code reviews, CI/CD, and production-ready systems.
- Evaluate platform performance, scalability, reliability, and usability.
- Translate technical and scientific requirements into clear specifications, architecture plans, and implementation guidance.
What We Are Looking For
- Bachelor's Degree (or equivalent knowledge/training) in Computer Science, Data Science, Bioinformatics, Engineering, or a related technical field and a minimum of 5 years of relevant experience developing production-quality software in Python, TypeScript/JavaScript, Java, Scala, Go, or another modern programming language, or an equivalent combination of education and professional experience.
- Experience building backend services, APIs, web applications, data systems, or distributed software platforms.
- Experience with databases, data engineering concepts, distributed query engines, or data lakehouse technologies.
- Experience with Apache Iceberg, Delta Lake, Apache Spark, Trino, Presto, Polaris, Hive Metastore, or other lakehouse/catalog technologies.
- Experience with Kubernetes, JupyterHub, distributed compute environments, S3-compatible object storage, or cloud-native infrastructure.
- Experience with AI agent frameworks, tool-calling systems, Model Context Protocol (MCP), retrieval-augmented generation, evaluation harnesses, or agent benchmarking.
- Experience working with Linux-based development environments, Git, containers, and modern software development workflows.
- Demonstrated ability to critically evaluate AI-generated software, identify incorrect assumptions or architectural drift, and determine when generated code is safe and appropriate to merge, modify, or reject.
- Fluency with Claude Code or comparable agentic coding environments, including agent-assisted software development, iterative code generation, code review, debugging, test generation, and safe use of AI coding agents in production-oriented engineering workflows.
- Demonstrated ability to delegate traditionally low-value, yet time consuming engineering ceremonies to coding agents to remain focused on high-value Engineering activities.
- Excellent oral and written communication skills, including the ability to document technical designs and explain implementation tradeoffs.
- Demonstrated interpersonal and collaboration skills, including the ability to work collaboratively with interdisciplinary teams that include software engineers, scientists, data engineers, and AI researchers.
Desired Qualifications
- Master's Degree (or equivalent knowledge/training) in Computer Science, Data Science, Bioinformatics, Engineering, or a related technical field.
- Experience with data lakehouse architecture, including medallion-style data organization, catalog design, data governance, scalable query patterns, and separation of storage and compute.
- Exposure to Databricks, including Unity Catalog, Delta Lake, Delta Sharing, Databricks workflows, notebooks, or related Databricks platform capabilities.
- Familiarity with frontier engineering practices, including agentic coding, intent-driven development, architecture decision records, and AI-assisted testing and review, with an emphasis on maintainable code, clear documentation, and human accountability for software quality.
- Experience building or integrating full-stack applications using frameworks such as React, FastAPI, Node.js, or similar technologies.
- Experience with scientific data systems, bioinformatics platforms, genomics data, environmental data, or large-scale research cyberinfrastructure.
- Experience designing or implementing software for data governance, access control, provenance, metadata management, lineage tracking, audit logging, or policy enforcement.
- Familiarity with workflow systems, task execution services, distributed job orchestration, or HPC/cloud execution backends.
- Experience developing user-facing scientific portals, dashboards, data catalogs, tenant browsers, or interactive computational research environments.
- Experience with observability, monitoring, logging, performance profiling, or reliability engineering for distributed systems.
- Interest in open science, reproducible research, and building software infrastructure that supports the broader scientific community.
Requirements
- Bachelor's Degree (or equivalent) in Computer Science, Data Science, Bioinformatics, Engineering, or related technical field
- Minimum 5 years of relevant experience developing production-quality software
- Proficiency in Python, TypeScript/JavaScript, Java, Scala, Go, or another modern programming language
- Experience building backend services, APIs, web applications, data systems, or distributed software platforms
- Experience with databases, data engineering concepts, distributed query engines, or data lakehouse technologies
- Experience with Apache Iceberg, Delta Lake, Apache Spark, Trino, Presto, Polaris, Hive Metastore, or other lakehouse/catalog technologies
- Experience with Kubernetes, JupyterHub, distributed compute environments, S3-compatible object storage, or cloud-native infrastructure
- Experience with AI agent frameworks, tool-calling systems, Model Context Protocol (MCP), retrieval-augmented generation, evaluation harnesses, or agent benchmarking
- Experience with Linux-based development environments, Git, containers, and modern software development workflows
- Ability to critically evaluate AI-generated software and determine when generated code is safe to merge, modify, or reject
- Fluency with Claude Code or comparable agentic coding environments
- Excellent oral and written communication skills
- Demonstrated interpersonal and collaboration skills
- Candidates must be eligible to work in the U.S. at the time of hire
Benefits
- Health Benefits
- Paid Time Off
- Sick Time Off
- Holidays
Company overview
Lawrence Berkeley National Laboratory (Berkeley Lab) is a premier federally funded research and development center established in 1931 and managed by the University of California for the U.S. Department of Energy. With a distinguished history spanning over 90 years, Berkeley Lab has been awarded 17 Nobel Prizes and operates as a multidisciplinary research institution focused on discovery science and energy solutions. The laboratory's expertise encompasses six major research areas: Computing Sciences, Physical Sciences, Earth and Environmental Sciences, Biosciences, Energy Sciences, and Energy Technologies. Berkeley Lab operates five national scientific user facilities including the Advanced Light Source, Joint Genome Institute, Molecular Foundry, National Energy Research Scientific Computing Center (NERSC), and Energy Sciences Network (ESnet), serving over 14,000 researchers annually. The institution is renowned for its team science approach, pioneering research in particle physics, materials science, genomics, and climate science, while maintaining a strong commitment to addressing global energy challenges and advancing fundamental scientific knowledge.