LillyDirect Pharmacy Master Data Technical Lead
Eli Lilly and Company
Summary
As Technical Lead for the LillyDirect Pharmacy Covered Entity Master Data team, you will own the technical direction and delivery of the data platform that creates trusted, consented customer and partner profiles. You will set engineering standards, guide a team of data engineers, and be the go-to expert on how Reltio (profile master data) and Transcend (consent management) work with our AWS and Databricks data platform. This is a hands-on technical leadership role.
Job description
What you'll be doing: Master data and consent
- Define and own the technical architecture for profile master data, including Reltio integration, match and merge logic, survivorship rules, and golden record delivery to downstream consumers.
- Design how consent and preference data from Transcend flows through the platform, so consent status is enforced consistently in pipelines, profiles, and downstream use.
- Design how data subject requests (for example access and deletion) are carried out across profile data and downstream systems, so requests are honored consistently and can be evidenced.
- Partner with Privacy, Legal, Quality, and business teams to translate consent and regulatory requirements (for example HIPAA and applicable privacy laws) into technical controls.
- Define technical controls for protecting sensitive data (PII/PHI), including access control, masking, encryption, and retention, in line with Lilly standards.
- Build data quality, lineage, and reconciliation checks that prove profile and consent data is accurate, complete, and auditable.
Data engineering delivery
- Lead design and delivery of batch and near-real-time pipelines in Python and PySpark on Databricks and AWS.
- Design Delta Lake and lakehouse (medallion) structures with sound partitioning, schema evolution, and Unity Catalog governance.
- Build observable pipelines with error handling, retries, alerting, and clear SLAs.
- Set standards for CI/CD and infrastructure-as-code for data workloads, working with the DevOps engineer, so environments are repeatable and reviewed.
- Tune SQL, Spark jobs, and data models for performance and cost.
- Own production support for data pipelines, including escalation, incident response, and root cause analysis, in partnership with the DevOps engineer.
Technical leadership
- Set coding standards, code review practices, and documentation (architecture decision records, runbooks, data contracts).
- Mentor engineers through design reviews, pair programming, and knowledge sessions.
- Partner with product owners, architects, and vendor teams to turn business needs into a clear technical roadmap, and influence vendor resources so delivery matches our data and technical direction.
- Represent the team in architecture reviews, security reviews, and platform governance forums.
How You Will Succeed
- You turn business and privacy needs into technical outcomes that stakeholders understand and trust.
- You set standards that others adopt, and you mentor engineers to raise the team's technical bar.
- You treat consent as a design principle, not an afterthought, and you catch risks before they reach production.
- You improve systems continuously through automation, performance tuning, and proactive issue resolution.
- You communicate with clarity to technical and non-technical audiences.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
- 8+ years of professional experience in data engineering or software engineering
- 3+ years as a tech lead, principal engineer, or senior individual contributor
- 3+ years of hands-on experience with Reltio (or a comparable MDM platform) for profile or customer master data, including match rules, survivorship, and integration patterns
- Working understanding of consent and preference management and how consent must be enforced in data pipelines and downstream use
- Hands-on experience with Transcend (or a similar consent platform) for consent, preference, or data subject request workflows
- Expert-level Python and PySpark with production-grade code, automated testing, and performance tuning
- Advanced SQL, including window functions, CTEs, and query optimization
- Strong hands-on experience building data pipelines on AWS (S3, Glue, Lambda, Step Functions, Athena or Redshift, IAM) and Databricks, including Delta Lake
- Experience with data modeling (dimensional and lakehouse medallion patterns) and data governance, security, and quality practices, including protection of sensitive data (PII/PHI)
- Experience with CI/CD, Git, and infrastructure-as-code (Terraform, CDK, or CloudFormation)
- Ability to lead technical design, mentor engineers, and communicate clearly with technical and non-technical stakeholders
- Pharmaceutical, healthcare, or pharmacy industry experience, and experience in regulated environments with privacy and compliance requirements
- Experience partnering with and influencing vendor resources on solution development and delivery
- Experience with orchestration tools such as Apache Airflow or Databricks Workflows
- Familiarity with data quality frameworks (Great Expectations or dbt tests) and with streaming platforms (Kafka, Kinesis, or MSK)
- Familiarity with data catalog and governance tools such as Unity Catalog or AWS Lake Formation
- AWS Certified Data Engineer - Associate, AWS Solutions Architect, or Databricks Certified Data Engineer (Associate or Professional)
Benefits
- 401(k) Matching
- Pension
- Vacation Benefits
- Medical, Dental & Vision
- Prescription Drug Benefits
- Flexible Spending Accounts
- Life Insurance
- Death Benefits
- Employee Assistance Program
- Fitness Benefits
- Employee Clubs & Activities
- Company Bonus
Company overview
Eli Lilly and Company, commonly known as Lilly, is a leading American multinational pharmaceutical corporation headquartered in Indianapolis, Indiana. Founded in 1876 by Colonel Eli Lilly, the company has grown into one of the world's most valuable pharmaceutical enterprises, with operations in approximately 125 countries. Lilly specializes in developing and manufacturing innovative medicines across multiple therapeutic areas, including diabetes, oncology, neuroscience, immunology, and cardiometabolic diseases. The company is renowned for its groundbreaking work in insulin production, having been the first to mass-produce insulin and later developing the first commercially available insulin product in the U.S. Lilly's current portfolio includes blockbuster medications such as Mounjaro and Zepbound (tirzepatide) for diabetes and obesity, Trulicity (dulaglutide) for type 2 diabetes, Verzenio (abemaciclib) for breast cancer, and Taltz (ixekizumab) for autoimmune conditions. With approximately 47,000 employees worldwide, Lilly maintains a strong commitment to research and development, investing heavily in scientific innovation to address some of the world's most significant health challenges. The company operates with a mission to make life better for people around the world through the discovery and delivery of innovative medicines.