Staff Software Engineer - Data Platform
Staff engineer and technical lead on Pantheon's Data Platform team, architecting and building the configuration-driven data infrastructure (ingest, curation, retention) that powers analytics and ML/LLM-driven insights across the company. Hands-on stack: Python, Airflow, Kubernetes, Snowflake, GCP, Docker, Terraform.
- Compensation
- $166.7K–$232K / yr
- Location
- Not listed
- Work setup
- Not specified
- Seniority
- Staff
- Employment
- Not specified
- Experience
- 8+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 8+ years building production data systems
- Deep expertise in large-volume data pipelines, cloud databases, and real-time data events
- Distributed data systems: processing large-scale datasets with high throughput and low latency trade-offs
- Data modeling and architecture for OLAP and OLTP systems
- Experience with data governance frameworks, data catalogs, and observability tooling
- Technical lead experience: mentoring engineers and driving architecture decisions
- Strong hands-on experience with Python 3
- Hands-on experience with cloud data warehouses such as Snowflake, BigQuery, Firebolt, or Redshift
- Experience with containers, Kubernetes, and Terraform
- Familiarity with configuration-driven pipeline design, Airflow, and CI/CD for data workflows
- Experience building data infrastructure behind ML/LLM applications (feature stores, embedding/vector pipelines)
- Hands-on experience using AI tools to accelerate work
- Quality mindset: automated test coverage, data validation, and idempotent design in deployment pipelines
- Design principles: security, trust, dependability, declarative design, modularity, containers, idempotency
- Customer/product focus: aligning data solutions with business value
- Clear communication with technical and non-technical stakeholders
- Team mindset with pride in team accomplishments
- Willingness to participate in the Data team's on-call rotation
Nice to have
- Experience with Google Cloud Platform
Full description
Compensation: $167k – $232k
About Pantheon
Pantheon WebOps Platform powers the open web, running more than 300,000 sites in the cloud for customers including Google, Princeton, Salesloft and Doctors Without Borders. Every day, thousands of developers and marketers create, iterate, and scale WordPress and Drupal sites to reach billions of people globally. Pantheon’s multitenant, container-based platform enables organizations to manage all of their websites from a single dashboard. Organizations including Clorox and the United Nations drive results through accelerated development and real-time publishing using Pantheon’s collaborative workflows.
The Role
The Data Platform team powers Pantheon’s data infrastructure and delivers analytics across the company. We’ve built a robust, configuration-driven data platform that handles extraction, ingestion, curation, compliance, security, and enterprise-wide access to data — and we’re looking for a Staff Software Engineer to take it to the next level.
In this role, you’ll extend the platform beyond its current foundation to surface data insights directly within our Product experience, and to power the infrastructure behind Machine Learning and LLM-driven insights. As the lead technical member of the Data Platform team, you’ll architect the next generation of services that let every team at Pantheon trust and act on data, working closely with Software Engineers, Data Engineers, Analytic Engineers and Product. The platform runs on Python, Airflow, Kubernetes, configuration YAML, Great Expectations, and Terraform.
Pantheon’s core values are Trust, Teamwork, Passion, and Customers First. Within engineering, we value collaboration, character, autonomy, and a no-blame culture — and we’re active participants in several open-source communities.
What You Will Do
- Take the platform to the next level. Extend our robust, configuration-driven data platform to surface data insights directly within the Product experience, and to power the infrastructure behind Machine Learning and LLM-driven insights.
- Enhance platform architecture. Serve as the lead technical member of the Data Platform team, maintaining and enhancing our core platform services: Ingest as a Service (consistent extraction and loading into the data lake), Curation as a Service (configuration-driven, audited transformations) and Retention as a Service (historical data hosting that balances access, compliance, and cost).
- Build with modern data infrastructure. Work hands-on with Snowflake (including Snowpark for Python), Google Cloud Platform, Airflow , Docker, and Terraform.
- Mentor the team. Guide a team of engineers in designing and implementing high impact projects, raising the technical bar across the group.