Data Platform Engineer (Azure)
Builds and maintains Azure-based data infrastructure, pipelines, and cloud environments to ensure scalability, security, and reliability for analytics and enterprise data initiatives.
- Compensation
- Not disclosed
- Location
- Alexandria, Virginia, United States
- Work setup
- Hybrid
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
- 5+ years of experience in DevOps, Platform Engineering, SRE, or Cloud Infrastructure
- 3-5+ years of hands-on experience with Microsoft Azure, Databricks, and Azure Data Services
- Microsoft Azure, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Log Analytics, Azure Functions, Logic Apps, Databricks, Terraform, Bicep/ARM Templates, Azure DevOps,
Nice to have
- Unity Catalog, Docker, Kubernetes/AKS, GitOps, Observability Platforms, FinOps Practices, Secure Credential Management, Branching & Environment Management Strategies, Power BI Infrastructure Support,
- Certifications: Microsoft Azure Fundamentals (AZ-900), Azure Administrator Associate (AZ-104), Azure Data Engineer Associate (DP-203), Azure DevOps Engineer Expert (AZ-400), Databricks Certified Data
Full description
The Data Platform Engineer (Azure) is responsible for building, automating, and operating the infrastructure that supports the organization's enterprise data platform. This role ensures data pipelines, cloud environments, and platform services are reliable, scalable, secure, and observable across Microsoft Azure.
The position focuses on Infrastructure as Code (IaC), DevOps, CI/CD automation, cloud operations, platform governance, FinOps, security, and Site Reliability Engineering (SRE) practices. The Data Platform Engineer partners closely with Data Engineering, IT Infrastructure, Cybersecurity, and Business stakeholders to deliver a stable and high-performing data platform that supports analytics, reporting, and enterprise data initiatives.
Essential Duties & Responsibilities
Cloud Infrastructure & Platform Engineering
- Design, implement, and maintain Infrastructure as Code (IaC) for Azure-based data environments using Terraform, Bicep, and/or ARM Templates.
- Build and support highly available, scalable, and secure Azure cloud environments.
- Configure and maintain Azure networking components including:
- Virtual Networks (VNETs)
- Private Endpoints
- Network Security Groups
- Access Security Policies
CI/CD & Automation
- Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub Actions.
- Automate deployment of:
- Azure Data Factory
- Databricks Notebooks
- Data Pipelines
- Infrastructure Components
- Platform Services
- Establish deployment standards and environment promotion processes across Development, QA, and Production environments.
- Manage source control, versioning, branching strategies, and release processes.
Databricks Administration
- Administer and govern Databricks workspaces.
- Manage:
- Cluster Provisioning
- Cluster Policies
- Cost Controls
- Unity Catalog
- Access Controls
- Identity Management
- Support data engineering teams by maintaining a reliable Databricks platform environment.
Data Storage & Platform Governance
- Manage Azure Data Lake Storage Gen2 environments.
- Configure:
- Access Control Lists (ACLs)