Databricks & Snowflake Infrastructure Engineer
- Compensation
- Not disclosed
- Location
- Not listed
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 2+ years
- Category
- Devops
- Posted
Skills
Full description
Day to Day Job Duties
Design, build, and maintain Terraform templates and Infrastructure as Code (IaC) frameworks to automate the deployment of Databricks and Snowflake platforms on AWS.
Deploy and configure Databricks workspaces, account-level settings, workspace networking, cluster policies, service principals, and Unity Catalog environments using Terraform and platform APIs.
Configure and validate Unity Catalog metastore architecture, catalog/schema structure, external locations, storage credentials, privilege models, and data governance controls.
Deploy and validate Snowflake accounts, virtual warehouses, databases, schemas, roles, warehouses, resource monitors, and role-based access control (RBAC) configurations.
Implement secure AWS infrastructure, including VPCs, PrivateLink, security groups, IAM roles, KMS encryption, Secrets Manager, and network segmentation to support Databricks and Snowflake deployments.
Build CI/CD pipelines to automate environment provisioning, configuration management, testing, and promotion across development, QA, and production environments.
Perform platform validation and operational readiness testing, including authentication, authorization, networking, connectivity, data access, encryption, monitoring, and disaster recovery capabilities.
Partner with Cloud Architects, Security Engineers, and Data Platform teams to establish deployment standards, reference architectures, and platform governance controls.
Troubleshoot infrastructure, connectivity, identity, Unity Catalog, and Snowflake security configuration issues.
Create reusable deployment accelerators, Terraform modules, platform blueprints, and operational runbooks to support enterprise-scale platform rollouts.
Basic Qualifications
Minimum 7+ years of experience in Cloud Engineering, DevOps Engineering, Infrastructure Engineering, or Platform Engineering.
Minimum 5+ years of hands-on experience developing Infrastructure as Code (IaC) solutions using Terraform.
Minimum 5+ years of experience with AWS services, including VPCs, IAM, KMS, Secrets Manager, CloudTrail, networking, and cloud security.
Minimum 3+ years of experience deploying and administering Databricks on AWS, including workspace deployment, Unity Catalog, cluster policies, service principals, secrets management, and workspace networking.
Minimum 3+ years of experience deploying and administering Snowflake, including account setup, database architecture, warehouses, RBAC, data sharing, security policies, and resource governance.
Minimum 3+ years of experience implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, GitLab, or similar tools.Minimum 3+ years of experience implementing secure cloud architectures, including encryption, identity management, secrets management, and network isolation.