Enterprise Data Warehouse (EDW) ETL/Data Engineer
CSpring is seeking a Senior Azure Data Engineer to design and build scalable data pipelines and enterprise data platforms using Azure technologies like Databricks, Synapse, and Microsoft Fabric. The role involves developing ELT workflows, implementing medallion architectures, and leading cloud migration initiatives.
- Compensation
- Not disclosed
- Location
- Springfield, IL
- Work setup
- Remote
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Deep hands-on experience in Azure data technologies
- Experience with modern Lakehouse architectures
- Experience with enterprise-scale data migrations
- Proficiency in Azure Data Factory, Synapse Pipelines, Databricks, or Microsoft Fabric
- Experience with medallion architecture (Bronze/Silver/Gold) and Delta Lake
- Proficiency in PySpark and distributed processing
- Expertise in dimensional data modeling (Kimball)
- Experience with CI/CD processes using Azure DevOps, YAML, and Bicep/Terraform
Full description
At CSpring, we believe in the power of people and data to drive real-world impact. We’re a purpose-driven consulting firm that helps organizations solve complex business and technology challenges through modern data, analytics, and engineering solutions.
We are seeking a Senior Azure Data Engineer to help design, build, and support a next-generation enterprise data platform on Microsoft Azure. In this role, you will lead the development of scalable data pipelines and data products that power analytics, operational reporting, dashboards, and emerging AI/ML use cases.
You’ll work closely with data architects, analytics engineers, data scientists, platform teams, and business stakeholders to deliver secure, high-performing, and cost-effective cloud data solutions. This role is ideal for someone with deep hands-on experience in Azure data technologies, modern Lakehouse architectures, and enterprise-scale data migrations.
What You'll DoData Pipeline Engineering
- Design and develop reusable, parameter-driven ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Databricks, and/or Microsoft Fabric Data Factory
- Build and maintain medallion architecture (Bronze / Silver / Gold) solutions using Azure Data Lake Storage Gen2, Delta Lake, Parquet, and structured streaming patterns
- Develop performant ELT workflows leveraging pushdown processing to platforms such as Synapse Dedicated SQL Pool, Azure SQL, and Teradata
- Create and optimize PySpark notebooks and distributed processing jobs in Azure Databricks or Synapse Spark
Data Warehousing & Modeling
- Design dimensional data models using Kimball star and snowflake methodologies
- Implement data vault patterns, Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data strategies
- Optimize distributed SQL workloads in Synapse Dedicated SQL Pool and/or Fabric Warehouse environments
- Tune partitioning, indexing, and query performance for enterprise-scale datasets
Cloud Platform Engineering & DevOps
- Implement CI/CD processes for data pipelines using Azure DevOps, YAML pipelines, ARM templates, Bicep, and/or Terraform
- Build monitoring, logging, and auditing solutions using Azure Monitor, Log Analytics, and KQL
- Support code reviews, branching strategies, release management, and engineering standards across environments
- Participate in troubleshooting and production incident response for critical data pipelines
Migration & Modernization
- Lead or contribute to cloud modernization initiatives, including Informatica PowerCenter to Azure Data Factory migrations
- Support migration efforts from on-premises Teradata, Oracle, or SQL Server environments to Azure Synapse or Microsoft Fabric