Encora10
Senior Data Engineer (Earnix)
Senior Data Engineer at Coforge building production-grade data pipelines and governed insurance-pricing data products (quotes, premiums, rating factors) on Azure Databricks, dbt, Python/PySpark, SQL, and Delta Lake, with governance via Unity Catalog. Requires 7+ years of data engineering experience; remote role open to candidates in Costa Rica, Peru, Colombia, or Bolivia.
- Compensation
- Not disclosed
- Location
- Colombia
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 7+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 7+ years of Data Engineering experience, including strong recent experience with enterprise Databricks platforms
- Strong production experience with Azure Databricks, Spark, Delta Lake, Workflows/Jobs, Databricks SQL, and platform optimization
- Advanced hands-on experience with dbt models, macros, tests, documentation, incremental patterns, and CI/CD integration
- Strong Python and PySpark skills for transformations, reusable frameworks, integrations, validation, and automated testing
- Advanced SQL skills, including query optimization, data reconciliation, and analytical data modeling
- Strong experience with enterprise ELT/ETL, batch pipelines, incremental processing, data quality, and production support
- Practical experience with Unity Catalog or comparable data governance, lineage, and access-control capabilities
- Experience with CI/CD, Git, automated deployments, peer reviews, and environment promotion for data products
- Strong Azure experience, including cloud storage, identity, security, and integration patterns
- Proven ownership of production data pipelines from design through deployment, monitoring, and incident resolution
Nice to have
- Experience with insurance pricing, policies, quotes, premiums, rating factors, underwriting, or actuarial data
- Experience integrating with Earnix or another enterprise pricing/rating engine
- Experience with Dataiku, MLflow, or governed machine-learning workflows
- Knowledge of Kafka, Event Hubs, streaming patterns, FastAPI, REST APIs, or low-latency data services
- Experience with Power BI and Terraform
Full description
Senior Data Engineer (Earnix)
Job Title: Senior Data Engineer (Earnix)
Key Skills: Azure Databricks, dbt, Python, PySpark, SQL, Delta Lake, Unity Catalog, Azure, CI/CD, Data Engineering, Earnix
Experience: 7+ YOE.
Location: Costa Rica, Peru, Colombia, Bolivia
Mode: Remote
We at Coforge are hiring Senior Data Engineer (Earnix) (#006fu00000cVkwnAAC-1) with the following skill set.
Key Responsibilities
- Design, develop, and optimize production-grade data pipelines and governed data products using Azure Databricks, dbt, Python/PySpark, SQL, and Delta Lake.
- Build conformed Silver and Gold data models for rating factors, model inputs, quote versions, policy premiums, and other insurance pricing and rating data.
- Implement scalable Lakehouse engineering practices, including data quality, observability, monitoring, governance with Unity Catalog, and performance optimization.
- Collaborate with pricing, actuarial, underwriting, Data Science, BI, Architecture, and Quality Engineering teams while providing technical leadership through design reviews, code reviews, and mentoring.
Required Skills & Qualifications
- 7+ years of Data Engineering experience, including strong recent experience with enterprise Databricks platforms.
- Strong production experience with Azure Databricks, Spark, Delta Lake, Workflows/Jobs, Databricks SQL, and platform optimization.
- Advanced hands‑on experience with dbt models, macros, tests, documentation, incremental patterns, and CI/CD integration.
- Strong Python and PySpark skills for transformations, reusable frameworks, integrations, validation, and automated testing.
- Advanced SQL skills, including query optimization, data reconciliation, and analytical data modeling.
- Strong experience with enterprise ELT/ETL, batch pipelines, incremental processing, data quality, and production support.
- Practical experience with Unity Catalog or comparable data governance, lineage, and access‑control capabilities.
- Experience with CI/CD, Git, automated deployments, peer reviews, and environment promotion for data products.
- Strong Azure experience, including cloud storage, identity, security, and integration patterns.
- Proven ownership of production data pipelines from design through deployment, monitoring, and incident resolution.
Preferred Skills
- Experience with insurance pricing, policies, quotes, premiums, rating factors, underwriting, or actuarial data.
- Experience integrating with Earnix or another enterprise pricing/rating engine.
- Experience with Dataiku, MLflow, or governed machine‑learning workflows.