Aurora Engineering AB
Senior Data Engineer / IT Developer – Azure Databricks
Senior data engineer on assignment with a large Stockholm organization: designs dimensional/semantic data models and builds medallion-architecture ETL/ELT pipelines on Azure Databricks (Delta Lake, Unity Catalog) with Azure Data Factory, SQL, and Python/PySpark, plus data-quality testing, GDPR-compliant governance, CI/CD, and Power BI collaboration.
- Compensation
- Not disclosed
- Location
- Stockholms län, Sweden
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Senior-level professional experience in data engineering or data platform development
- Strong hands-on experience with Azure Databricks, Delta Lake, Lakeflow, and Unity Catalog
- Advanced proficiency in SQL, Python, and PySpark
- Experience developing and orchestrating large-scale pipelines using Azure Data Factory
- Strong knowledge of dimensional and semantic data modeling (star schemas, SCD, role-playing dimensions, calculation groups)
- Experience integrating and modeling data from Workday, Peakon, or equivalent HR, employee experience, or financial systems
- Experience implementing automated data-quality checks, testing, validation, and monitoring
- Knowledge of GDPR, data protection, access controls, and information governance
- Experience working with business stakeholders and translating requirements into scalable technical solutions
- Strong communication, analytical, and problem-solving skills
Full description
We are looking for an experienced Senior Data Engineer / IT Developer to join an exciting assignment with a large organization in Stockholm.
Key Responsibilities
Data Engineering & Data Modeling
- Design and develop dimensional and semantic data models, including star schemas, Slowly Changing Dimensions (SCD), and role-playing dimensions.
- Build and enhance Bronze, Silver, and Gold layers using Medallion Architecture.
- Develop reusable, scalable, and version-controlled datasets.
- Maintain clear data definitions, documentation, and end-to-end traceability.
Data Pipelines & Platform Development
- Design, develop, and optimize ETL/ELT pipelines using Azure Databricks, Azure Data Factory, SQL, and Python/PySpark.
- Work with Delta Lake, Lakeflow, and Unity Catalog.
- Implement incremental data processing and optimize pipeline performance and storage costs.
- Develop reliable data integration solutions across multiple enterprise systems.
Data Quality, Security & Governance
- Implement automated data testing, validation, profiling, and quality monitoring.
- Manage data access and governance using Unity Catalog.
- Apply row-level and column-level security controls.
- Ensure appropriate handling of personal and sensitive information in accordance with GDPR.
- Support data retention policies, documentation, and compliance requirements.
Collaboration & Continuous Improvement
- Translate business requirements into robust technical solutions.
- Collaborate with BI developers to optimize Power BI datasets and semantic models.
- Participate in Agile planning, backlog refinement, and technical discussions.
- Support CI/CD, release management, incident management, and platform improvements.
- Maintain technical documentation and contribute to engineering best practices.
Required Qualifications
- Senior-level professional experience in data engineering or data platform development.
- Strong hands-on experience with Azure Databricks, Delta Lake, Lakeflow, and Unity Catalog.
- Advanced proficiency in SQL, Python, and PySpark.
- Experience developing and orchestrating large-scale pipelines using Azure Data Factory.
- Strong knowledge of dimensional and semantic data modeling, including star schemas, SCD, role-playing dimensions, and calculation groups.