Senior Data Engineer (Azure/Databricks)
Senior Data Engineer building and maintaining scalable Azure Databricks data pipelines, analytics, and BI solutions for global pharma and FMCG clients, with CI/CD via Azure DevOps/GitHub and end-to-end project delivery. Core stack: Azure (Databricks, Data Lake, Data Factory, SQL), SQL, Python. Hybrid Warsaw/remote setup.
- Compensation
- Not disclosed
- Location
- WorkplaceWarsaw/Remote
- Work setup
- Remote
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 4+ years
- Category
- Data engineering
- Posted
Skills
Must have
- 4+ years of experience in Azure and 6+ years of industrial experience in large-scale data management, visualization, and analytics
- Strong hands-on experience with Azure Databricks, including data engineering, data processing, and analytics workloads
- Hands-on knowledge of Azure data services such as Azure Data Lake, Azure SQL, Azure Data Factory
- Good knowledge of SQL and Python
- Proactive approach, goal-oriented mindset, and strong problem-solving skills
- Great communication skills for discussing technical issues with end users and clients
- Very good knowledge of English, able to explain and simplify technical topics for the business
- Willingness to show up at the Warsaw office as needed (customer visits, workshops, key project periods)
Nice to have
- Experience designing and implementing CI/CD pipelines for data and analytics solutions, preferably Azure DevOps, and data orchestration via Databricks Workflows
- Good understanding of DevOps practices, version control, automated testing, and deployment processes
Full description
C&F is a technology services company providing innovative solutions in Data Management,Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.
We are looking for an experienced Senior Data Engineer (Azure/Databricks), who will support our global customers mainly in the pharmaceutical and FMCG industry in building innovative big data products and services.
You will be responsible for:
- Designing, developing, and maintaining scalable data solutions in Azure Databricks for analytics and BI
- Managing the full data lifecycle, from acquisition and integration to analysis and visualization
- Building and maintaining CI/CD pipelines using Azure DevOps and/or GitHub, automating testing, deployment, and operations
- Delivering end-to-end data and analytics projects, from requirements and architecture to implementation and deployment
- Developing and optimizing data pipelines, visualizations, analytics products, automated services, and APIs
- Ingesting and integrating data from diverse sources into scalable, maintainable data platforms
- Ensuring performance, reliability, scalability, and data quality of data solutions
- Collaborating with multidisciplinary teams to turn data into models, insights, and production-ready solutions
- Identifying opportunities to leverage data and models to improve products and customer solutions
- Advising clients and stakeholders on data, Databricks, and solution architecture, identifying optimization opportunitiesWhat you will need:
- 4+ years of experience in Azure and 6+ years of industrial experience in large-scale data management, visualization, and analytics
- Strong hands-on experience with Azure Databricks, including data engineering, data processing, and analytics workloads
- Hands-on knowledge of other Azure data services and technologies, such as Azure Data Lake, Azure SQL, Azure Data Factory
- Good knowledge of SQL and Python
- Proactive approach, goal-oriented mindset, and strong problem-solving skills
- Great communication skills for discussing technical issues with end users and clients
- Very good knowledge of English, with the ability to communicate effectively and explain and simplify technical topics for the business