ACENSI
Data Engineer Senior
Senior data engineer consulting for an ACENSI client in Brussels: building data pipelines and ETL within a data framework, writing specs and unit tests, shaping architecture, and monitoring production. Core stack is Python 3, PySpark, Databricks and AWS, with Airflow and Terraform preferred.
- Compensation
- Not disclosed
- Location
- Belgium
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Python V3
- PySpark
- Databricks
- AWS
- Solid understanding of relational databases (SQL) and data warehouses
- Sound experience in data engineering activities with high-level analytical skills, rigour and communication
Nice to have
- Airflow
- Azure DevOps (TFS or VSTS)
- Terraform
- Iomnia / Postman
- CI/CD
- C#
- Databricks platform experience: creating/executing ETL tasks, managing Spark clusters, optimizing SQL queries
- Knowledge of the energy market industry
- Knowledge of portfolio management, risk management or trading
- Knowledge of energy forecasting activities
- Agile methodology
- Ability to collaborate with multidisciplinary teams and communicate with stakeholders
Full description
About The Job
:
Activities
- Develop within the data framework
- Write technical specifications
- Write Unit Test
- Participating to architecture direction
- Provide and Put in place the best practise around data management
- Ensure deliveries and respect deadlines
- Production Monitoring / Maintenance
- The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.
- Expected technical skills
- Technical skills required: (by order of priority for the assignment)
- Python V3
- Pyspark
- Databricks
- AWS
- Airflow (preferred)
- Terraform (preferred)
- CI / CD (preferred)
- C# (preferred)
About The Job
ACENSI is looking a Senior Data Engineer for one of their clients based in Brussels :
Activities
The Main Activities Are
- Develop within the data framework
- Write technical specifications
- Write Unit Test
- Participating to architecture direction
- Provide and Put in place the best practise around data management
- Ensure deliveries and respect deadlines
- Production Monitoring / Maintenance
Expected skills
General skills (soft skills)
- The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.
- Expected technical skills
- Technical skills required: (by order of priority for the assignment)
- Python V3
- Pyspark
- Databricks
- AWS
- Airflow (preferred)
- Azure DevOps (TFS or VSTS) (preferred)
- Terraform (preferred)
- Iomnia / Postman (preferred)
- CI / CD (preferred)
- C# (preferred)