RQ09118 - DataOps/Cloud Data Engineer - Senior
Senior DataOps/Cloud Data Engineer designing, optimizing, and automating data pipelines, database migrations, and cloud-based data solutions for a government client, focusing on Azure, Oracle, and SQL Server environments.
- Compensation
- Not disclosed
- Location
- Toronto, ON, Canada
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Expert experience with Microsoft Azure technologies (pipeline, DACPAC, storage, Azure DevOps, Data Lake, monitoring tools)
- Expert data/database administration experience (Azure SQL, Synapse, Oracle, IMS, DB2)
- Extensive experience with SQL Server Stored Procedures and Oracle PL/SQL development and performance tuning
- Experience with data pipeline orchestration, CI/CD, and automation
- Experience with data replication pipelines (Azure SQL, Oracle, IMS/DB2)
- Experience with DataOps principles, Agile development, and performance monitoring
Full description
Description
Deliverables section:
Scope of Services and Deliverables - The Services and Deliverables to be provided by the Vendor will include the following:
· Participate in the review of project, work request and maintenance release artefacts - Use Case, System Requirement Specification, etc.
· Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.
· Design, develop and optimize data/database CI/CD pipelines.
· Design logical and physical data models using Sybase Power Designer.
· Prepare database change in DACPAC and develop Azure CI/CD release pipeline to promote DACPAC.
· Promote database changes through Development, Integration Testing, QA, UAT, Production environments.
· Provision data in cloud environment according to requirements.
· Design, develop data loading, data conversion, data migration program.
· Design, develop and implement data conversation of VLD (Very large Data) of Online analytical processing (OLAP) and online transaction processing (OLTP) environments to Cloud Software-as-a-service (SaaS), Platform-as-a-service (PaaS) and Infrastructure-as-a-service (IaaS) environments.
· Design, develop and implement fact/dimension model, data mapping, data warehouse, data lake and data lakehouse.
· Plan, configure, maintain, administrate, tune performance of Oracle, Microsoft Azure SQL database and Synapse database.
· Support cloud-based heterogeneous data replication solution.
· Develop complex Oracle PL/SQL program, SQL server stored procedure to fulfill project, work request, maintenance requirements.
· Optimize performance of PL/SQL program, SQL server stored procedure.
· Monitor and analyze incident, provide timely resolution.
· Perform reference data administration as required.
· Build and test database backup/recovery scripts.
· Build and test database automation scripts.
· Perform database administration, including patching/upgrade, monitoring, performance tuning, partitioning, capacity planning, OEM upgrade/enhancement, achieving, etc
· Document and resolve any database problems/issues.
· Provide effective knowledge transfer to Ministry staff at all stages of this assignment.
SkillsExperience and Skill Set Requirements
Evaluation Table