Senior Data Engineer (AI & LLM Solutions)
Senior data engineer at a Canadian IT consulting firm, fully remote, designing enterprise data platforms on Microsoft Fabric and Azure (Databricks, Synapse, Data Factory) that power analytics and AI/LLM solutions such as RAG, vector search, and Azure OpenAI. Day to day: building ETL/ELT pipelines, lakehouse/medallion architecture, data governance, and mentoring other engineers.
- Compensation
- Not disclosed
- Location
- Pakistan
- Work setup
- Remote
- Seniority
- Senior
- Employment
- Full time
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's degree in Computer Science, Software Engineering, IT, Data Science, or related field
- 8+ years professional experience in Data Engineering, Data Platforms, or Cloud Data Solutions
- 5+ years hands-on experience with Microsoft Azure Data Services
- Proven experience delivering enterprise-scale data, analytics, and AI solutions
- Experience working within consulting, professional services, or enterprise environments
- Strong communication, stakeholder management, and problem-solving skills
- Microsoft Fabric
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Data Lake Storage Gen2 (ADLS)
- Azure Databricks
- Azure Event Hubs
- Data Warehouse, Lakehouse, and Medallion Architecture
- Python and SQL
- PySpark and Spark SQL
- Kusto Query Language (KQL)
- REST API integrations and ETL/ELT development
- SQL Server, PostgreSQL, MySQL, and NoSQL databases
- Azure OpenAI, Generative AI, and Prompt Engineering
- Retrieval-Augmented Generation (RAG) and vector databases/vector search
- Machine Learning pipelines and NLP fundamentals
- Power BI, Tableau, and semantic models
- Microsoft Purview, data lineage, classification, cataloging, and access control
- SOC 2, NIST, and CMMC awareness
- Azure DevOps, Git, and CI/CD pipelines
Nice to have
- Microsoft certifications: Fabric Analytics Engineer, Azure Data Engineer, Azure Data Scientist, Azure Solutions Architect
- Databricks Certified Data Engineer
- Relevant AI, Machine Learning, or Generative AI certifications
Full description
Senior Data Engineer (AI & LLM Solutions)
Location: Remote(Pakistan, Mexico, India, Morocco)
Department: Digital Solutions / Data Engineering & AI
Reports To: Technical Lead / Director
Job Type: Full-time
About AIM
Architecture in Motion Inc. (AIM) is a Canadian technology consulting firm that supports organizations across public and private sectors with software engineering, cloud platforms, API integration, data engineering, and enterprise technology solutions.
We specialize in delivering scalable, secure, and modern digital solutions leveraging Microsoft technologies, helping our clients drive operational efficiency, data modernization, and digital transformation.
Role Overview
AIM is seeking a Senior Data Engineer (AI & LLM Solutions) to design, develop, and optimize modern data platforms that support analytics, artificial intelligence, machine learning, and Generative AI solutions.
This is a hands-on senior role requiring strong expertise in Microsoft Fabric, Azure Data Services, Azure Databricks, Python, PySpark, and enterprise data architecture, along with practical experience supporting AI and LLM initiatives.
The ideal candidate will build scalable and secure data solutions while enabling advanced AI capabilities, including Retrieval-Augmented Generation (RAG), vector search, Azure OpenAI, Copilot, and enterprise LLM solutions.
The successful candidate will work closely with Solution Architects, AI Engineers, Cloud Engineers, Data Scientists, and client stakeholders to deliver secure, scalable, and business-driven data platforms.
Key Responsibilities
Modern Data Platform Development
- Design and develop enterprise-scale data solutions using Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks.
- Build and optimize scalable ETL/ELT pipelines for structured, semi-structured, and unstructured data.
- Develop modern Lakehouse, Data Warehouse, and Medallion Architecture solutions.
- Design and implement batch and real-time data processing frameworks.
- Lead data modernization, migration, and integration initiatives from legacy platforms.
AI, LLM & Data Enablement
- Develop data foundations that support AI, Machine Learning, and Generative AI solutions.
- Prepare, transform, and optimize datasets for AI applications, model training, and fine-tuning.
- Design and implement Retrieval-Augmented Generation (RAG) architectures and vector search solutions.