Builds and maintains Snowflake-based data pipelines and models, using dbt, Kafka, and Python to deliver scalable, high-quality datasets for analytics and AI initiatives in a travel-focused loyalty/engagement platform.
Compensation
Not disclosed
Location
Mumbai
Work setup
Hybrid
Seniority
Senior
Employment
Not specified
Experience
25+ years
Category
Data engineering
Posted
Skills
agile
ai
airflow
analytics
api
aws
ci-cd
containerization
data-engineering
data-governance
data-mesh
data-modeling
data-pipelines
data-quality
data-vault
data-warehousing
databricks
dbt
dimensional-modeling
docker
elt
etl
event-driven-architecture
express
gdpr
generative-ai
git
infrastructure-as-code
kafka
kanban
kubernetes
lakehouse
llm
machine-learning
observability
pyspark
python
scrum
snowflake
sql
stakeholder-management
terraform
vault
vector-databases
Nice to have
Confluent Kafka Platform
Airflow
Databricks
PySpark
Data Mesh concepts
Data Products and Product Operating Model
Data Governance and Lineage tools
Monitoring and Observability platforms
Kubernetes fundamentals
Generative AI fundamentals
LLM integration patterns
RAG architectures
Vector databases
AI Agent frameworks
Machine Learning platform awareness
Real-time analytics architectures
Full description
Recruiter for this role:
Britney DiasKey Responsibilities
Develop and maintain Snowflake-based data products and data models.
Build and manage ELT pipelines using dbt and modern data engineering practices.
Implement automated data quality checks, monitoring and observability across data pipelines.
Deliver reliable, secure and well-governed datasets for analytics and operational use cases.
Collaborate with Product Managers, Analysts and Business Stakeholders to understand data requirements and deliver fit-for-purpose solutions.
Design solutions with scalability, maintainability, performance and cost optimisation in mind.
Support real-time and near-real-time data integration patterns using Kafka and event-driven architectures.
Develop reusable frameworks, standards and engineering best practices across the data platform.
Implement CI/CD pipelines and automated deployment processes.
Troubleshoot and resolve data quality, performance and reliability issues.
Contribute to platform modernisation and continuous improvement initiatives.
Work closely with Data Governance teams to ensure compliance with GDPR, security and data management standards.
Participate in code reviews and promote engineering excellence across the team.
Mentor junior engineers and contribute to knowledge sharing across the Data & Analytics community.
Evaluate emerging technologies and recommend improvements to the platform and engineering practices.
Support AI and advanced analytics initiatives through the delivery of trusted, high-quality data assets
Knowledge, skills and experience requiredMandatory Technical SkillsData Engineering
Advanced SQL
Python
Data Modelling (Dimensional Modelling, Kimball, Data Vault fundamentals)
ELT/ETL design and development
Data Warehousing concepts
Data Lakehouse concepts
Data Quality Engineering
Snowflake
dbt
Git
CI/CD pipelines
Data Observability and Monitoring
AWS fundamentals
Infrastructure as Code (Terraform)
APIs and data integrations
Containerisation fundamentals (Docker)
Kafka fundamentals
Event-Driven Architecture concepts
CDC (Change Data Capture) concepts
Agile delivery (Scrum/Kanban)
Test-driven engineering principles
Code review practices
Performance optimisation
Cost optimisation
Preferred Skills
Confluent Kafka Platform
Airflow
Databricks
PySpark
Data Mesh concepts
Data Products and Product Operating Model
Data Governance and Lineage tools
Monitoring and Observability platforms
Kubernetes fundamentals
Nice to Have
Generative AI fundamentals
LLM integration patterns
RAG architectures
Vector databases
AI Agent frameworks
Machine Learning platform awareness
Real-time analytics architectures
Person Specification
Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape
Strong problem-solving and analytical skills.
Passion for building scalable and maintainable data solutions.
Self-motivated with a continuous learning mindset.
Strong stakeholder management and communication skills.
Ability to communicate technical concepts to non-technical audiences.
Collaborative team player who thrives in agile environments.
Quality-focused with strong attention to detail.
Ability to balance business priorities with technical excellence.
Proactive in identifying opportunities for improvement and innovation.
Comfortable working across global teams and multiple business domains.
About us: Our story
Collinson Group is a global leader in driving loyalty and engagement for many of the world’s largest companies. Predominantly through the provision of travel related benefits within a market leading digital travel ecosystem. The group offers a unique blend of industry and sector specialists who together provide market-leading experience in delivering products and services across four core capabilities: Loyalty, Lifestyle Benefits and Insurance.
The group provides unrivalled insight and expertise around affluent consumers and frequent travellers, creating and delivering products and services now accessible to over 400m end consumers.
We have more than 25 years’ experience, with 28 global locations, servicing over 800 clients in 170 countries, employing 1,800 people.
We have been bringing innovation to the market since inception – from launching the first independent global VIP lounge access Programme, Priority Pass to being the first to sell direct travel insurance in the UK through Columbus Direct and creating the first loyalty agency of its kind in the travel sector with ICLP. Today we still invest heavily in innovation to ensure that we continue to deliver superior customer experiences.
Key clients include: Visa, Mastercard, American Express, Cathay Pacific, British Airways, LATAM, Flying Blue, Accor, EasyJet, HSBC, Chase, HDFC.
Our mission is focused on doing good beyond profit, which for us means we seek out opportunities for our people to share in our success and that we give back to the communities and people within which we work.
Never short of ambition, the success of our business is delivered through the diverse and talented team of over 1,800 colleagues globally.
Equal Opportunities: Our commitment to inclusion
Collinson is an equal opportunity employer and welcomes differences in all their forms including: colour, race, ethnicity, gender identity, sexual orientation, neurodivergence, family status, age, individuals with disabilities and people from all backgrounds, cultures and experiences as we strongly believe this contributes to our on-going success.
We are focused on continually evolving our purpose driven, high performing culture, providing an environment where our people have the opportunity to achieve their full potential and do interesting and meaningful work. Our company values are: Act smarter, Do the right thing, One team and Be insight led. These help guide everything we do internally in terms of how we think, act and interact, right through to how we deliver value to our customers and clients.
If you need any extra support throughout the interview process, then please email us at recruitment@collinson.com
Reward & Benefits: What's in it for me?
You can look forward to a competitive salary and benefit plan including but not limited to: