Senior Data Engineer
Senior Data Engineer on Berkadia's Data Pipeline team, designing and building AWS-based data pipelines and ETL/ELT flows that power its commercial real estate platform. Daily work spans Python/PySpark, Scala, SQL, Spark, Airflow and data warehousing, plus mentoring juniors and code reviews. Role is Bangalore-based, hybrid, split shift 3pm–12am.
- Compensation
- Not disclosed
- Location
- Negros Occidental, Philippines
- Work setup
- Hybrid
- Seniority
- Senior
- Employment
- Full time
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Bachelor's degree in IT, Computer Science, Data Engineering, Information Systems or related field (or equivalent practical experience)
- 7+ years of professional experience in data engineering or closely related field
- 5-7 years of hands-on data engineering with end-to-end ownership of optimized ingestion & transformation data flows
- Experience building and maintaining ETL/ELT pipelines using PostgreSQL, Docker, Apache Airflow, AWS Step Functions or similar
- 5+ years building high-performance algorithms in scalable languages such as Scala, Python and R
- Strong expertise in SQL (complex queries, performance tuning, analytical functions) and Python (PySpark)
- 5+ years of experience with cloud computing in AWS (EMR, Airflow, Spark, S3, etc.)
- Experience with modern data warehousing and/or lakehouse architecture
- Well versed with CI/CD, Git, and agile development practices
- Experience mentoring junior engineers and performing code reviews
- Ability to understand complex requirements, provide concise updates and maintain project timelines
- Strong logical, analytical, problem solving and reporting skills
- Experience managing large scale products with a passion for quality/efficiency and enforcement of best practices
Nice to have
- Post Graduate degree focused in Computer Science, Machine Learning, Data Engineering or Data Science
Full description
The Opportunity Berkadia Services India Pvt Ltd
Integrity is Everything
We Take the Long View
We believe People Matter
We Stand for Excellence
We Love our Jobs
We Innovate
Job title: Senior Data Engineer
Department: Innovation Technology
Location: Bangalore
Full Time – Hybrid work model (subject to Berkadia policy changes)
Working Hours: Split Shift (3:00pm to 12:00am)
The Opportunity
As a member of the Data Pipeline team you’ll be at the center of building our platform that enables us to redefine the Commercial Real Estate industry. We’re building a data pipeline that merges with the tested design of data warehousing and the latest big data technologies. You will be designing and building data projects while securing core data elements. In this role, individual will be required to work on one or multiple aspects of Innovation verticals with the following key responsibilities :
- Research new technology and share knowledge with team and peers
- Design, implement and release data applications in AWS using big data technologies
- Coordinate development efforts across the organization
- Influence team in development standards and processes
- Teach and mentor peers
- Other duties as assigned
Your Qualification
Education
Bachelor’s degree in information technology, Computer Science, Data Engineering, Information Systems, or a closely related technology field; or equivalent practical experience. Preferably Post Graduate degree with a focus in Computer Science, Machine Learning, Data Engineering or Data Science.
Qualifications
Qualifications to perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the experience required:
- 7+ years of professional experience in data engineering or a closely related field.
- 5 - 7 years of hands‑on data engineering with end‑to‑end ownership of optimized ingestion & transformation data flows.
- Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar.
- 5+ years of experience building high-performance algorithms in scalable languages such as Scala, Python and R.
- Strong expertise in SQL (complex queries, performance tuning, analytical functions) & Python (PySpark).
- Proven ability to understand complex requirements, provide concise updates and maintain project timelines.