Data Engineer - Python/SQL

Experience: 5+ Yrs

Location: Bangalore

Work Mode: Remote

Key Responsibilities :

• Design, build, and maintain scalable data pipelines for structured and unstructured financial datasets.

• Work with real-time and batch data processing systems for investment research workflows.

• Develop ETL/ELT pipelines using modern cloud-native technologies.

• Integrate market, financial, and alternative data sources into centralized data platforms.

• Optimize data architecture for performance, reliability, and scalability.

• Collaborate with AI/ML teams to support agentic workflows and intelligent automation.

• Build and maintain data models for analytics, reporting, and research use cases.

• Ensure data quality, governance, security, and compliance standards are maintained.

• Support scaling of platform components from MVP/v0.1 to stable production-ready systems.

• Participate in architecture discussions and contribute to system design decisions.

Required Skills:

5+ years of experience in Data Engineering.

• Strong experience with Python, SQL, and data processing frameworks.

• Hands-on experience with cloud platforms such as Microsoft Azure, AWS, or GCP.

• Expertise in ETL/ELT pipeline development.

• Experience with Databricks, Spark, Kafka, or similar distributed data technologies.

• Strong understanding of data warehousing and lakehouse architectures.

• Experience working with APIs, streaming data, and large-scale datasets.

• Knowledge of CI/CD and DevOps practices for data platforms.

• Understanding of data governance and security best practices.