Palantir Data Engineer
A data engineer at Capgemini Invent in Bangalore who designs and maintains enterprise data pipelines and analytics platforms, centered on Palantir Foundry, with ETL work (Talend), SQL/NoSQL databases, and cloud data architectures on Azure, AWS, Snowflake, and Google Cloud.
- Compensation
- Not disclosed
- Location
- Not listed
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Experience in DevOps, Infrastructure as Code, DataOps, MLOps
- Experience in data warehousing, data modelling and data integration for enterprise data environments
- Experience with ETL tools, primarily Talend and/or other Data Integrator tools
- Extensive SQL experience incl. PL/SQL, query tuning and optimization on relational databases (PostgreSQL, Oracle, Microsoft SQL Server, MySQL)
- Experience with NoSQL databases such as MongoDB and/or document-based databases
- Experience in programming languages like Python, PySpark, JavaScript, Java/Scala
- Design, create and maintain optimal data pipeline architecture in Palantir Foundry
- Identify, design and implement internal process improvements in Foundry
- Palantir scheduling jobs for pipelines, monitoring data pipeline health, configuring health checks and alerts (data expectations)
- Working knowledge of Foundry tools: Ontology, Contour, Object-explorer, Ontology-Manager, Object-editor using Actions/Typescript, Code workbook, Code Repository, Foundry ML
- Design viable architectures based on Palantir, Microsoft Azure, AWS, Snowflake, Google (or similar) for Cloud Data Analytics, Data Engineering, Analytics and Reporting
- Work with business solution leaders to translate information requirements into data-centric solutions
- Responsible for designing data governance solutions
Full description
At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.
Your Role
- Experience in DevOps, Infrasturcure as a code, DataOps, MLOps. Data warehousing, data modelling and data integration for enterprise data environments.
- Experience with ETL tools primarily Talend and/or any other Data Integrator tools (Open source / proprietary), extensive experience with SQL and SQL scripting (PL/SQL & SQL query tuning and optimization) for relational databases such as PostgreSQL, Oracle, Microsoft SQL Server and MySQL etc., and on NoSQL like MongoDB and/or document-based databases. Experience in programming languages like Python, Pyspark, JavaScript, Java/ Scala etc.
- Provides data services for enterprise information strategy solutions - Works with business solutions leaders and teams to collect and translate information requirements into data to develop data-centric solutions.
- Design and develop modern enterprise data centric solutions (e.g. Palantir, DWH, Data Lake, Data Lakehouse) Responsible for designing of data governance solutions.
Your Profile
- Design, create and maintain an optimal data pipeline architecture in Foundry. Identify, design, and implement internal process improvements in Foundry
- Palantir scheduling jobs for pipeline, monitoring Data pipeline health and configuring health checks and alerts. (Data expectations).
- Good Understanding and working knowledge on Foundry Tools: Ontology, Contour, Object-explorer, Ontology-Manager, Object-editor using Actions/ Typescript, Code workbook, Code Repository, Foundry ML.
- Responsible for architecture topics and solution scenarios in the areas of Cloud Data Analytics Platform, Data Engineering, Analytics, Reporting and designing viable architectures based on Palantir, Microsoft Azure, AWS, Snowflake, Google (or similar) and implementing analytics.
What you will love about working here
- We recognize the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance.
- At the heart of our mission is your career growth. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.
- Equip yourself with valuable certifications in the latest technologies such as Generative AI.