Full Stack Data Engineer - Palantir Foundry

Overview :

As a Full-Stack Data Engineer & Application Developer, you will own the end-to-end lifecycle of data-driven solutionsfrom building robust data pipelines to developing intuitive applications and dashboards. This hybrid role combines deep technical expertise in data engineering with strong skills in application development and visualization, enabling you to deliver scalable, user-centric solutions on the Palantir Foundry platform.

Key Responsibilities : 1. Data Pipeline Architecture & Development :

• Design, build, and maintain efficient, reliable, and scalable data pipelines using Palantir Foundry.

• Implement best practices for data ingestion, transformation, and enrichment leveraging Python/PySpark.

• Optimize build schedules, computation profiles, and resource utilization for performance and cost efficiency.

• Apply programmatic health checks and ensure data lineage for transparency and durability.

2. Dataset Creation & Quality Assurance :

• Transform big data into high-quality, manageable datasets for analytics and applications.

• Conduct data profiling, validation, and health checks to ensure accuracy and completeness.

• Collaborate with data engineers and analysts to maintain compliance with internal governance (ITPM) and Sarbanes-Oxley requirements.

3. Application Development & UI Design :

• Rapidly build customized applications using Foundry Workshop and low-code tools.

• Configure Ontology objects, action types, and workflows to enable operational decision-making.

• Develop interactive dashboards and user-friendly interfaces using Contour, Quiver, and web technologies (HTML, CSS, JavaScript).

• Integrate APIs and Webhooks to enhance application functionality.

4. Data Analysis & Visualization :

• Explore and analyze datasets using Foundry tools to extract actionable insights.

• Create dynamic dashboards and visualizations to highlight trends and patterns for stakeholders.

• Translate technical data into clear, compelling narratives for business decision-making.

5. Collaboration & Continuous Improvement :

• Work closely with cross-functional teamsdata scientists, analysts, and business stakeholdersto deliver impactful solutions.

• Stay updated on emerging technologies and Foundry upgrades to enhance solution design.

• Document processes and maintain transparency across development and deployment phases.

Qualifications : Education : Bachelors or Masters degree in Computer Science, Engineering, Information Systems, or related field.

Technical Skills :

• Proficiency in Python/PySpark and libraries (Pandas, NumPy).

• Strong SQL skills for relational modeling.

• Familiarity with big data technologies (Spark, Hadoop, Kafka).

• Knowledge of web technologies (HTML, CSS, JavaScript); TypeScript/React preferred.

• Experience with APIs, Webhooks, and application integration.

Other Skills :

• Strong analytical and problem-solving abilities.

• Excellent communication and collaboration skills.

• Familiarity with compliance frameworks (ITPM, SOX)