Sr. Software Engineer - AWS Databricks GenAI Job
Senior data/software engineer at YASH Technologies (IT services integrator) in Pune, building scalable data pipelines and Lakehouse architectures on AWS and Databricks (Delta Lake, Unity Catalog, PySpark) and delivering GenAI solutions such as RAG chatbots and AI agents using Bedrock, SageMaker, and LLM tooling.
- Compensation
- Not disclosed
- Location
- Not listed
- Work setup
- Not specified
- Seniority
- Senior
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Ai engineering
- Posted
Skills
Must have
- 5+ years of experience
- AWS Data Analytics: S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB
- Databricks: Delta Lake, Iceberg, Unity Catalog, Delta Live Tables (DLT), MLflow, Mosaic AI, Vector Search, Genie Agent, Genie One
- Programming: Python, PySpark, SQL
- Data Engineering: ETL/ELT, Data Modeling, Data Warehousing, Lakehouse Architecture, Medallion Architecture
- Data Governance: Data Quality, Data Lineage, Metadata Management, Data Cataloging, Data Observability, Data Security
- AI & GenAI: AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, LLM Orchestration
- Design and deploy GenAI solutions including RAG-based chatbots and AI agents
- Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions
Full description
YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.
At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.
We are looking forward to hire Databricks Professionals in the following areas :Data Engineer (AWS, Databricks & GenAI)Key Roles & Responsibilities
- Design, develop, and optimize scalable data pipelines using AWS and Databricks.
- Build and manage modern Lakehouse architectures leveraging Delta Lake, Iceberg and Unity Catalog.
- Implement data governance capabilities including data quality, data lineage, metadata management, and data security.
- Develop ETL/ELT solutions using Python, PySpark, and SQL.
- Design and deploy GenAI solutions, including RAG-based chatbots and AI agents.
- Implement Context Engineering and semantic search frameworks to improve AI outcomes.
- Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions.
- Ensure platform scalability, performance, reliability, and cost optimization.
Key Skills
- AWS Data Analytics: S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB
- Databricks: Delta Lake, Iceberg, Unity Catalog, Delta Live Tables (DLT), MLflow, Mosaic AI, Vector Search, Genie Agent, Genie One
- Programming: Python, PySpark, SQL
- Data Engineering: ETL/ELT, Data Modeling, Data Warehousing, Lakehouse Architecture, Medallion Architecture
- Data Governance: Data Quality, Data Lineage, Metadata Management, Data Cataloging, Data Observability, Data Security
- AI & GenAI: AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, LLM Orchestration
Experience: 5+ Years
At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.