Data Engineer
- Compensation
- Not disclosed
- Location
- Nanakramguda, TG, India
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 5+ years
- Category
- Data engineering
- Posted
Skills
Must have
- Strong hands-on experience with Databricks and Apache Spark (PySpark/Scala/Java).
- Proficiency in SQL for data analysis and transformation.
- Experience in cloud platforms (Azure, AWS, or GCP), especially Azure Data Lake, AWS S3, or GCP Big Query.
- Hands-on experience with ETL tools, Data Pipelines, and Data Warehousing.
- Strong knowledge of CI/CD, Git, and DevOps tools for data workflows.
- Knowledge of Delta Lake, Lakehouse architecture, and performance tuning.
- Experience in handling large-scale datasets and distributed computing.
Full description
We are looking for passionate, driven professionals to join Texplorers Inc and help us build the future of data Solutions. If you thrive in a fast-paced environment and love solving complex problems, we want to hear from you!
Current Opportunity: Databricks Developer
Work Mode: Hybrid
Location: Nanakramguda Hyderabad
Experience Required:5- 7 Years
Key Skills:
Strong hands-on experience with Databricks and Apache Spark (PySpark/Scala/Java)
Proficiency in SQL for data analysis and transformation.
Experience in cloud platforms (Azure, AWS, or GCP), especially Azure Data Lake, AWS S3, or GCP Big Query.
Hands-on experience with ETL tools, Data Pipelines, and Data Warehousing.
Strong knowledge of CI/CD, Git, and DevOps tools for data workflows.
Knowledge of Delta Lake, Lakehouse architecture, and performance tuning.
Experience in handling large-scale datasets and distributed computing.
Key Responsibilities:
Design, develop, and optimize ETL pipelines in Databricks.
Build data ingestion, transformation, and processing workflows using Apache Spark.
Work with structured and unstructured data from various sources.
Optimize Spark jobs for performance, cost efficiency, and scalability.
Implement CI/CD for Databricks workflows and manage version control.
Work closely with Data Engineers, Data Scientists and Business Analysts to support analytics and reporting.
Implement security best practices and manage access controls in Databricks.
Troubleshoot performance and scalability issues in big data processing.
The Role:
We are looking for a skilled Databricks Developer to design, develop, and optimize big data solutions using Apache Spark and Databricks on cloud platforms like Azure, AWS, or GCP. The ideal candidate will have strong experience in data engineering, ETL pipelines, and performance optimization.
Required Qualifications:
Strong hands-on experience with Databricks and Apache Spark (PySpark/Scala/Java).
Proficiency in SQL for data analysis and transformation.
Experience in cloud platforms (Azure, AWS, or GCP), especially Azure Data Lake, AWS S3, or GCP Big Query.
Hands-on experience with ETL tools, Data Pipelines, and Data Warehousing.