Circuit Compilers
Data Engineer - Python/PySpark
- Compensation
- Not disclosed
- Location
- Hyderabad
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 2+ years
- Category
- Data engineering
- Posted
Skills
Full description
Job Description :
- 2 - 5 years of diversified experience in design, development, analysis, testing and implementation of data pipelines using AWS services, Python, Apache Spark, Jupyter Notebook.
- Excellent understanding and hand on experience in AWS Architecture and services; DynamoDB, Lambda, EC2, S3, ELB, EMR, Redshift.
- Extensively worked on AWS Data pipelines using Python and also leveraged python libraries such as numPY and Pandas for data analytics.
- Hands on experience in using data warehousing technologies such as AWS Redshift, Oracle and Teradata.
- Experience working on API development.
- Hands-on experience in Data Visualization tools like Tableau, Power BI.
- Experience in RDBMS like MySQL ,programming languages like Pyspark
- Hands on experience with Python IDE's like Pycharm, Jupyter Notebook.
- Knowledge on GIT processes and UNIX machines.
- Performance Tuning of long running SQL queries and procedures and effectively reduced SLA breaches.
- Worked on scripting with python in spark for transforming the data from various - les like Text - les, CSV and JSON Demonstrated experience in effective decision making within a high-pressure environment.
- Excellent analytical and problem solving skills and ability to quickly learn new technologies
- Good communication and interpersonal skills, team player and can work independently.