Data Engineer
Data Engineer at I-Net Software Solutions in Hounslow (hybrid) who designs, optimizes, and maintains large-scale data pipelines and warehouses on AWS, Spark, Hadoop, Hive, and Oracle/SQL Server, using Python, Java, and Bash to automate ETL and support analytics across the organization.
- Compensation
- £40K–£50K / yr
- Location
- Hounslow, United Kingdom
- Work setup
- Not specified
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Proven experience as a Data Engineer or similar role focused on big data environments
- Strong proficiency in Java and Python for building scalable data solutions
- Extensive knowledge of cloud platforms, particularly AWS services for storage, computing, and data processing
- Hands-on experience with SQL-based databases including Oracle and Microsoft SQL Server
- Solid understanding of database design principles
- Familiarity with big data frameworks like Hadoop, Spark, and Apache Hive
- Experience with ETL tools such as Informatica for data integration
- Demonstrated ability to analyze complex datasets to derive actionable insights
- Knowledge of scripting languages including Bash (Unix shell) for automation
- Strong understanding of Data Warehouse concepts and architecture
Nice to have
- Skills in VBA and Shell Scripting for automating data processing tasks
Full description
Job Description:
Reference: INET/DE/Oct26
Location: Hounslow
Salary: £40,000.00 to £50,000.00 (Based on experience)
Job Open date: 12th October 2026
Close date: 11th November 2026
Job Summary
We are seeking a dynamic and highly skilled Data Engineer to lead the development, optimization, and maintenance of our data infrastructure. In this role, you will harness your expertise in big data technologies, cloud platforms, and database design to build scalable data pipelines that empower data-driven decision-making across the organization. Your innovative approach and technical leadership will ensure our data environment is robust, efficient, and ready to support advanced analytics and business insights.
Responsibilities
- Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data.
- Collaborate with cross-functional teams to understand data requirements and translate them into efficient database architectures and workflows.
- Optimize existing data workflows for performance, scalability, and reliability within cloud environments like AWS.
- Maintain and enhance data warehouses built on platforms such as Oracle, Microsoft SQL Server, or similar systems to support analytical needs.
- Develop automated scripts using Python, Bash (Unix shell), Shell Scripting, or VBA to streamline data processing tasks.
- Ensure data quality, security, and compliance by implementing best practices in database design and management.
- Lead efforts in integrating diverse data sources through tools like Informatica and manage big data ecosystems involving Hadoop clusters.
- Conduct analysis of complex datasets to uncover insights that drive strategic business decisions.
Experience
- Proven experience as a Data Engineer or in a similar role with a focus on big data environments.
- Strong proficiency in programming languages such as Java and Python for building scalable data solutions.
- Extensive knowledge of cloud platforms, particularly AWS services related to storage, computing, and data processing.
- Hands-on experience with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles.
- Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components.
- Experience working with ETL tools such as Informatica for data integration tasks.
- Demonstrated ability to analyze complex datasets using advanced analysis skills to derive actionable insights.