Senior Data Engineer
Senior Data Engineer at LiveScore Group (LiveScore, LiveScore Bet, Virgin Bet) in Soho, London on a hybrid basis (3 office days Tue-Thu). Leads design of scalable GCP data pipelines (BigQuery, Dataflow, Pub/Sub), data modeling, Terraform-based infrastructure, and real-time AI/ML workloads, while mentoring engineers and supporting sports media and betting products.
- Compensation
- Not disclosed
- Location
- London, United Kingdom
- Work setup
- Hybrid
- Seniority
- Senior
- Employment
- Not specified
- Experience
- Not specified
- Category
- Data engineering
- Posted
Skills
Must have
- Significant experience in data engineering or data warehousing with large-scale, complex datasets
- Advanced SQL and Python skills, with experience using AI-assisted development tools appropriately
- Strong knowledge of data-modelling techniques
- Deep experience with cloud data services and technologies, ideally within the GCP ecosystem (Dataflow, Pub/Sub, BigQuery, Vertex AI)
- Proven experience designing and implementing robust ELT pipelines, including real-time and large-scale batch processing
- Proven ability to deploy and maintain data infrastructure using Infrastructure as Code principles and tools such as Terraform
- Experience with Airflow environment management and Docker
- Experience contributing to an AI roadmap and evaluating AI tooling, including coding agents, for the development lifecycle
- Ability to explain complex technical concepts clearly and concisely to technical and non-technical stakeholders
- Demonstrable experience applying data-governance, privacy and security best practices in a regulated environment
- Proactive and curious approach, with the ability to anticipate and resolve system inefficiencies
- Ability to lead cross-functional technical work and translate complex or ambiguous requirements into robust data solutions
- Track record of end-to-end ownership for quality, reliability and performance of business-critical data solutions
- Experience mentoring engineers and influencing technical standards across a team
Full description
Soho, LondonHybrid working: 3 days in the office Tues - Thurs
The Role
We are seeking a Senior Data Engineer to join our Data Team, taking a leading role in building the complex, scalable systems that power our data strategy. You will lead architectural discussions, own the design of business-critical data solutions and deliver high-quality systems that bring millions of fans closer to the sports they love. This is a fantastic opportunity to lead the optimisation of our data platforms for real-time AI/ML workloads, mentor engineers and make a significant impact on our business. The Senior Data Engineer leads technical initiatives, maintains data integrity and performance, and works across teams to translate complex business requirements into effective data solutions. The role also uses automation and artificial intelligence to improve efficiency, decision-making and productivity across the organisation.
At LiveScore Group, we're the proud home of three of the most exciting brands in the sports and gaming world: LiveScore, LiveScore Bet and Virgin Bet. A fully owned and operated ecosystem that converges the two worlds of sports media and sports betting. We're proud of the high ratings for our commitment to excellence and fueling fan's passion for sport driving us to the top.
We don't just lead; we innovate. Our cutting-edge products and immersive experiences set the standard, but it's our people who truly make the difference. Every day, our team embody our values: adaptability, teamwork, a fan-driven approach, and an ever-curious mindset that fuels our ambition. As we scale and continue to create a culture that allows all employees to thrive, we know we need the most talented people with diverse backgrounds, perspectives and skills. If you're good at what you do, come and join us. The more inclusive we are, the more amazing experiences we can create for our users.
We know that job descriptions can sometimes seem daunting, and you might not feel you tick every box. But, if you're passionate about the role and have relevant experience, we want to hear from you!
Key Responsibilities
- Lead the design and delivery of robust data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub and Cloud Storage. This includes integrating data from various sources, ensuring data quality and enabling real-time processing capabilities.
- Own the design of data models and databases that support business analytics and intelligence, using dimensional data-modelling principles. Select and use GCP database technologies such as Bigtable, Spanner or Firestore to optimise performance and scalability.
- Lead the automation of data workflows and optimisation of data storage and processing costs within GCP. Use tools such as Cloud Composer for orchestration and establish best practices in performance tuning.
- Ensure data security by implementing GCP security practices. Manage access controls, comply with data-governance policies and safeguard sensitive information.