Senior Data Engineer - Data and Platforms

August 13

Apply Now

Receive Emails with Similar Jobs

Houseful

WebsiteLinkedInAll Job Openings

We’ve recently renamed our wider business to ‘Houseful’, which is why the name might be new to you$1. .$1

501 - 1000

Description

• Lead and mentor junior data engineers by demonstrating excellent technical knowledge and fostering their growth within the organisation • Architect and build scalable ETL/ELT pipelines to process large volumes of data from various sources using AWS technologies. • Drive and develop the data warehousing solutions utilising Amazon Redshift, Databricks, or similar data warehousing/data lakehouse technologies, ensuring they align with business goals • Collaborate strategically with software engineers, data analysts and data scientists to ensure data availability and quality for model training and evaluation, promoting MLOps across the organisation • Identify and address performance bottlenecks in data pipelines and queries to ensure high efficiency and reliability. • Establishing and maintaining monitoring and alerting systems to proactively manage data infrastructure health and performance. • Maintain comprehensive documentation for data systems, processes, and workflows. • Champion and implement data engineering best practices, including data governance and data security.

Requirements

• Proficiency in Python, SQL (understanding of Spark and DBT is a bonus) • Strong experience with AWS services such as AWS Lambda, S3, AWS Redshift, AWS Glue (databricks knowledge is an additional plus) • Experience building out data warehouses and building data pipelines • Extensive knowledge on SQL, NoSQL databases • Terraform, or similar IaC (Infrastructure as Code) platform • Experience with Orchestration tools (e.g. AWS Step Functions, Airflow)

Benefits

• Everyday Flex - greater flexibility over where and when you work • 25 days annual leave + extra days for years of service • Day off for volunteering & Digital detox day • Festive Closure - business closed for period between Christmas and New Year • Cycle to work and electric car schemes • Free Calm App membership • Enhanced Parental leave • Fertility Treatment Financial Support • Group Income Protection and private medical insurance • Gym on-site in London • 7.5% pension contribution by the company • Discretionary annual bonus up to 10% of base salary • Talent referral bonus up to £5K