Senior Data Engineer

May 16

Apply Now

Receive Emails with Similar Jobs

Solirius Consulting

WebsiteLinkedInAll Job Openings

We are an independent software and technology consultancy who pride ourselves on our ability to deliver complex technology solutions for our clients$1. .$1

Solution architecture • Enterprise architecture • TOGAF • SOA • Independent advice

51 - 200

Description

• Design and build data models, schemas to support business requirements • Develop Data Engineering solutions for our clients/projects • Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. • Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. • Working collaboratively with the client and cross-functional teams to identify and address data-related issues and opportunities. • Stay updated with the latest trends and developments in the data engineering field, such as modern data stack, big data technologies, cloud computing, etc • Assist with defining the processes needed to achieve operational excellence • Ensure data quality across all projects/clients • Define and manage SLA’s for data sets and processes throughout production • Lead on the design, build and launch of new data models and pipelines

Requirements

• Experience in operating as part of data engineering teams and independently. • Line/Team management experience, leadership experience • Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial) • SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) • You have framework experience within either Flask, Tornado or Django, Docker • Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo • Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. • Data acquisition and development of data sets and improving data quality • Preparing data for predictive and prescriptive modelling • Hands on coding experience, such as Python • Reporting tools (e.g. Tableau, PowerBI, Qlik) • GDPR and Government Service Standard (desirable) • Passionate, motivated and enthusiastic about developing technology solutions. • Experience working in an Agile development environment • Data architecture experience.

Benefits

• Competitive salary, dependent on experience • Flexible working / Work from home • Private Healthcare • Generous annual discretionary bonus • 25 days annual leave + bank holidays • 10 days allocated development training per year • Contributory pension • Gym membership • Annual away days and social events