Job Title: (Senior) Data Engineer
Location: London
Salary: Competitive
Job Type: Permanent, Full Time
We’re hiring a data engineer to join a fast growing team building the world’s First Integrated Safety, Security & Mobility Operating System. The team has been supporting organisations around the world to Prepare, Digitise & Respond to emergencies effectively.
The role:
This is a key role that will be accountable for the development and operations of a Data Platform to drive maximum value from data for business users and in line with company best practices.
You will work as part of a cross-functional agile delivery team, including front and back end engineers, data scientist, product managers and infrastructure.
You will have the opportunity to work on complex problems, implementing high performance solutions that will run on top of our cloud based big data platform.
Key Responsibilities and Accountabilities:
- Work as part of the Data Engineering team to uphold and evolve common standards and best practices, collaborate to ensure that our data solutions are complementary and not duplicative.
- Build and maintain high-performance, fault-tolerant, secure, and scalable data platform to support multiple data solutions use cases.
- Interface with other technology teams to design and implement robust products, services and capabilities for the data platform making use of infrastructure as code and automation.
- Build and support platforms to enable our data engineers and data scientists to build our cloud based big data platform.
- Create patterns, common ways of working, and standardised guidelines to ensure consistency across the organisation.
- Help to engineer our platform ingestion, data warehouse/data Lake and API strategies for our data management ecosystem.
- Work with data scientists to ensure scalability, resilience and operational efficiency of ML Models in production.
The Candidate:
- Strong experience on Cloud architecture/administration in production environments.
- Experience with object oriented and functional design, coding, and testing patterns as well as experience in engineering software platforms and large-scale data infrastructures.
- Experience writing production quality code in Java/Python/Bash/Powershell/Go, etc
- Experience of building and maintaining distributed platforms to handle high volume of data.
- Strong platform-level design, architecture, implementation and troubleshooting skills.
- Good understanding of Enterprise patterns and best practices applied to data engineering and data science use cases at scale.
- Good understanding of cloud storage and orchestration, and computing platforms (especially document/blob stores, Kafka, Airflow, Elastic, Spark ).
- Good understanding of DevOps/DataOps in an Agile Environment, familiarity with Jira and Confluence.
- Experience of Docker/Kubernetes would be beneficial.
- Expertise in Databases (Postgres, MySQL, etc)
- Solid experience of network and security on cloud-based environments, specifically on cloud services such as VPCs, Security Groups, NACLs and IAM roles.
- Deep understanding of CI/CD using tools like Jenkins/CircleCI/Azure Data Pipelines, along with deep experience in source control like Git.
Competencies
- Great problem-solving skills, and the ability and confidence to hack their way out of tight corners.
- Ability to prioritise and meet deadlines.
- Conscientious, self-motivated, and goal orientated.
- Excellent attention to detail and solid written and verbal English communication skills
- Willingness and an enthusiastic attitude to work within existing processes / methodologies
Please note:
Please click the APPLY button and to submit your CV and Cover Letter.
Candidates with experience or relevant job titles of; IT Programmer, Developer, Programmer, Software Programming, Software Development, IT Developer, IT Software Engineer, Software Development Engineer, Software Developer, Software Engineer, Java Engineer, Application Support Officer, Application Support, Sharepoint, Web Analyst, IT Application Support, IT Data Analyst, Data Support Analyst, ICT Data Analyst, SQL Server, .NET, XML, Java, Data Analyst, SQL Analyst, SQL Developer, Oracle 12c, Agile, Java, Python, JavaScript, C++, C#, PHP, Perl may also be considered for this role.