Big Data Engineer (hybrid or remote)

• About Us

   

  The world isn’t standing still, and neither is Allstate. We’re moving quickly, looking across our businesses and brands and taking bold steps to better serve customers’ evolving needs. That’s why now is an exciting time to join our team. You’ll have opportunities to take risks, challenge the status quo and shape the future for the greater good.

   

  You’ll do all this in an environment of excellence and the highest ethical standards – a place where values such as integrity, inclusive diversity and accountability are paramount. We empower every employee to lead, drive change and give back where they work and live. Our people are our greatest strength, and we work as one team in service of our customers and communities.

   

  Allstate operate a very flexible hybrid working policy that will allow you to design your working week in collaboration with your manager with a blend of remote and office working for NI based employees as well as condensed working patterns (4 day week/9 day fortnight). Employees based in GB will be employed on a permanent remote working contract.

   

  Join our team and you’ll find challenge and reward in a culture of innovation, support and balance. 

   

   

  Location

   

   

  Belfast/ Derry, Londonderry/Strabane/Remote GB

   

   

   

  Your role in the team

   

   

  Data is central to Allstate’s transformation of the customer experience. We are looking for passionate engineers to help build the next generation of data analytics and software solutions within the big data technology stack. We need a Data Lake developer who will work collaboratively on Scaled Agile teams, and who loves interacting with different areas to design and deliver the next generation analytics platforms and applications which will ultimately transform how our customers view Allstate.

   

  Within the Data Lake space we are passionate about empowering our developers and we work to the principal of ‘if you can do it, go do it”. So, if you believe in the power of Data to transform and would love to join a team at the beginning of this journey, then we would love you to bring your ideas and enthusiasm on this mission.

   

   

  • Develop & maintain data processes to collect, store & perform real time/batch processing to serve data to data scientists and alike.
  • Create automated scalable and high-volume data pipelines and platforms.
  • Manage & monitor data lake quality via automated testing frameworks (Data-Driven Testing, TDD, etc.)
  • Collaborate with Data source teams, Architects, Data Scientists, BI developers and Data Warehouse to continuously iterate on sustainable and scalable data lake patterns/solutions
  • Develop patterns and build data pipelines that ingest enterprise-wide data into the Enterprise Data Lake and make it available for consumption for both data analytics and data science

   

   

   

  So, what are the essential criteria to apply?

   

   

  • All candidates must evidence an existing right to work in the UK'
  • 4 years’ experience in data engineering e.g. (Scala, Spark) or
  • 4 years software development using java
  • Demonstrated experience with sound technical design and documentation;
  • Demonstrated expertise in Agile development and tools to iterate quickly on product changes, developing user stories and working through backlog;

   

   

   

  We also have some desirable criteria

   

   

  • 1 years’ experience developing scalable Enterprise Data Lake patterns.
  • About 2 years of experience in building data lake type solutions, developing data ingestion, data processing, analytical data pipelines for Data Scientists and alike.  
  • At least 1 year implementing large scale data projects within on-prem/cloud.
  • 2 years’ experience working with transactional/relational data & various data formats
  • Hyper focus on ensuring data quality & availability to Data Lake end users
  • Experience with Abintio, Lenses or Flink for use in ingestion is a huge plus.
  • Experience with Dremio or similar tools is a huge plus
  • Good understanding of common analytical platform architectural patterns (Star Schema, data integration patterns, data quality frameworks etc.)
  • Understanding Data lake design patterns and technology options (schema on read, metadata capture, data search framework etc.) is a huge plus

   

   

   

  What we offer

   

  As Digital DNA’s Workplace of the Year 2020 winners, we offer a generous benefits package that includes flexible annual leave entitlement, dental and healthcare insurance, an attractive pension package and discounts on gym memberships, public transport and parking.

   

  Allstate invests heavily in your development, as an employee you will have access to multiple world-class learning platforms and courses from our award-winning in-house Learning & Development team.

   

  We pride ourselves in providing clear career paths and opportunities for internal mobility allowing you to further develop within the organisation.

   

  We encourage a better work life balance and you’ll have the opportunity to apply for various flexible working arrangements.

   

  Apply here: https://bit.ly/3h5KCk0 
  

   

  Statement on Fair Employment and Equal Opportunities

   

  Allstate NI wishes to ensure equal opportunity is given to all job applicants.  This company will not discriminate on the grounds of race, gender (including gender reassignment status), sexual orientation, religious belief, political opinion, marital status, age or disability.

   

  We are an equal opportunities employer. We welcome applications from all suitably qualified persons. However, as women are currently under-represented in our workforce, we would particularly welcome applications from women. All appointments will be made on merit.

   

  Applicants should note Allstate NI complete AccessNI background checks on all candidates offered a position.

   

   

  The closing date for receipt of applications is Tuesday, 21st September