Accessability Links

Senior Data Engineer

  • Location: London
  • Salary: £50000 - £75000 per annum + Benefits
  • Job type: Permanent
Sorry! This vacancy has now expired.


Job Description

Senior Data Engineer - Python/Scala, Azure- London- Up to £75,000

A new role has come to light for an experienced Data Engineer for a global professional services company based in the heart of London. The organisation has a huge client base and is currently undergoing rapid expansion plans. The Senior Data Engineer will play a critical role in the Data Analytics team, delivering important data objectives to the business.

The role will involve using a variety of Big Data and visualisation technologies to create solid propositions and to solve challenging business problems based on a robust, low latent platform of structured, semi-structured and unstructured data. The successful candidate will be working with a team of data scientists, business analysts & data engineers to implement the cloud based Big Data & Analytics strategy.

Responsibilities:

  • Leading the design, implementation, and continuous delivery of pipelines using distributed Azure based big data technologies
  • Developing with Scala, Python and Big Data Frameworks such as Spark, EMR, Kafka, Storm, Jenkins, Jfrog Artifactory and DataBricks
  • Providing administrative support on deployed Azure platform components
  • Identifying, evaluating and implementing cutting edge big data pipelines and frameworks
  • Designing the most appropriate end-to-end technology solutions
  • Processing and managing high volume real time customer interaction streams
  • Providing architectural support by building Proof of Concepts & Prototypes

Requirements:

  • Experience with Azure services
  • Experience with GCP services such as Cloud Storage, Cloud Spanner, BigQuery
  • Experience with Apache Spark and NoSQL
  • Extensive working knowledge in different programming or scripting languages such as Scala, Java, Linux, Shell, SQL, Python.
  • Experience working with structured, semi-structured and unstructured data sets
  • Knowledge on Visualisation and Data Science Tools.
  • Expert level usage with Jenkins, GitHub is preferred

The Company

This is a great opportunity to add real value to an established organisation and will offer the applicant an excellent benefits package and a supportive work environment.

Apply Now!

If you are looking to join an organisation that has a fantastic approach to work in a supportive and forward thinking environment then look no further - this is the role for you!

Interviews for this role will be held imminently. To be considered, please send your CV to me now to avoid disappointment.

Senior Data Engineer - Python/Scala, Azure- London- Up to £75,000

Oscar Technology Limited is acting as an Employment Agency in relation to this vacancy.

To understand more about what we do with your data please review our privacy policy at https://www.oscar-tech.com/our-privacy-policy.

  • similar jobs

    PERMANENT
    .Net AngularJS Dev - 35k - Doncaster - flexi-scheme! Doncaster, South Yorkshire £28000 - £38000 per annum
    .Net Dev - Barnsley- £35k - MVC, - Flexitime, No Suits Barnsley, South Yorkshire £30000 - £35000 per annum
    .Net Developer Henley-In-Arden, West Midlands Up to £40000 per annum
    .NET Developer Norwich, Norfolk Up to £35000 per annum + Competitive Benefits
    .Net Developer - C#, ASP.NET, AngularJS Kenilworth, Warwickshire Up to £45000 per annum
    CONTRACT
    1st Line Support Manchester, Greater Manchester £90 - £130 per day
    1st Line Support Liverpool, Merseyside £90 - £130 per day
    2nd Line Support Engineer Cambridge, Cambridgeshire £160 - £180 per annum
    Agile Coach Leeds, West Yorkshire Up to £400 per day
    Automation Development Lead Dorset £350 - £450 per day