Principal Developer


Cambridge, GB

Category:  IT

Hadoop Principal Developer

Permanent, Full Time

Competitive Salary



What it’s about:

The Data Lab is a small team who run an onsite Hadoop system supported by Hortonworks.  The key role of the developer is to archive data from legacy systems, work with data science team, manage data within Hadoop and be capable of working closely with other technical teams.  


What you will be doing

  • Producing design and estimations, delivery of developments to budget in the given technology and when required producing detailed technical specification for third party resources and / or in-house custom development.
  • Assist the architectural solution through involvement with the solution architect / business users.
  • To ensure within a program or project the technical solution follows the high level design and architectural solution both within the given technology or across the technology portfolio. Report on progress of development or issues and risks for onward dissemination.
  • Research, present and test cutting edge technologies within CA policies and practices
  • Definition / ownership and adherence of the development standards / processes in the given technology
  • To mentor less experienced development resource within the given technology to support continuous learning and improvement.


What you’ll bring to the team:

The successful candidate will be proficient at:

  • Agile project life cycle
  • Data Modelling 
  • Hadoop developer experience using Java, python or scala
  • Data management in HDFS and Hive
  • Writing bash scripts
  • Using tools like oozie and sqoop


You will have extensive experience:

  • As a relational database senior developer for 2 years min
  • Illustrating a complete understanding of Data Lifecycle including design, development, testing and implementation complex data models 
  • Monitoring and troubleshooting data issues
  • Using ETL tools
  • In Analytics, Reporting, MDM, Data Governance


Technical Requirements Summary: 

The types of solutions you would be expected to collaborate on will require you to demonstrate an:

  • In-depth experience of data modelling – creating a schema from a logical or physical models
  • In-depth experience of project life cycles – ability to work within an agile team or to work to a Waterfall or PrinceII project plan
  • In-depth experience of data life cycles, data governance,  QA testing (using scripts) and good working practices - ability to demonstrate secure and good working practices relating to the ingestion, storing, testing and management of data
  • In-depth experience of Sqoop, Oozie, Bash Scripts, Spark, MapReduce, HDFS, Hive, Java, Scala, Python, R – the ability to use these tools to manage data within the Hadoop cluster and to transfer these skills to new tools CA adopts
  • In depth experience of cutting edge tools like NiFi, Kafka, Storm, Spark – demonstrate the ability to use and train other developers to use these tools effectively and to transfer these skills to new tools CA adopts
  • Knowledge of data management tools like Collibra – understanding of what how data management tools work
  • Knowledge of Cloud technologies – demonstrate an understanding of cloud technologies like AWS, AZURE, etc


About Cambridge Assessment

Cambridge Assessment is Europe's largest assessment group, incorporating three major awarding bodies. It plays a leading role in researching, developing and delivering assessment to eight million candidates in 170 countries every year. The Group is a department of the University of Cambridge and a not-for-profit organisation.

This is an excellent opportunity to join a market leader and be rewarded with valuable learning opportunities, a competitive salary and benefits.




In addition to a competitive salary, we offer a comprehensive package of benefits to help with your life both inside and outside of work:


  • Generous contributory pension
  • 28 days annual leave, plus bank holidays 
  • Annual performance related bonus and increases (discretionary) 
  • Enhanced maternity/paternity pay and childcare voucher scheme 
  • Childcare vouchers
  • Employee discount and cash back scheme at 2,500 retailers 
  • Cycle scheme 
  • Season Ticket Loan
  • Subsidised staff restaurants
  • Support for professional qualifications
  • Discounted access to the University of Cambridge Sport Centre, along with various other local gyms.

We know that diversity of thinking, backgrounds and approaches leads to innovation and creates an atmosphere where everyone’s contribution is valued. As well as wanting to create diverse teams, we also value diversity in the way our people approach their work. Work/life balance is important to us at Cambridge Assessment and we offer our colleagues a range of flexible working options according to the needs of the business and the individual, so please let us know of any flexible working requirements when applying and we can see how we can support you.

The closing date for receipt of applications is 23 September 2018 and interviews will be held in the following week.

If you’re successful at interview stage we will ask you to undergo background screening (carried out by Credence Background Screening Ltd), to ensure that all information provided to us is accurate. We wish you all the very best with your application.



Job Segment: Bank, Banking, Developer, Java, Database, Finance, Technology

Find similar jobs: