Ref: 288012021pr_1611864693

Data/Platform Engineer - Hadoop

England, London

Job description

Data/Platform Engineer - Hadoop


Job Title: Data/Platform Engineer - Hadoop

Contract Length: 3 Months

Rate: Negotiable

Start Date: ASAP

**Fully Remote**

Job Description

3 + years of design experience for installation of components within HDP or Cloudera and to include design

* Experience of performance tuning and performance testing HDP Clusters and connected systems.
AND/OR at least 1 project delivered where design of Airflow with solid HA DR were important and
demonstrable components

3 + years of performance testing experience with the following tools:
* · SparkBench, HiveBench, TeraGen/TeraSort/TeraValidate, · TestDFSIO,

3+ years of performance monitoring experience with:
* · Grafana, HDFS, YARN, Ambari, Linux OS,

3+ years performance tuning experience:
* Yarn and Yarn resource allocation architecture · Factors affecting resource utilization of Hadoop clusters ·
Spark Job tuning/parameters · HIVE LLAP Queue capacity

5+ years working knowledge of :
* Hadoop · Spark and SparkSQL · HIVE and HIVE SQL

* Desirable skills: Spark MLib, GraphX or StreamingAwareness and experience with widely successful
Agile techniques: ATDD, TDD, Continuous Integration, Continuous Testing, Pairing, Automated Testing,
Agile Games, Story mapping,

* English Proficient User C2 - Similar to Cambridge English Proficiency (CPE), BULATS score 90-100,
CLB/CELPIP 10-12, CAEL 80-90, IELTS exam 8-9.

Please send your CV to or call direct on 0203 879 8405