CA-Global-BannerConcept8.png

Let's find out where you can grow your career

Data Engineer (IT / Coding / Automation) Cape Town, South Africa

Job Reference

CDTLKDE

Region

Southern Africa

Date Posted

April 20, 2022

Reference Number: CDTLKDE

 

Job Description:

Our client is currently looking for a Data Engineer to join the team to help build a world class data platform which enables the team to access to the data they need to guide their decisions and actions every day. The successful candidate will be helping solve data challenges across a range of systems, from real-time event streams powering their CRM and other data integrations to traditional batch workloads underpinning our warehouse and machine learning models.

 

Responsibilities:

Over the last couple of years, they managed to build a complex, end to end data platform that powers many use cases across the company. As the company continues to grow, they’re looking to make it more robust, scalable and efficient, to make sure it scales with the business. To help make this happen, you will be responsible for:

  • Automating the ingestion of data from internal and external sources into our data warehouse (Amazon Redshift)
  • Data cleansing and preparation using Airflow and Spark (either in Scala or Python)
  • Building and maintaining daily ETL jobs
  • Creating structured tables in the data warehouse to make the data clear, understandable and accessible to analysts and team members
  • Writing scripts to automate the ingestion of daily reports into the data warehouse

 

Requirements:

  • Proficiency with Python, Java or Scala
  • Experience of data orchestration using tools such as Airflow or similar
  • ETL experience using Spark, with Scala or Python, and experience of EMR
  • Knowledge of the end to end data pipeline, with a focus on data cleaning, structuring and transformation
  • Understanding of AWS data stack preferred (S3, MSK, EMR, Glue, Redshift, Lambda, Kinesis)
  • A certification or bachelors degree in computer science, data analytics, big data or similar
  • 3+ years experience as a data engineer or similar
  • An analytical mind with an eye for detail and demonstrated history of solving complex data challenges

 

If you wish to apply for the position, please send your CV to Chalden Du Toit at cdutoit@caglobalint.com

 

Please visit www.caglobalint.com for more exciting opportunities.

 

Chalden Du Toit

Recruitment Consultant

CA Finance

 

CA Global will respond to short-listed candidates only. If you have not had any response in two weeks, please consider your application unsuccessful however your CV will be kept on our database for any other suitable positions.

 

Concept3.png

Look for More Jobs

arrow&v
arrow&v

Section Engineer (Maintenance / Open Pit / GCC Mines / Legal Appointment /Mining) – Kathu, Northern Cape

Job Reference

Region

178 02 RR

Southern Africa

Security Manager (Diamond Mining / Crime / SAPS / Surveillance / Investigations / Strategic) – Limpopo, South Africa

Job Reference

Region

523 1111 MHU

Southern Africa

Mécanicien Engins Lourds, Hydraulique et Électrique (Mécanique / Hydraulique / Électrique / Gravier) – Afrique de l’Ouest

Job Reference

Region

61 GS

Western Africa

Afreximbank: Manager, Intra African Trade Initiative (Intra-African Trade Fair & Exhibitions – Trade & Investment Promotion) – Cairo, Egypt

Job Reference

Region

LEEBLR033

Northern Africa

Chief Surveyor ( Mining / Open Pit / Expat ) – Sierra Leone

Job Reference

Region

713VG

Western Africa

Vice President - Technical Services (Engineering / Geology / Enviro / Metallurgy / Base Metals) – Middle East

Job Reference

Region

2627VG

Middle East

Afreximbank: Manager, Treasury & Markets (Treasury Client Solutions) – Cairo, Egypt

Job Reference

Region

LEEBLR028

Northern Africa

Production Manager ( Manganese / Iron Ore / Drill / Blast / Contract Mining / Open Cast ) – Northern Cape

Job Reference

Region

166 01 RR

Southern Africa

Fundraising Analyst (Fundraising / Finance / Analyst) – Tour Ivoire, Morocco

Job Reference

Region

FDSAALFA

Northern Africa

Global Principal Safety Capability Development (Risk Management / Health & Safety / Mining / Training ) – London / JHB

Job Reference

Region

145 05 12 MNW

Europe

Country Sales Representative ( Chemicals / Raw Materials / Pharma / Distribution / Business Development ) – Nigeria, West Africa.

Job Reference

Region

063 10 02 AB

Western Africa#Central Africa

Warehouse Manager (Inventory Manager / Mining / Bulk Materials / ERP / Fixed Plant / Mobile Plant) – West Africa

Job Reference

Region

256-1305LH

Western Africa

Let's get in touch

Find your dream job