Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
501 to 1000 Employees · Dalton, South Africa
1 open role1 posted in 7d1 in 30d
Work-life balance 3.8Compensation & benefits 3.4Culture & values 4.1
Hiring: Big Data Engineering
What employees say
+ LONG HOLIDAY AS IT'S ALSO A UNIVERSITY
− you could end up with rubbish management depends on which department you work for
More reviews on the company profile.
Job description
Big DataData EngineeringSparkCloud Computing
Overview
Data Engineer with experience in Java, Big Data technologies, and handling complex data ingestion and transformation solutions in a trading, telecom, gaming, or risk engine environment.
Responsibilities
- Good knowledge of Data Structures, Design patterns, and Algorithms
- Performance Tuning with optimization of Memory, CPU, Network IO
- Knowledge of Data Distribution, Leader Election, and Memory allocation routines
- Experience in handling large datasets that meet functional / non-functional business requirements
- Create and maintain optimal data pipeline architecture
- Assemble large, complex data sets that meet functional / non-functional business requirements
- Deliver streaming data ingestion and transformation solutions
- Knowledge of data redistribution techniques in case of Node Failures
- Knowledge of Query Parsing techniques
- Experience in Cloud Computing
Qualifications
- Minimum 4–7 years experience
- Practical experience in Java as well as Scala or Python (implied)
- Good understanding of Spark Internals
- Understanding of Unix Internals
- Experience working with Trading, Telecom, gaming, or Risk engines in financial sectors
Verify Java for this role
Free PRACTICE for Java adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Java free →Want match scores and deeper insight? Create a free candidate profile