Senior Data Engineer
Western Cape, South Africa
Job Description
Job Summary Responsibilities:
- Design and implement scalable data pipelines using Apache Spark, Scala, and Java
- Develop and maintain data architectures for batch and real-time processing
- Collaborate with cross-functional teams to identify and prioritize project requirements
- Optimize data processing performance, scalability, and reliability
- Ensure data quality, security, and compliance
- Mentor junior data engineers and contribute to knowledge sharing
- Stay up-to-date with industry trends and emerging technologies
- Relevant Degree
- 6+ years of experience in data engineering (Spark, Scala, Java)
- Apache Spark (Core, SQL, Streaming)
- Scala programming language
- Java (Java 8 and above)
- Gradle build tool
- Data architectures (batch, real-time, lambda)
- Data storage solutions
- Big Data technologies (Hadoop, Hive, Impala)
- Cloud platforms (AWS, Azure, Google Cloud)
- Agile development methodologies
- Version control systems (Git)
- Excellent problem-solving, analytical, and communication skills
- Apache Kafka, Apache Flink, or other streaming technologies
- NoSQL databases (MongoDB, Couchbase)
- Data science concepts (machine learning, R, Python)
- Containerization (Docker)
- Orchestration tools (Apache Airflow, Kubernetes)
- Certification in Spark, Scala, or Java development
- Familiarity with DevOps practices
LaReine Mulder
Specialist Recruitment Consultant011 622 9526Network FinanceRecruiter
Job Mail
Beware of fraud agents! do not pay money to get a job
MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1354913
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:R320000 - 420000 per year
-
Employment StatusPermanent
-
Job LocationWestern Cape, South Africa
-
EducationNot mentioned