Senior Data Engineer

Johannesburg, GP, ZA, South Africa

Job Description

Join the Team Taking South African Innovation to the World! - Remote to Hybrid Role



Ever heard of global brands like

Starbucks

,

KFC

, and others using cutting-edge tech to transform their customer experiences? Well, what if we told you that

South Africans

are leading the charge behind this revolution?

We're a South African-founded company that's using

world-class technology

to disrupt the retail industry on a global scale. We're not just changing physical retail--we're

redefining

it.

If you're ready to work with a team that's

shaping the future of connected retail

, and you want to be a part of something truly groundbreaking, this is your chance!

About the Team & Role



Our mission is supported by a data ecosystem that drives informed decision-making and innovation. The Data Team is a critical part of this mission, enabling advanced analytics, machine learning, and actionable insights to shape business strategy and outcomes. This team - comprising data engineers, data scientists, and data analysts - works collaboratively to transform raw data into impactful solutions, ensuring scalability, reliability, and actionable insights.

As a

Senior Data Engineer

, you will take a leading role in designing, implementing, and optimising our data infrastructure to support the organisation's strategic goals. You will be responsible for building scalable, high-performance data pipelines and driving best practices in data engineering. In this role, you will mentor junior team members, contribute to architectural decisions, and ensure the delivery of robust data solutions that empower data scientists and data analysts to generate insights. You will also play a key role in defining the future of our data platforms, leveraging advanced technologies to streamline data processing and enable business growth.

If you are passionate about

solving complex data challenges, driving innovation

, and shaping the backbone of a data-driven organization, we want you on our team!

Key Responsibilities



Lead the design and implementation of scalable and secure data architectures to support analytics and machine learning initiatives. Develop and optimise complex, high-volume data pipelines and databases to process structured and unstructured data in real time or batch. Ensure data pipelines and databases are optimised for performance, security, availability, and scalability. Work closely with data scientists and data analysts to ensure they have access to the right data and that data is formatted for their analysis needs. Develop and enforce standards and best practices for data quality, documentation, quality control, security, and compliance across all data processes. Evaluate and implement new tools, technologies, and frameworks to improve data systems and processes. Serve as a technical leader, coach and mentor for junior team members and adjacent data and engineering teams. Lead end-to-end data engineering projects that support strategic goals. This includes requirements gathering, technical deliverable planning, output quality control and stakeholder management. Contribute to the development of the IOB data strategy.

Requirements



A Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degrees are a plus. 5+ years (preferred 8+ years) of proven experience as a Data Engineer or in a similar technical role, with a strong track record of building scalable solutions. Expertise in programming languages such as Python, Java, or Scala. Advanced proficiency with SQL and database optimization techniques. Experience with data warehousing solutions (e.g. Databricks, Snowflake, Redshift, BigQuery, Synapse). Experience with distributed systems and big data technologies like Hadoop, Spark, Flink, or similar. Strong knowledge of cloud-based data platforms and their services (e.g. AWS, Azure, GCP). Experience with ETL tools and frameworks (e.g. Apache Kafka, Apache Airflow, Apache Spark etc.). Experience in designing and implementing data architectures that support large-scale data processing. Ability to work effectively with cross-functional teams, including data scientists, analysts, and business stakeholders. Experience leading and mentoring junior data engineers and other team members Experience contributing to and shaping internal data science standards and best practices. Strong problem-solving and critical thinking skills, with the ability to identify and resolve issues in data pipelines or infrastructure. Strong interpersonal skills, with the ability to communicate effectively across technical and non-technical teams. An innovative, collaborative mindset with excellent communication skills to work across teams.

Bonus Points & Other Considerations



Experience working in the retail or consumer analytics industry. Familiarity with embedded and edge compute platforms. Knowledge of data security best practices and compliance requirements (e.g. GDPR, SOC2). Knowledge of how to integrate machine learning models into data pipelines or data architectures. Experience with DevOps practices and tools, including containerization (e.g. Docker) and infrastructure-as-code (e.g. Terraform). Relevant certifications in cloud platforms or data engineering (e.g. Google Professional Data Engineer, AWS Certified Big Data - Specialty, Microsoft Certified Azure Data Engineer).
Job Type: Full-time

Pay: Up to R125000,00 per month

Work Location: In person

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1403462
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Contract
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Johannesburg, GP, ZA, South Africa
  • Education
    Not mentioned