Data Engineer

Johannesburg, Gauteng, South Africa

Job Description


Key Responsibilities:

  • Develop, optimize, and manage data pipelines and data storage solutions.
  • Work with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, Glue, Fire Hose, or similar AWS tools.
  • Set up and manage data ingestion processes across Azure, AWS, or GCP environments.
  • Work closely with cross-functional teams to design and implement scalable data solutions.
  • Ensure optimal database performance by understanding SQL internals, including execution plans, wait types, isolation levels, DMVs, and indexing.
  • Optimize and write complex queries, focusing on high performance.
  • Leverage data visualization tools such as Power BI, SSRS, Tableau, or QlikView to produce actionable insights.
  • Develop and maintain version control using Git, and participate in CI/CD pipeline management for deployment strategies.
Qualifications and Experience:
  • Bachelors Degree in Computer Science, Software Engineering, Informatics, or Information Systems. Equivalent qualifications or certifications combined with significant industry experience may also be considered.
  • 3-5 years of professional experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
  • Strong T-SQL knowledge and experience writing and optimizing complex queries.
  • Intermediate Python development skills with familiarity in data-related libraries (e.g., Pandas, PySpark, Numpy).
  • Hands-on experience with NoSQL DB systems and understanding of Hadoop, Spark, Map Reduce, and MPP systems.
  • Experience with cloud platforms (Azure, AWS, or GCP) and related data ingestion processes.
  • Working knowledge of SQL Server and database design.
  • Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA/MCSE SQL Server 2012/2014) are a plus.
  • Proficient in version control and CI/CD practices with Git and repositories such as GitHub or Bitbucket.
  • Advantageous: Experience in C# or Java, and understanding of microservices architecture and containerization (e.g., Docker, Kubernetes).
Location: Sandton (Hybrid role)Apply now!For more IT jobs, please visit
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles/positions.For more information contact:
Reinie Du Preez
Senior Specialist Recruitment Consultant
E-mail:

ExecutivePlacements.com

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1393479
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Johannesburg, Gauteng, South Africa
  • Education
    Not mentioned