Job Description

Key Responsibilities:

• Design, Develop, and Optimize Data Pipelines: Lead the design, development, and management of robust cloud and on-premises data pipelines, ensuring efficiency and accuracy in support of our data strategy.
• Ensure Data Quality and Consistency: Implement data validation processes, enforce data guidelines, and monitor for inconsistencies to maintain high-quality data.
• Azure DevOps Repos and CI/CD Integration: Utilize Azure DevOps Repos for version control and Azure Pipelines for CI/CD practices, ensuring seamless integration and automation.
• Technical Leadership: Mentor junior and intermediate engineers, lead technical solutions, and resolve complex issues to build a strong, skilled team.
• Stakeholder Engagement: Foster relationships across the business to align stakeholders with data engineering objectives.
• Project Management: Plan, coordinate, and execute tasks to ensure successful project completion and manage timelines effectively.

Required Skills:

• Cloud Technology: Expertise in Azure services (Data Factory, Databricks, Data Lake, SQL Databases, Azure DevOps). Experience with Apache Spark is essential; knowledge of GCP and AWS is a plus.
• Programming Languages: Proficiency in Python and SQL, with exposure to PySpark.
• Commercial Acumen: Ability to develop solutions independently and provide technical assistance with an understanding of business objectives.

Education and Experience:

• Education: Grade 12/SAQA Accredited Equivalent (Essential); 3-year Degree in IT, Sciences, Informatics, or Computer Sciences (Essential); Masters degree (Advantageous).
• Experience: 5+ years in data engineering, data science, or computer science (Essential); experience in the Financial Services Industry, especially Short-Term Insurance (Advantageous).

Why Join Us?:

• Innovative Environment: Work on exciting projects in a forward-thinking company.
• Leadership Role: Take charge and lead a dynamic team of talented engineers.
• Professional Growth: Access to extensive development opportunities and career advancement.

Ready to lead and innovate? Apply now and become a key player in our data engineering success story!

ExecutivePlacements.com