Job Description

AHRI is always looking for talented and motivated staff to join our multidisciplinary team. We offer a highly diverse, professional and supportive environment with opportunities for development and growth.Description:This role is for a Senior Data Engineer to help build and maintain scalable data pipelines and related systems in a research-focused environment. You will be responsible for designing, developing, testing, and deploying data solutions that meet the business requirements and align with the scientific goals.You will collaborate with research scientists, internal IT, and other stakeholders to ensure data quality, reliability, accessibility, security, and governanceOverview of Duties:Overview of DutiesDesign, develop, and maintain end-to-end technical aspects of all data pipelines required to support the research scientists and data managersSupport ETL processes including, data ingestion, transformation, validation, and integration processes using various tools and frameworksOptimize data performance, scalability, and securityProvide technical guidance and support to data analysts and research scientists.Design data integrations and data quality frameworksWork and collaborate with the rest of the IT department to help develop the strategy for long-term scientific Big Data platform architectureDocument and effectively communicate data engineering processes and solutions.Make use of and help define the right cutting-edge technology, processes and tools needed to drive technology within our science and research data management departments.Minimum QualificationsBachelor's degree or higher in Computer Science, IT, Engineering, Mathematics, or a related fieldIndustry recognized IT related certification and technology qualification such as Databases and Data related certifications.This is a technical role so a strong focus needs to be on technical skills and experienceMinimum Experience7+ years experience in a Data Engineering, High Performance Computing, Data Warehousing, Big Data ProcessingStrong experience with high performance computing environments including Unix, Docker, Kubernetes, Hadoop, Kafka, Nifi, or Spark or Cloud-based big data processing environments like Amazon Redshift, Google BigQuery and Azure Synapse AnalyticsAt least 5 years advanced experience and very strong proficiency in UNIX, Linux, WindowsKnowledge of various data related programming, scripting or data engineering tools such as Python, R, Julia, T-SQL, PowerShell, etc.Knowledge and AbilitiesStrong Experience working with various relational database technologies like MS SQL, MySQL, PostgreSQL as well as NoSQL databases such as MongoDB, Cassandra etc.Experience of Big Data technologies such as Hadoop, Spark and HiveExperience with data pipeline tools such as Airflow, Spark, Kafka, or DataflowExperience working with containerization is advantageousExperience with data quality and testing tools such as Great Expectations, dbt, or DataGrip is advantageousExperience working with Big Data Cloud based (AWS, Azure etc) technologies is advantageousExperience with data warehouse and data lake technologies such as BigQuery, Redshift, or Snowflake advantageousStrong Experience designing end-to-end data pipelines.Strong knowledge of data modeling, architecture, and governance principlesStrong Linux Administration skillsProgramming skills in various languages advantageousStrong data security and compliancy experienceExcellent communication, collaboration, and problem-solving skillsAbility to work independently and as part of a cross-functional teamInterest and enthusiasm for medical scientific research and its applicationsWorker Type: EmployeeSkills:The application closing date: 6 Mar 2025Please note that only shortlisted candidates will be contacted, kindly consider your application as unsuccessful if you do not hear from us within 14 days of the application closing date.AHRI is a values-driven organisation. As an employer we are committed to staff engagement and development. Our culture is one of high performance and partnership.Our values
The successful candidate will be expected to live by AHRIs values, including collaboration, ubuntu, leadership, innovation, transformation, and excellence.Employment equity
AHRI is fully compliant with South African labour law and is committed to employment equity. This position is primarily open to South African or other African applicants, with a valid work permit desirable. AHRI reserves the right in special circumstances to accept late applications or to extend the above date to facilitate further searches. Furthermore, AHRI reserves the right not to make an appointment.

Africa Health Research Institute