Job Description

Data Engineer (JHB) IT - Analyst, Data Management
Johannesburg - Gauteng - South AfricaENVIRONMENT:OPTIMIZE data pipelines for performance, scalability, and reliability as the next Data Engineer sought by a dynamic Retail and Consumer Finance Concern in Joburg. The ideal candidate will use their passion for Big Data & Analytics to provide insights to the business covering a range of topics. You will play a critical role in the development and maintenance of data infrastructure while ensuring data availability, quality, and accessibility for analysis. You must possess a Bachelors Degree in Computer Science/IT or similar discipline, have relevant Certifications such as AWS Certified Data Analytics, Google Cloud Professional Data Engineer and have 5-10 years experience and understanding in designing and developing data warehouses according to the Kimball methodology. You will also need proficiency with SQL, Python/R, Scala, Java, Snowflake, Redshift, AWS, SAS Data Studio & ETL tools.DUTIES:

• Collaborate with Data Scientists, Analysts, and business stakeholders to understand data requirements.
• Design, develop, and maintain data pipelines and ETL processes.
• Implement and maintain data warehousing and data storage solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Ensure data quality and integrity through data validation and cleansing processes.
• Monitor and troubleshoot data infrastructure issues.
• Stay current with emerging technologies and best practices in Data Engineering.
• Systematic solution design of the ETL and data pipeline in line with business user specifications.
• Develop and implement ETL pipelines aligned to the approved solution design.
• Ensure data governance and data quality assurance standards are upheld.
• Deal with customers in a customer centric manner.

REQUIREMENTS:Qualifications

• Bachelor's Degree in Computer Science, Information Technology, or a related field.
• Relevant Certifications (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).

Experience/Skills

• 5-10 Years experience and understanding in designing and developing data warehouses according to the Kimball methodology.
• Proven experience as a Data Engineer in a professional setting.
• Proficiency in Data Engineering technologies and Programming languages (e.g., SQL, Python, Scala, Java).
• Strong knowledge of data storage, database design, and data modelling concepts
• Experience with ETL tools, data integration, and data pipeline orchestration.
• Familiarity with data warehousing solutions (e.g., Snowflake, Redshift).
• Excellent problem-solving and troubleshooting skills.
• Adept at design and development of ETL processes.
• SQL development experience, preferably SAS Data Studio and AWS experience. Have the ability to ingest/output CSV, JSON and other flat file types and any related data sources.
• Proficient in Python or R or willingness to learn. Experience within Retail, Financial Services and Logistics environments.
• Redshift Technologies.
• Understanding of data security and compliance best practices.

ATTRIBUTES:

• Effective self-management and teamwork.
• Strong communication and collaboration skills.

Apply for this Job

Datafin