Job Description

Data Engineer

"Join Us as a Data Alchemist: Turn Raw Data into Golden Insights!"

Location:

Johannesburg, SA - Hybrid |

Salary:

Competitive (Cause you're worth it!)


Are you a data virtuoso with a flair for crafting seamless data highways? We're on the hunt for a Data Engineer extraordinaire to join our client's dynamic Technology Team. This role offers the unique opportunity to collaborate with clients, designing secure, scalable, and cost-effective solutions that harness the power of both on-premises technologies and Cloud platforms like Azure and AWS. If you possess a blend of Cloud expertise, hands-on data engineering experience, and the ability to communicate complex ideas with creativity and clarity, we want to hear from you!

Your Mission, Should You Choose to Accept:

Design and implement scalable data pipelines using Cloud services such as Glue, Redshift, S3, Lambda, EMR, Athena, Microsoft Fabric, and Databricks. Develop and maintain ETL processes to transform and integrate data from diverse sources. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver top-notch data solutions. Optimize and fine-tune the performance of data pipelines and queries. Ensure data quality and integrity through rigorous testing and validation processes. Implement data security and compliance best practices. Monitor and troubleshoot data pipeline issues, ensuring timely resolutions. Stay abreast of the latest developments in data engineering technologies and best practices.

Your Toolkit:

A Bachelor's degree from an accredited university. 3+ years, hands-on experience in data engineering; prior experience in the financial services industry is a plus but not mandatory. Bonus points if you have experience with banks and insurers! Proven skills in building and managing data solutions using on-premises technologies or Cloud platforms. Familiarity with core Cloud Data Services, including Glue, Redshift, S3, Lambda, EMR, Athena, Microsoft Fabric, or Databricks. Knowledge of big data technologies such as Apache Spark, Hadoop, or Kafka. Proficiency in programming languages like Python (with Pandas) and SQL. Experience working with relational databases like AWS RDS, MS SQL, Azure SQL DB, or Postgres. Solid understanding of data modeling, ETL processes, and data warehousing. Experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or Azure ARM/Bicep. Familiarity with CI/CD tools to streamline software development and delivery. Excellent communication, problem-solving, and analytical skills, with the ability to present complex technical concepts clearly and concisely. Relevant Cloud certifications are a plus, showcasing your commitment to professional development and mastery of Cloud services and best practices. Strong desire to learn and enhance business knowledge.

If you're ready to embark on a data-driven adventure and elevate your career to new heights, apply now and let's revolutionize the world of data together!