Job Description

Job SummaryJOB DESCRIPTION:Job Title: AWS Data Engineer
Employment Type: 3 Months Contract (Renewable), Hybrid
Work Location: Johannesburg, SandtonDUTIES AND RESPONSIBILITIES:

• Creating data models that can be used to extract information from various sources and store it in a usable format.
• Lead the design, implementation, and successful delivery of large-scale, critical, or difficult data solutions involving a significant amount of data.
• Utilize expertise in SQL and have a strong understanding of ETL and data modelling.
• Ability to ingest data into AWS S3, perform ETL into RDS or Redshift.
• Use AWS Lambda (C# or Python) for event-driven data transformations.
• Designing and implementing security measures to protect data from unauthorized access or misuse.
• Maintaining the integrity of data by designing backup and recovery procedures.
• Work on automating the migration process in AWS from development to production.
• You will deliver digestible, contemporary, and immediate data content to support and drive business decisions.
• You will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery, and production implementation.
• From day one, you will be involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on- premises and hybrid client technology landscapes.
• Optimize cloud workloads for cost, scalability, availability, governance, compliance, etc.

QUALIFICATION AND EXPERIENCE REQUIRED:

• 5+ Years Python/C# Development.
• 3+ Years AWS Data Engineering Education.
• Global Markets experience is preferred.
• Creation of Data products.
• 5+ Years Data Analysis experience.

MANDATORY SKILLS:

• AWS Glue Jobs using PySpark or AWS Glue Spark Strong SQL and C# or Python programming knowledge Expert knowledge of data engineering packages and libraries and related functions in C# or Python.
• AWS technical certifications.
• Experience with development and delivery of microservices using serverless AWS services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM). SQL Server and MySQL.
• Apply knowledge of scripting and automation using tools like PowerShell, Python, Bash, Ruby, Perl,
• Exefxacx80ectively and efficiently troubleshoot data issues and errors.
• Strong experience in SDLC delivery, including waterfall, hybrid, and Agile methodologies.
• Delivering data solutions and pipelines on AWS Cloud Platform.
• Understand of data modelling, data structures, databases, and ETL processes.
• Delivering CI/CD and DevOps capabilities in a data environment.

BENEFICIAL SKILLS:

• Realtime ingestion using KAFKA.
• Experience in the financial industry.
• AWS Certified Machine Learning - Specialty Certificate

PACKAGE & REMUNERATION:

• Compensation will be determined based on qualifications, applicable experience, and previous earnings.

SPECD (Pty) LtdRecruiter

Job Mail