Software Developer/data Engineer

Cape Town, Western Cape, South Africa

Job Description


Software Developer/Data Engineer - 12 Month ContractEducational Qualifications

  • BSc Computer Science / BEng
Professional Qualifications
  • AWS Professional Certification
Years of Experience
  • 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
Skills / Requirements
  • 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
  • Required to code complex transformations using loader specifications provided by the BA
  • Experience working with Big Data sets and solving data-related challenges
  • Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
  • Proficiency in coding languages: PySpark, Python, SQL
  • Hands-on experience with AWS services, including S3, Athena, Lambda Functions, GLUE, EC2
  • AWS experience and AWS certification required
  • Experience in data modeling and data architecture design
Key Responsibilities
  • Implement scalable data pipelines and architectures using PySpark, Python, SQL
  • Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue
  • Serve as a technical resource for team members and mentor junior engineers
  • Collaborate with the team to deliver high-quality solutions that meet business requirements
  • Ensure code is well-designed, maintainable, and follows best practices and standards
  • Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met
  • Utilize project development tools such as JIRA, Confluence, and GIT
  • Assist DEVOPS Engineer in automation and CI/CD practices
  • Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.

Boardroom Appointments

Beware of fraud agents! do not pay money to get a job

MNCJobs.co.za will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1404295
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Cape Town, Western Cape, South Africa
  • Education
    Not mentioned