Job Description

Title Software Developer / Data EngineerWe are looking for s strong passionate and skilled Data Engineer to join our MAC (Margin Assurance Cloud) project, to can help the team drive the project to fruition.MAC is a bespoke in-house developed AWS Serverless Cloud Native application and the core functionalities are:DataExtract, load and transform data using familiar scripting language like SQL & Python for the purpose to produce automated, near real time Assurance Controls to the MA TeamSelf-ServiceAccess to Athena using workgroups & federated roles for end users (MA Team) to run their own queries for the purpose of investigations;Reporting & AlertingCapability to create reports from Athena views and send via email to the business customer;Alerting capabilities & Monitoring on File IngestionMain Components (AWS Services used): S3, Athena, Lambda Functions, GLUE, EC2Main Coding Language is: Python, PySpark and SQLIn support to our Clients IT strategy we are in progress with a major migration project of the current on-prem Assurance system utilized by business Margin Assurance residing in FINOPS to the MAC Cloud environment.The scope of the project build includes:Data Ingestion and Transformation; S3 Loader Output Build; Athena SOX Validation Reports Build; Athena SOX Aggregation Reports Build;Delivery will be an agile project which will be managed in monthly sprints. Altron will deliver the requirements as listed and prioritized in the backlog by the Vodacom Technical Delivery Lead and agreed to in each Sprint Planning Ceremony.KEY RESPONSIBILITIES:The Role:Implement scalable data pipelines and architectures using technologies like PySpark/Python/SQLBuild out distributed data pipelines and compute tier that operates on AWS Lambda and GlueServe as a technical resource for team members and mentor junior engineersCollaborate with team to deliver high-quality solutions that meet business requirementsEnsure that code is well-designed, maintainable, and adheres to best practices and standardsPlay a key role in shaping the direction of engineering practices through working on a scrum-size team empowered to organize and ensure sprint deliverables are met as committed during sprint planning ceremoniesFollowing the project development tools like JIRA, Confluence and GITAssist DEVOPS Engineer in automation CICD practices.Evaluate and recommend new technologies and approaches to improve the performance, scalability, and reliability of our software systemsCORE RESPONSIBILITIES:Skills / Requirements:4 to 8 Years of Data Engineering or Software Development experience working on Data Driven eco systemsRequired to code complex transformations using loader specifications provided by the BABe able to work with Big Data sets, very knowledgeable in understanding and solving data problemsBe able to automate ingestion through building ingestion pipelines using Lambda or GlueVery skilled in coding languages PySpark/Python/SQLMust have worked on AWS, with the focus on the following services: S3, Athena, Lambda Functions, GLUE, EC2Experience in AWS and Certificate in AWS certification requiredExperience with data modelling and data architecture design requiredQUALIFICATIONS, EXPERIENCE, & SKILLS:Educational Qualifications:BSc Comp Sci/BEngProfessional Qualifications:AWS Professional CertificationYears of Experience:4 to 8 Years of Data Engineering or Software Development experience working on a Data driven eco systems.Education Bachelor's Degree: Computer and Information Science (Required)Languages English

Altron