Job Description

What We DoAt Blue Bean Software, we're not just building software we're shaping the future. As a leading custom software and product development company, we partner with both large enterprises and dynamic start-ups to solve their most complex challenges. From high-stakes projects in the financial services industry to groundbreaking ventures in agritech and healthtech, we deliver tailored solutions that blend cutting-edge technology with a deep understanding of our clients' needs.We're pioneers in our field, constantly pushing boundaries and redefining what's possible. If you're passionate about solving real-world problems with innovative tech, you'll find a home here.Who We AreBlue Bean Software is more than a workplace it's a community of brilliant minds. We've created an environment where software engineers, developers, and tech enthusiasts can thrive, grow, and express themselves freely. Here, you'll have the freedom to master your craft, collaborate with like-minded professionals, and tackle challenges that inspire you.We're committed to fostering a culture of trust, integrity, and self-motivation. At Blue Bean, you're not just an employee you're a valued member of a team that's driven by curiosity, innovation, and a shared passion for excellence.How We WorkForget rigid hierarchies and red tape. At Blue Bean, we operate with a flat organisational structure that empowers every team member to make an impact. Collaboration is at the heart of everything we do, and we believe in giving our people the autonomy to make agile decisions and drive results.We're all about streamlined communication, creative problem-solving, and delivering exceptional customer service. Whether you're working on a high-profile project or brainstorming the next big idea, you'll have the support and freedom to excel.Role OverviewWe are continuously seeking skilled Data Engineers to join our talent pool for future opportunities. By submitting your details, you can be pre-vetted for roles where you can design, build, and manage robust data pipelines and infrastructure. Your expertise will enable organisations to harness the power of data, driving insights and innovation.Key Responsibilities

• Design, develop, and maintain scalable data pipelines to process and transform large volumes of data.
• Integrate data from various sources, ensuring data quality, consistency, and reliability.
• Optimise data storage and processing for performance, scalability, and cost efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to support data-driven decision-making.
• Implement and manage big data platforms and tools such as Hadoop, Apache Spark, and Kafka.
• Ensure data security, compliance, and governance across all data processes.
• Monitor and troubleshoot data pipelines to ensure smooth operation and minimal downtime.
• Stay updated with the latest trends and technologies in data engineering and big data.

Your Skills and Experience

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in big data tools and frameworks (e.g., Hadoop, Apache Spark, Kafka, Apache Flink).
• Expertise in programming languages such as Python, Java, Scala, or SQL.
• Experience with ETL/ELT processes and tools (e.g., Talend, Informatica, Apache NiFi).
• Familiarity with cloud-based data solutions and services, including:

• AWS (Redshift, Glue, EMR, S3)
• Azure (Synapse, Data Factory, Databricks)
• Google Cloud (BigQuery, Dataflow, Pub/Sub)
• Knowledge of database systems, including:

• Relational databases (e.g., PostgreSQL, MySQL, SQL Server)
• NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• Data warehousing solutions (e.g., Snowflake, Redshift, BigQuery)
• Experience with data modeling, data architecture, and data governance best practices.
• Familiarity with workflow orchestration tools like Apache Airflow or Luigi.
• Strong understanding of data security, compliance, and privacy regulations (e.g., POPIA, GDPR).
• Knowledge of containerisation and orchestration tools (e.g., Docker, Kubernetes) is a plus.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Relevant certifications (e.g., AWS Certified Data Analytics, Google Cloud Data Engineer, Azure Data Engineer Associate) are a plus.

Additional InformationCompetencies

• Capable of contributing to the development of innovative solutions.
• Proven ability to perform effectively under pressure and meet tight deadlines.
• Self-driven with a proactive approach to tasks and challenges.
• Strong team player with the ability to collaborate effectively in a team environment.

Why Submit Your Details?By joining our talent pool, you'll be first in line for exciting opportunities to become a part of our team, working on innovative projects and cutting-edge technologies.Here, you're more than just a developer or a designer you're a catalyst for change in how people interact with technology. Step into a world where digital products don't just function they make an impact. A world where you carve your own path to success, surrounded by a team that's as authentic as it is exceptional.Sound like your kind of place?Take the leap and join us!

Blue Bean Software