Job Description

Responsibilities:

• Design, develop, and deploy robust and scalable data pipelines on GCP using tools such as Dataflow, Dataprep, and Apache Beam.
• Implement data ingestion processes from various sources including databases, APIs, and streaming platforms.
• Build and optimize data storage solutions on GCP, leveraging services like BigQuery, Cloud Storage, and Firestore.
• Work closely with data scientists to deploy machine learning models into production environments, ensuring reliability and scalability.
• Collaborate with software engineering teams to integrate data pipelines into existing applications and systems.
• Develop and maintain documentation, best practices, and standards for data engineering processes.
• Monitor and troubleshoot data pipelines to ensure optimal performance, reliability, and data quality.
• Stay up-to-date with emerging technologies and industry trends in data engineering and cloud computing.

Qualifications:

• Bachelors degree in Computer Science, Engineering, or a related field. Masters degree preferred.
• Proven experience as a Data Engineer or similar role, with a strong background in building and optimizing data pipelines.
• Proficiency in programming languages such as Python, Java, or Scala.
• Hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery, Dataflow, and Cloud Storage.
• Familiarity with SQL and NoSQL databases, data modeling techniques, and ETL processes.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration abilities, with the ability to work effectively in a fast-paced, team-oriented environment.

Google Cloud certification (e.g., Professional Data Engineer)

ExecutivePlacements.com