Job Description

WHAT WE NEED:

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate should have a strong background in extracting and transforming data from various sources, including SFTP servers, APIs, and databases. Proficiency in modern data stack technologies, such as Python, BigQuery, dbt (data build tool), SQL, ELT concepts, and DevOps tools, is crucial. The successful candidate should have a minimum of 5 years of hands-on experience in data engineering.

The Data Engineer will play a crucial role in designing, implementing, and maintaining our data architecture, ensuring efficient and accurate data processing for analytics and business intelligence purposes.

WHAT WE NEED YOU TO DO:

Data Architecture Design:

Collaborate with cross-functional teams to understand data requirements and design scalable data architectures.

Develop and maintain conceptual, logical, and physical data models to support business needs.

Evaluate and implement new data storage and processing technologies.

ETL Development:

Design, develop, and optimize ETL processes to extract, transform, and load data from various sources into data warehouses.

Ensure data quality and integrity throughout the ETL pipeline.

Monitor and troubleshoot ETL jobs to identify and resolve issues promptly.

Database Management:

Administer and optimize databases to ensure high performance and availability.

Implement and maintain database security measures and access controls.

Collaborate with database administrators to fine-tune database configurations.

Data Integration:

Integrate data from multiple sources, both internal and external, to provide a unified view for reporting and analysis.

Implement data pipelines to facilitate real-time and batch data integration.

Performance Tuning:

Identify and address performance bottlenecks in data processing and storage.

Optimize queries and data retrieval processes to enhance overall system performance.

Documentation:

Create and maintain comprehensive documentation for data architecture, ETL processes, and database configurations.

Train and support other team members in understanding and utilizing data systems effectively.

Collaboration and Communication:

Work closely with analytics engineers, analysts, and business stakeholders to understand data requirements and deliver solutions.

Communicate effectively with technical and non-technical team members to convey complex concepts in a clear and concise manner.

Job Type: Full-time

Education:

Bachelors (Required)
Experience:

Data Engineer: 5 years (Required)
Work Location: In person