Submit

Senior Data Engineer (AWS)

Lisboa

Job description

The focus of the service is for collaboration in one of the many data engineering projects running at Client, namely designing, developing, and maintaining data pipelines and architectures that support our Data platforms. You will work closely with cross-functional teams to ensure data is accessible, reliable, and efficiently processed to meet business needs.

Key Responsibilities for the service:
- Design and develop scalable data pipelines using AWS Glue.
- Implement and manage data storage solutions using Snowflake and other databases.
- Develop and maintain ETL processes to ingest, transform, and load data from various sources.
- Utilize Apache Airflow for workflow orchestration and scheduling.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality, integrity, and security across all data pipelines and storage solutions.
- Monitor and optimize data pipeline performance and troubleshoot issues as they arise.

Requirements

Senior Level
- Fluency in English, written and spoken, is mandatory.
- At least 3 years of direct professional experience working with AWS data services, especially AWS Glue, S3, and Lambda. This is mandatory
- Professional experience with Snowflake for data warehousing and analytics. This is mandatory.
- Professional experience with Apache Airflow for workflow orchestration.
- Professional experience in SQL and Python for data manipulation and analysis is mandatory.
- Professional experience with Git for version control and CI/CD

Mid-Level
- Experience with Terraform for infrastructure as code.
- Knowledge of Neo4j and Cypher is a plus.

Want to apply?
Position
Name*
Email*
Phone number*
Country*
City*
Linkedin
Faça upload do seu CV* (max. 4MB)
Upload your photo or video (max. 4MB)
Submit