登录获取应用

职位 › Dublin › 职位详情

Senior Data Engineer – AWS Data Lake & Pipeline Architecture

Toptal · Remote (Worldwide)

远程,全球均可英语

职位介绍

摘自雇主发布的职位信息 · Toptal · 发布于2026年9月15日

<p> <strong>Headquarters:</strong> </p> <p>Summary<br>We are seeking a Data Engineer to support the development of a Data Intelligence Platform. This role focuses on data modeling, data services, data pipelines, and cloud-based data infrastructure for reporting, analytics, and data science.</p><p>General information<br>This Data Engineer will support data-related operations across a broader Data Intelligence Platform team. The work includes building and consuming web services, integrating search technologies, supporting personalization and recommendation engines, and applying data engineering best practices across the platform.</p><p>The role spans cloud-based data architecture, database performance, pipeline automation, and support for data scientists, researchers, and internal business units. The environment includes AWS-based infrastructure and a mix of structured and unstructured data sources.</p><p><strong>Tasks and Deliverables</strong><br>- Participate in the architecture design and implementation of high-performance, scalable, and optimized data solutions.<br>- Create data models from scratch using strong SQL fundamentals.<br>- Write and optimize in-application SQL statements.<br>- Ensure the performance, security, and availability of databases.<br>- Prepare documentation and technical specifications.<br>- Handle database procedures such as upgrades, backups, recovery, and migration.<br>- Profile server resource usage and optimize configurations as necessary.<br>- Design, build, and automate the deployment of data pipelines and applications.<br>- Integrate data from on-premise databases and external data sources using REST APIs and harvesting tools.<br>- Collaborate with business units and data science teams on data access, transformation, processing, and reporting needs.<br>- Support implementation, technical issues, and training related to the data lake ecosystem.<br>- Work with the team to manage AWS resources, including EMR and ECS clusters.<br>- Support provisioning, monitoring, configuration, and maintenance of AWS tools.<br>- Evaluate and promote new cloud technologies that improve capabilities and lower operating costs.<br>- Support automation efforts using Infrastructure as Code with Terraform and CI/CD tools such as Jenkins.<br>- Work with the team to implement data governance, access control, and security risk reduction.</p><p><strong>Required experience</strong><br>- 7-9 years of experience designing and developing cloud-based data models, ETL pipelines, and infrastructure.<br>- Experience working with both structured and unstructured data.<br>- Strong proficiency with SQL across popular databases.<br>- Experience optimizing large, complex SQL statements.<br>- Knowledge of best practices for

提及的技能

Programming

每个职位,都有你的匹配分

BabZituna按六个真实维度,将每个职位与你的资料对照评分,并告诉你为什么得出这个分数,公平性经过审计(阅读公开的偏见审计)。

获取应用 → ✓ 求职者100%免费
一个职位如何评分 示例
技能96经验90地点84工作方式74工作类型61薪资无数据

示例数据,并非真实候选人。每个维度根据你本人的资料按100分制评分;无法衡量的维度会如实标明,而不是猜测。