Senior Data Engineer – AWS Data Lake & Pipeline Architecture

<p>Summary<br>We are seeking a Data Engineer to support the development of a Data Intelligence Platform. This role focuses on data modeling, data services, data pipelines, and cloud-based data infrastructure for reporting, analytics, and data science.</p><p>General information<br>This Data Engineer will support data-related operations across a broader Data Intelligence Platform team. The work includes building and consuming web services, integrating search technologies, supporting personalization and recommendation engines, and applying data engineering best practices across the platform.</p><p>The role spans cloud-based data architecture, database performance, pipeline automation, and support for data scientists, researchers, and internal business units. The environment includes AWS-based infrastructure and a mix of structured and unstructured data sources.</p><p><strong>Tasks and Deliverables</strong><br>- Participate in the architecture design and implementation of high-performance, scalable, and optimized data solutions.<br>- Create data models from scratch using strong SQL fundamentals.<br>- Write and optimize in-application SQL statements.<br>- Ensure the performance, security, and availability of databases.<br>- Prepare documentation and technical specifications.<br>- Handle database procedures such as upgrades, backups, recovery, and migration.<br>- Profile server resource usage and optimize configurations as necessary.<br>- Design, build, and automate the deployment of data pipelines and applications.<br>- Integrate data from on-premise databases and external data sources using REST APIs and harvesting tools.<br>- Collaborate with business units and data science teams on data access, transformation, processing, and reporting needs.<br>- Support implementation, technical issues, and training related to the data lake ecosystem.<br>- Work with the team to manage AWS resources, including EMR and ECS clusters.<br>- Support provisioning, monitoring, configuration, and maintenance of AWS tools.<br>- Evaluate and promote new cloud technologies that improve capabilities and lower operating costs.<br>- Support automation efforts using Infrastructure as Code with Terraform and CI/CD tools such as Jenkins.<br>- Work with the team to implement data governance, access control, and security risk reduction.</p><p><strong>Required experience</strong><br>- 7-9 years of experience designing and developing cloud-based data models, ETL pipelines, and infrastructure.<br>- Experience working with both structured and unstructured data.<br>- Strong proficiency with SQL across popular databases.<br>- Experience optimizing large, complex SQL statements.<br>- Knowledge of best practices for relational databases.<br>- Experience configuring database engines and orchestrating clusters.<br>- Ability to plan resource requirements from high-level specifications.<br>- Ability to troubleshoot common database issues.<br>- Experience with Spark, Glue, EMR, and Apache Kafka or AWS Kinesis.<br>- Experience with version control tools such as Git or Subversion.<br>- Experience using automated build systems and CI/CD workflows.<br>- Experience programming in Java, Python, and Scala.<br>- Knowledge of data structures and algorithms.<br>- Knowledge of relational, NoSQL, graph, document, key-value, and time-series databases.<br>- Knowledge of scalable data model design and management.<br>- Knowledge of ML model deployment.<br>- Knowledge of AWS cloud platforms.<br>- Knowledge of TDD and BDD.<br>- Strong interest in improving software development skills, frameworks, and technologies.</p><p><strong>Engagement highlights</strong><br>- Opportunity to work across data modeling, data services, and data science within a broader Data Intelligence Platform.<br>- Exposure to a varied technical environment spanning AWS, ETL pipelines, databases, search technologies, and recommendation systems.<br>- Direct collaboration with data science teams and internal stakeholders on reporting, transformation, and platform capabilities.</p>

Back to blog

Other Jobs To Apply

Content Moderator – Remote Role Maintaining Online Standards, Earn Up to $35/Hour

(No Experience/ Entry Level) Netflix Virtual Assistant Jobs For Teens – Join Our Team

Seasoned Part‑Time Statistics Analyst I – Remote Data Entry Specialist for arenaflex – Elevate Sports Analytics from Home

Admitting Representative

Aetna Remote Jobs, Aetna Careers Remote @ Joblagii ( Manager Account Management )

Remote Tech Support Representative Entry Level Text Based Only No Degree Required

Phoenix Healthcare Services Data Entry Jobs

Remote - Operations Manager - Customer Success and Strategic Support (Pupil Transportation)

Remote Part Time Data Entry Clerk

Online Amazon Part Time Jobs WFH - (Actively Hiring)

REMOTE ENTRY-LEVEL POSITION - Full/Part-Time Available| Beginner Friendly - Start ASAP

Entry Level Fedex data entry jobs (Work At Home)

Merchandising Systems Delivery Lead

Online Proofreader

Remote Night Shift Customer Service Representative

Chewy Remote Typing For Teens No Experience – US ( FULL TIME )

SAP SD Consultant

Servicing Travel Advisor IV - Chase Travel (Remote)

Amazon Customer Service - Work From Home $16-$24/hr

Business Consultant (Remote)

Sales District Leader Trainee

Remote Netflix Jobs

Remote Typing Jobs No Experience

Logistics Coordinator (Work From Home) – $1,800 to $3,500 Weekly

Administrative Assistant / Data Entry Clerk (Remote Work From Home - Online)

Business Planning Manager

Work at Home Data Entry Agent - Part Time

Online Proofreader

Remote Tech Sales Executive

Amazon Customer Service - Work From Home $16-$24/hr

Remote Typing Jobs No Experience

Business & E-commerce (Part Time)

Strategic Logistics Area Leader — Data-Driven

Amazon Warehouse - Shopper / Order Fulfillment Associate $17-$23/hr

Area Manager II

Amazon Warehouse - Shopper / Order Fulfillment Associate $17-$23/hr

Amazon Yard Jockey Hostler at Amazon TOM Team(Part-Time,Houston)

Warehouse II

Janitorial Associate

Part-Time Fulfillment Center-Coordinator in Chattanooga

Immediate Opening in Paterson for a 3rd Shift Dispatch Driver

Grocery Warehouse Associate•Livonia,MI•Amazon | Hiring

Amazon Night Shift Sortation Warehouse Associate

Evening driver/courier | Delta, BC

Amazon Yard Jockey Hostler at Amazon TOM Team(Part-Time,Houston)

Janitorial Associate

Part-Time Fulfillment Center-Coordinator in Chattanooga

Immediate Opening in Paterson for a 3rd Shift Dispatch Driver

Grocery Warehouse Associate•Livonia,MI•Amazon | Hiring

Amazon Night Shift Sortation Warehouse Associate