[Remote] Data Engineer-Data Platforms-Google - 1

Note: The job is a remote job and is open to candidates in USA. IBM Consulting helps companies advance their hybrid cloud and AI journeys through collaboration, technology, and innovative solutions. The Data Engineer will design, build, maintain, and optimize scalable batch and real-time data pipelines and data engineering solutions using Google Cloud data platforms and open-source technologies.


Responsibilities

  • Design Data Pipelines: Design and develop batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services such as DataProc, DataFlow, PubSub, BigQuery, and Big Table
  • Develop Data Engineering Solutions: Build and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python, and other open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala
  • Manage Data Platforms: Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), ensuring seamless data pipeline operations
  • Optimize Data Layer: Design and optimize the data layer for efficient data migration and data processing using Google Cloud services
  • Ensure Scalability: Ensure scalability and efficiency of data pipelines and data engineering solutions to meet business needs

Skills

  • Proven experience designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, including Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB
  • Experience with Apache Beam, Apache Airflow, dbt, Spark/Python, or Spark/Scala, and ability to integrate these technologies with Google Cloud services
  • Experience developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services
  • Experience scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow)
  • Experience designing and optimizing data layers for efficient data migration and data processing using Google Cloud services
  • Experience with Apache Beam, including integrating it with Google Cloud services such as DataFlow, is highly valued
  • Ability to optimize Beam pipelines for scalability and efficiency is a plus
  • Familiarity with dbt and data modeling concepts, including data warehousing and data lake architecture, is beneficial for designing and optimizing data layers
  • Proficiency in Spark and Scala, including integrating them with Google Cloud services such as DataProc, is desirable for building and maintaining data engineering solutions

Benefits

  • This role can be performed from anywhere in the United States of America
  • Long-term career development support

Company Overview

  • IBM provides technology and consulting, including software, infrastructure systems, and cloud-based solutions. It was founded in 1911, and is headquartered in Armonk, New York, USA, with a workforce of 10001+ employees. Its website is

  • Company H1B Sponsorship

  • IBM has a track record of offering H1B sponsorships, with 1230 in 2026, 2857 in 2025, 3115 in 2024, 2047 in 2023, 1795 in 2022, 1153 in 2021, 2669 in 2020. Please note that this does not guarantee sponsorship for this specific role.

  • Back to blog

    Other Jobs To Apply

    Charlotte Outbound Dock Worker(Full-time)-Amazon | Hiring

    Arlington Flexible Role:Grocery Warehouse Associate

    Amazon Fulfillment Center Logistics Associate

    Seasonal Stockroom Operations Associate

    Part Time Hourly Warehouse Associate Seasonal Openings (T9478)

    Start ASAP:Delta Airlines Flight Attendant(Dallas)

    [Part-Time] Flight Attendant-Dallas

    Dallas Area Part-Time:Flight Attendant

    Area Maintenance Manager

    Appling Full-time Grocery Warehouse Associate | Hiring

    Part-Time Fulfillment Center-Warehouse Stower(Miami) | Part Time

    Surprise Career:Inbound Warehouse Associate at Amazon | Hiring

    Part-Time Fulfillment Center Job in Surprise | Part Time Job

    Amazon Warehouse

    Suffolk Flexible Role:Overnight Warehouse Associate

    Amazon(Suffolk)Hiring:Inbound Warehouse Associate | Apply Now

    Entry-Level Data Entry Clerk (Work From Home)

    Remote Telepharmacy Technician: Patient Care

    Remote Telepharmacy Technician (CPhT)

    Livestream Host + Coordinator (Tik Tok and WhatNot)

    Work in Fort Lauderdale:Overnight Warehouse Associate | Hiring

    Amazon Delivery Driver

    Work in Fort Lauderdale:Returns Processing Associate | Hiring

    Flight Attendant (PT + FT Available)

    Flight Attendant (PT + FT Available)

    Retail Associate - Inventory

    Fully Remote Job (Entry Level/No Experience) Data Entry Job – Indeed Jobs US

    Work From Home Data Entry Specialist Typing (Remote)

    Amazon Fulfillment Center - Package Sorter

    Senior Analyst - Digital Compliance (Remote)

    Remote Live Chat Support Agent

    Production Assistant (Entry-Level)

    Jr. Production Assistant - Global Production Equipment Inventory

    Care Manager RN – LA Market – Remote

    Call Center Representative- Fully Remote!

    Work from Home - Pharmacy Tech Support/Call Center Rep (9a-6p ET) - National

    Amazon Fulfillment Center - Outbound Ship Dock Loader

    Flexible Hours:Warehouse Associate-San Jose

    Amazon Fulfillment Center - Inbound Dock Worker

    Amazon Package Delivery Driver - Earn $17.50 - $27.00 / hr

    Senior account resolution representative

    Senior Software Engineer, Backend | Audit Product Team

    Senior Oracle EBS Supply Chain IT Business Analyst (US Remote)

    Flexible Grocery Warehouse Associate(Tulsa)

    Tulsa Area Part-Time:Overnight Warehouse Associate-Sort & Reset

    Waste Collection Driver Career Growth & Benefits

    Amazon Flex Delivery Driver

    Augusta,GA:Grocery Warehouse Associate at Amazon | Hiring

    Flight Attendant

    Flight Attendant - LAX