Job Description

Screening questions:
What are the steps to migrate from on prem to cloud.
What are some challenges you have faced with this in the past.
What are some other technical challenges you've faced and how did you solve them.

The client is EST, CST is fine as well but need to be able to work EST or CST hours.

Role Title: RM - Lead Data Engineer (Level 9)
Location: Remote (USA)

Work Setup: 100% Remote; candidates must have valid US work authorization.
Business Driver: Financial Services client requires a Level 9 lead to manage cloud migration and ETL modernization.
Scope: Heavy focus on Ab Initio (Metaprogramming/PDL) and transitioning data to AWS (Redshift/S3).
Leadership: This is a "Lead" role; candidate must be able to coach others and estimate efforts for Agile sprints.

TOP HARD SKILLS

1) Ab Initio (Expert) - 5+ years
2) AWS (S3/Redshift) - 5+ years
3) Hadoop/Hive - 5+ years

NICE-TO-HAVES * PySpark

Cloud Migration project experience
Banking/Financial Services background

DISQUALIFIERS * Lack of expert-level Ab Initio (Metaprogramming/PDL) experience.
No experience with AWS or Hadoop environments.

• Title: Lead Data Engineer (Level 9)
• Location: Remote (USA)
• POSITION OVERVIEW This role joins the AI & Data team within a major Financial Services environment, focusing on large-scale data warehousing and ETL modernization. As a Lead Data Engineer, you will drive the design and delivery of business solutions that bridge legacy Ab Initio frameworks with modern AWS and Hadoop ecosystems.

DAY-TO-DAY RESPONSIBILITIES * Design, code, and deliver complex business solutions using Ab Initio, including Metaprogramming, PDL, and generic frameworks.

• Lead ETL projects and technical solution design within the Banking Domain.
• Manage data migration and integration tasks for cloud-based applications.
• Identify technical enablers and calculate the level of effort for data ingestion and transformation in DWH environments.
• Oversee and coordinate deliverables for DWH and Cloud Agile teams.
• Coach team members by sharing best practices, technical insights, and domain expertise.

TOP 3 REQUIRED SKILLS 1) ETL-Abinitio (Expert level, 5+ years)

2) AWS - S3 and Redshift (5+ years)

3) Hadoop Ecosystem - HDFS, Spark, Hive (5+ years)

ADDITIONAL DESIRED SKILLS * Cloud Migration strategy

• PySpark development
• Financial Services / Banking Domain experience
• Agile team leadership

IDEAL CANDIDATE PROFILE The ideal candidate is a seasoned technical lead with a deep "under the hood" understanding of Ab Initio and modern cloud data stacks. They should possess the professional maturity to guide Agile teams while remaining hands-on in complex ETL design and AWS data migration.

Job Responsibilities

• Lead the design and development of complex ETL solutions using Ab Initio.
• Integrate and migrate data to AWS environments using S3 and Redshift.
• Collaborate with Agile teams to ingest and transform data for high-scale warehousing.
• Provide technical mentorship and best-practice guidance to junior and mid-level engineers.

Job Tags

Similar Jobs