Lead Software Engineer (Big Data; SPARK)

About the position

We are seeking a highly motivated Lead Software Engineer to join our Enterprise Finance Technology organization. This role will provide technical leadership in the design, development, implementation, and modernization of critical accounting, finance, and regulatory reporting platforms. The successful candidate will lead engineering teams in delivering scalable, secure, and resilient solutions that support financial transaction processing, accounting engines, regulatory reporting, data integration, and enterprise data platforms. This role requires deep expertise in distributed systems, cloud technologies, data engineering, event-driven architectures, and financial systems integration, along with hands-on experience using Python and Spark.

Responsibilities

  • Lead the architecture, design, and development of enterprise-wide finance technology solutions.
  • Drive modernization initiatives focused on cloud-native platforms, containerization, automation, and scalable data processing.
  • Design and implement high-performance data pipelines using Python, Apache Spark, Kafka, and modern data engineering frameworks.
  • Lead integration efforts between Oracle E-Business Suite (EBS), accounting platforms, regulatory reporting systems, and enterprise data warehouses.
  • Develop and support financial transaction processing services, accounting engines, reconciliation platforms, and reporting applications.
  • Partner with Accounting, Finance, Risk, Audit, Regulatory Reporting, and Technology stakeholders to define technical solutions aligned with business objectives.
  • Establish engineering standards, architecture patterns, coding best practices, and operational excellence processes.
  • Design event-driven architectures leveraging Kafka and streaming technologies to support near real-time financial processing and reporting.
  • Drive adoption of DevOps, CI/CD pipelines, infrastructure-as-code, automated testing, and deployment automation.
  • Lead root cause analysis for complex production issues and implement long-term remediation strategies.
  • Ensure solutions meet enterprise security, resiliency, compliance, data governance, and regulatory requirements.
  • Provide technical leadership, mentorship, and coaching to software engineers and technical leads.
  • Collaborate with enterprise architecture, cybersecurity, cloud engineering, and infrastructure teams to implement platform modernization strategies.
  • Evaluate emerging technologies and recommend innovative solutions to improve operational efficiency, scalability, and reliability.

Requirements

  • 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 5+ years of Python and object-oriented software development experience.
  • 5+ years of hands-on experience with Apache Spark for large-scale data processing and analytics.
  • 5+ years of technical leadership experience leading complex initiatives and engineering teams.

Nice-to-haves

  • Experience designing and implementing Kafka-based messaging and event-streaming solutions.
  • Strong knowledge of APIs, microservices architecture, and distributed systems design.
  • Experience with relational databases including Oracle, SQL Server, PostgreSQL, or equivalent platforms.
  • Hands-on experience with cloud platforms including Azure, AWS, or Google Cloud.
  • Experience implementing CI/CD pipelines using modern DevOps tools and practices.
  • Strong understanding of software security, data privacy, resiliency, monitoring, and observability
  • Experience supporting Oracle E-Business Suite financial modules and integrations.
  • Knowledge of General Ledger, Accounts Payable, Accounts Receivable, Fixed Assets, and Subledger Accounting processes.
  • Experience with Accounting Hub, enterprise accounting engines, or financial transaction processing platforms.
  • Experience supporting regulatory reporting solutions and financial reporting controls.
  • Familiarity with enterprise finance systems including Oracle ERP, SAP, or comparable platforms.
  • Experience with OpenShift, Kubernetes, Docker, or container-based deployments.
  • Experience implementing data governance, data lineage, and auditability requirements.
  • Knowledge of enterprise integration patterns and middleware technologies.
  • Experience working in regulated financial services environments.

Benefits

  • Relocation assistance is not available for this position
Back to blog

Other Jobs To Apply

Remote Customer Support Specialist- Part Time & Full Time

PACS Admin with Site co-ordinator (reputed company and Divrad)

Social Media Lead (m/w/d) | Strategie & Performance | 100 % remote

**Experienced Online Customer Support Specialist – reputed company Chat Support (Remote) – Part-Time Opportunity**

Junior Level/ Entry Level Software Engineer (Remote)

Ramp Agent - Evening Shift

Work from Home Overnight Jobs Late Night Customer Experience Specialist $25-$35/hr ? Enhance customer experiences during late-night hours in a home-based role.

Warehouse Associate - Night Shift- Immediate Hiring

reputed company Careers - Find flexible, work-from-home jobs helping customers while earning $25-$35 per hour.

Call Center Representative- Reno, Nevada- Remote (Any city, NV, US, 99999)

Nurse Consultant (Nursing Home Surveyor)

Warehouse Worker Job at Hayes Company LLC in Forney

SOC Analyst I (Remote)

Remote Part‑Time Customer Service Representative – Flight Operations & Passenger Support – Earn $27/hr at arenaflex

Live Chat Jobs - Remote Position (Up to $35/hour) - No Degree Required, No Experience Necessary

[Remote] DR Systems PACS Administrator / Specialist

-Work From Home Position | Entry-Level | Flexible Hours

Flexible Part-Time Remote Data Entry Specialist | Flexible Hours & Training Provided | Join arenaflex Team

reputed company, Progressive Care, Per-diem

Remote Physical Therapist in ID

Overnight Positions Near Me Online – Non-Phone Digital Chat Role | $25–$35/hr

reputed company RN – Clinical Documentation Specialist – CDIP CCDS Required – 100% Remote, GA

HelpDesk (Customer Support)

Senior Technical Program Manager, Amazon Access - Apply

Entry Level Financial Protection Specialist (Remote)

[Remote] Epic- Clinical Service Desk Specialist-REMOTE

Work from Home as a Game Tester in the United States

Medical Scribe (Remote - Full Time) - Full-time

Part Time Package Handler (Twilight) - YVR Area

Lead Backend Developer – Aviation Systems (Remote, Full-Time)

Remote Cybersecurity Jobs - reputed company

Appeals Nurse (RN) Analyst (670084)

Dealer Development Manager (Nashville, TN)

Entry-Level Data Entry Specialist Remote

Part-Time Remote Typist/Data Entry Clerk

No Experience Necessary | Work from Home Chat Agent Job - $25-$35/hour (Remote), Compensation: $25-$35/hour

**Remote Data Entry Clerk – Part‑Time, Precision‑Focused, Flexible Hours, Global Collaboration**

Remote Product Support Representative (No Degree Required/High Paying)

Entry-Level Data Entry Clerk – No Experience Required – Immediate Start at arenaflex – Grow Your Career in a Dynamic Data‑Driven Environment

**Dedicated Overnight Live Chat Support Agent – Remote, Night Shift Customer Service Specialist with Strong Communication Skills**

**Customer Service & Support Representative – Remote – 6+ Month Engagement – Join arenaflex’s Dynamic Operations & Assurance Team**

Experienced Remote Administrative Support & Data Entry Assistant – Part-Time, Entry Level | Flexible Hours + Great Pay

Weekend Job / Part-time Job - Online Tutor in Türkiye

[Remote] Business Operations Admin

Remote Live Chat & Email Support Specialist – Deliver Outstanding Customer Service from Home, Earn $25–$35 per Hour

Customer Support Jobs No Phone Flexible Schedule – reputed company | $25–$35/hr

**Remote Admin Support - Data Entry Role at blithequark**

**Experienced Customer Support Representative – Night and Weekend Shift – Coppell, TX**

Part-Time Remote Live Chat Support Specialist – No Experience Required, Flexible Hours, Earn Up to $280 Daily

**Experienced Part‑Time Remote Data Entry & Market Research Specialist – Earn Competitive Pay in Paid Focus Groups & Clinical Trials**