Senior Level Big Data Position || Need on w2


Spear Staffing
Dice Job Match Score™
🎯 Assessing qualifications...
Job Details
Skills
- Big data
- finance
- pyspark
Summary
Role:Senior Level Big Data Position
Location: Charlotte NC (Hybrid)
Duration: 2-year contract
Interview: Video
Must haves:
Pyspark
Scala
SQL
Batach Data Pipeines
Job Description:
Big Data Engineer Financial Crimes & AI Enablement
Overview
- Wells Fargo is expanding its AI and data modernization initiatives and is seeking experienced Big Data Engineers to support critical data sourcing, platform engineering, and modernization efforts within the Financial Crimes organization. These roles are funded to accelerate delivery of new AIdriven use cases that require strong, reliable data foundations.
- The work centers on largescale data ingestion, conformance, and modernization of legacy systems including the Newton wires platform onto the enterprise big data environment.
Key Responsibilities
- Lead endtoend development of batchoriented data pipelines, including raw data sourcing, domainlevel conformance, and support for downstream curation teams.
- Design, build, and optimize largescale data processing solutions using PySpark, Scala, Spark, and advanced SQL.
- Support modernization initiatives such as the Newton wires rebuild, including complex parsing, mapping, and transformation of highvolume structured and semistructured data (CLOB, JSON, SWIFT formats).
- Apply enterprisescale performance engineering patterns (partitioning, sorting, join optimization) to ensure reliability and throughput across petabytescale datasets.
- Collaborate with platform engineering, financial crimes teams, and AI integration groups to ensure data readiness for advanced analytics and AI use cases.
- Provide L3 production support for developed pipelines, particularly during golive and stabilization phases.
- Work within established tooling and frameworks, including Autosys, Unix shell scripting, GitHub/CI/CD, JIRA/Agile, FlowMaster (ingestion wrapper), and Dremio (SQL interface).
Required Qualifications
- 5+ years of experience in Big Data engineering within large enterprise environments.
- Strong handson expertise with PySpark, Scala, Spark, and SQL.
- Proven experience with data sourcing, ingestion, and conformance on distributed data platforms.
- Demonstrated ability to own deliverables endtoend, including production support.
- Experience building and supporting batch pipelines and working with enterprise schedulers (Autosys).
- Proficiency with Unix shell scripting, GitHub, CI/CD pipelines, and Agile development practices.
Preferred Qualifications
- Experience with financial crimes, risk, or transaction monitoring data domains.
- Familiarity with modernization of legacy systems (e.g., mainframe to big data migrations).
- Exposure to AIrelated data preparation or integration (AI experience is a plus, not a requirement).
- Knowledge of Power BI for reporting support (beneficial for select roles).
- Prior Wells Fargo experience or returning boomerang candidates with strong references.
- Dice Id: 91138897
- Position Id: 8981000
- Posted 17 hours ago
Company Info
As the world’s first and largest specialized talent solutions and business consulting firm, we are a rapidly growing company with the potential to offer you a rewarding career. Our team comprises talented professionals with expertise in recruitment, talent acquisition, and career development. We collaborate to create innovative solutions and deliver extraordinary results.
We offer competitive salaries, benefits, and a collaborative work environment. Our culture is one of collaboration and respect, and we strive to create a positive work-life balance for our employees. Join our team and help us achieve our mission of positively changing people’s lives!
From flexible schedules to development opportunities, at Spear Staffing you’ll have the support you need to reach your goals at every stage of your career. Explore some of the reasons why many of our employees have been with us for 10, 15, 20 years or longer.
Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs