Data Engineer Ab initio
Contract W2
1 Year
No Travel Required
On-site
Depends on Experience
Futuremindz llc
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Unix/Linux shell scripting
- SQL
- Oracle
- Teradata). Experience in Java
- Scala
- Python or Kafka is plus.
- Kafka
- message queues
Summary
Job Title: - Data Engineer Ab initio - Ab Initio,
Location: Berkley Heights, NJ
Location: Berkley Heights, NJ
Duration - Longterm
Role Overview:
- We are seeking a highly skilled resource to design and implement high-performance, event-driven data
- pipelines, ensuring low-latency data processing and high availability system for the large credit card
- processing system. The ideal candidate will work with the Ab Initio ecosystem (GDE, EME, Conduct>It) to
- build stateful services that ingest, filter, and transform data from sources like Kafka or message queues,
- pushing updates to dashboards or downstream databases in near-real-time.
- Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and
- aggregations.
- Implement event-driven data pipelines using Kafka, MQ, and file streams.
- Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee "exactly-
- once" processing.
- Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency
- performance.
- Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issues
- Develop ETL pipelines for batch and real-time data ingestion and transformation.
- Implement and ensure data validation, data security, integrity, and compliance across big data
- platforms.
- Monitor and troubleshoot performance issues in large-scale clusters.
- Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
- Automate workflows and improve operational efficiency using scripting and orchestration tools.
- Deep understanding of credit card process system
- Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta>Environment),
- Conduct>It, and Continuous Flows.
- Understanding of Kafka, message queues, and real-time stateful services.
- Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).
- Experience in Java , Scala, Python or Kafka is plus.
- Familiarity with Linux/Unix environments and shell scripting.
- Understanding of data security, governance, and compliance standards.
- Experience with cloud-based big data platforms
- Exposure to containerization (Docker, Kubernetes) for big data workloads.
- Knowledge of CI/CD pipelines for data engineering projects.
- Good Communication skills
- 5 days Work from Office at Berkley Heights, NJ
- Team Player
- Ability to work in a changing environment
- Strong problem solving and analytical skills
- Ability to work independently or within a team
- Manage day-to-day challenges and communicate developmental risks with the technical team
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91162969
- Position Id: 9134569
- Posted 2 hours ago
Company Info
About Futuremindz llc
FutureMindz LLC is a IT Consulting Services company established in 2016. We specialize in providing scalable Implementation and Production support services to support Enterprise Resource Planning (ERP) adoption projects in mid-level to large organizations.
Headquartered in New Jersey, our team drives digital transformation for companies nationwide in the United States through partnerships with prime vendors.
Need more information? Please don’t hesitate to contact us and set up an exploratory call to identify how our consulting services can help your business needs.
Whether you are a seasoned professional or a new graduate, we definitely have existing and upcoming projects to pique your interest. Get in touch with one of our recruiters today to find out more.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.