Job#: 3017641
Job Description:
Job Title: Data Engineer
Duration: 12 Months
Location: Jersey City NJ
Payrate: $70.00 - $73.68/hr
Position Summary
The team is a Data Engineering & ETL focused on building and maintaining robust data pipelines and analytics platforms across heterogeneous systems. They partner closely with stakeholders to translate business processes into scalable technical solutions-designing, developing, and testing Informatica PowerCenter ETL workflows, Oracle/MS SQL procedures, and Unix shell automation, with scheduling via Autosys. The team ensures end-to-end data integrity and performance across big data ecosystems (Hadoop, Spark) and traditional databases, applying dimensional modeling, data profiling, and database/ETL testing to deliver reliable, well-documented, and compliant data solutions. They also support user acceptance testing, create training materials, and collaborate with adjacent development teams to manage interdependence and maintain software stability and data quality.
ETL Tool- 30%, PL/SQL/Shell/Python- 70%- shell scripting critical.
Responsibilities:
- Developing an understanding of stakeholders needs to help create a solution, envisions the solution to solve a problem (manually or through software
- Analyzes the stakeholder process to build efficiencies and analyzes the software to improve or implement that process
- Gathers and catalogs functional, non-functional, and technical requirements for stakeholder requests.
- Analyzes functional and data requirements. Answers the questions: What does the software do and how does it store information?
- Assists users and development team with application testing and troubleshooting
- Identifies, documents and troubleshoots application related problems
- Documents process, procedures and workflows associated with applications
- Creates and maintains training materials for end-users
- Demonstrate exceptional analytical skills and problem-solving skills; excellent organizational, communication skills
- A good team-player who seeks input and involves others in his/her communications; a person who values and cultivates relationships.
- Assist team with resolving technical complexities involved in realizing story work.
- Collaborate with other development teams to manage interdependency, set up test cases, debug and maintain data quality.
- Ensure software stability via documentation, code reviews, regression, unit and user acceptance testing.
- Hands on logical and physical data modeling and database design responsibilities.
- Perform data analysis and data profiling. Identify data quality issues
Primary Skill: ETL/Database testing
Required Qualifications
- Experience with large data sets using big data solutions such as Hadoop, Spark etc.
- 10+ years non-relational and relational DB's ETL looks like Informatica or others
- Design and implement ETL (Informatica) process using SQL, ETL tool and Linux shell scripting to deliver high quality solutions.
- Experience automating ETL with job scheduling tools. Autosys Preferred- Should understand scheduler (Autosys)
- 10+ years of professional experience with SQL/PLSQL
- Contribute to story refinement/defining requirements.
- Participating in and guiding teams in estimating work is necessary to realize a story/requirement through the delivery lifecycle.
- Perform spike/proof of concept as necessary to mitigate risk or implement new ideas.
- Code solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
- Utilize multiple architectural components (across data, application, business) in design and development of client requirements.
- Good understanding of Dimensional modeling
- Be able to lead and develop Informatica PowerCenter ETL complex flows connecting to heterogenous database such as oracle/MS SQL server.
- Develop complex oracle procedures, functions, and packages to support database applications (API calls / DW reporting)
- Conduct both proactive and reactive performance tuning activities during course of development of new applications and existing legacy applications.
- Hands on experience to develop and support Unix Shell Scripting.
- Hadoop- good to have it, not mandatory for now.
EEO Employer
Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Apex uses a virtual recruiter as part of the application process. Click for more details.
Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Apex team member can provide.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: apexsan
- Position Id: BHJOB2374_3017641
- Posted 1 day ago