Datastage/ Python developer

Columbus, OH, US • Posted 1 hour ago • Updated 1 hour ago
Contract Independent
On-site
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Shell
  • Scripting
  • Data Flow
  • Orchestration
  • Datastage
  • Scala
  • Apache Spark
  • Java
  • Apache Hive
  • Apache Pig
  • Use Cases
  • Data Marts
  • Analytical Skill
  • Management
  • Data Processing
  • Data Profiling
  • Data Quality
  • Workflow
  • EDM
  • Data Management
  • Analytics
  • Apache Hadoop
  • RDBMS
  • Data Lake
  • Apache Sqoop
  • Real-time
  • HDFS
  • Apache Kafka
  • Customization
  • Regression Testing
  • Unit Testing
  • Test Plans
  • Continuous Integration
  • Continuous Integration and Development
  • Data Engineering
  • Impact Analysis
  • Data Warehouse
  • Extract
  • Transform
  • Load
  • IBM InfoSphere
  • IBM InfoSphere DataStage
  • Oracle
  • Python
  • Snow Flake Schema
  • Amazon Web Services
  • Technical Drafting
  • Teradata
  • Database
  • Big Data
  • Cloud Computing
  • Computer Science
  • Privacy
  • Marketing

Summary

Location: Columbus, OH Salary: Depends on Experience Description:
Job Description:

  • Develop Shell scripts for automation of the data flow process and ETL orchestration pipeline.
  • Implement ETL transformations using DataStage, Hadoop Big data technologies like Spark-Scala/Spark-Java, Hive, or Pig based on the business use case.
  • Develop One-time/On-demand data Extractions from the data marts in the database systems for the business users for analytical purposes.
  • Direct Podium for end-to-end data management.
  • Develop automation and ETL jobs to schedule data processing utilities using reusable ETL components and frameworks of the data pipelines.
  • Implement Data profiling, Data quality, and Data standardization for all the workflows based on EDM standards (Enterprise Data Management).
  • Build Hadoop Data Lake for analytics using Hadoop echo system.
  • Migrate tables from traditional RDBMS into Data Lake using Sqoop.
  • Transfer real-time data from different data sources into HDFS systems using Kafka producers, consumers, and Kafka brokers.
  • Use cloud-native development, micro-services architecture, operations, and governance framework to gather required technical data for purposes of formulating recommended customization of AWS.
  • Perform Unit and regression testing, prepare unit test case documents for comparing the results with business requirements.
  • Ensure the technical implementations are in line with the requirements and specifications.
  • Help Quality Analyst Team in preparing a comprehensive test plan to ensure proper functioning of the application for the zero-defect delivery for the continuous integration and deployment to the production.
  • Prepare Technical Specification documents that explain the technical solutions and list the technologies to be used while implementing the solution.
  • Prepare data models to be certain that the data objects are represented accurately by the ETL and Data engineering software and application tools.
  • Participate in business requirement meetings, perform requirement, and impact analysis with Business Analysts.
  • Coordinate with business users to understand the data sources/entities.
  • Design the on-prem or cloud data warehousing models using ETL tools such as IBM Infosphere Data Stage, Oracle, Python, and cloud platforms such as Snowflake and AWS (Amazon Web Services)
  • Create Technical design documents as part of project deliverables.
  • Analyse Teradata databases to design extract strategies into Big data and cloud platforms.
  • These duties are complex and require at least a bachelor's degree in computer science or a related field.


By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: cxjudgpa
  • Position Id: 1148872
  • Posted 1 hour ago

Company Info

About Judge Group, Inc.

The Judge Group, is a leading professional services firm specializing in talent, technology, and learning solutions. We consult, staff, train, and solve. Through our work we make people and organizations better.

Our services are successfully delivered through a network of more than 30 offices across the United States, Canada, and India. The Judge Group is proud to partner with the best and brightest companies in business today, including over 60 of the Fortune 100. We serve organizations in financial services, healthcare, life sciences, insurance, government (including aerospace and defense), manufacturing, and technology and telecommunications.

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Whitehall, Ohio

Today

Contract

Burlington, New Jersey

Today

Contract

USD 100,000.00 - 110,000.00 per year

Plano, Texas

Today

Contract

USD 70.00 - 75.00 per hour

Salt Lake City, Utah

Today

Contract

Compensation information provided in the description

Search all similar jobs