Big Data Engineer

company banner
Judge Group, Inc.
Engineer, Analytical, SQL, Python, Java, J2EE, Business Analyst, Oracle
Full Time

Job Description

Location: The Colony, TX
Description: Our client is currently seeking a Big Data Engineer for a long term contract, possible contract to hire located in plano, TX. Please reach out o: for more information

The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization's data assets.

Job Responsibilities:

Design, construct, install, test and maintain highly scalable data management systems.

Ensure systems meet business requirements and industry practices.

Design, implement, automate and maintain large scale enterprise data ETL processes.

Build high-performance algorithms, prototypes, predictive models and proof of concepts.

Analytical and problem solving skills, applied to Big Data domain

- Proven understanding and hands on experience with Hadoop, Hive, Pig, Impala, and Spark

- 5-8 years of SQL, Hive, Hadoop and Python, Shell (4-5 years)

- Java/J2EE development knowledge

- 3+ years of demonstrated technical proficiency with Hadoop and big data projects

Day to Day duties: - Take requirements from Business Analyst and Stakeholders

Analyze and see where changes are needed; perform impact analysis (if pipeline available);

make sure proper connectivity to source & right credentials to connect to source; create pipelines (if not available) -

Data collection - gather information and required data fields.

Pull data from Oracle database (from different databases) put into Hive tables

- Data manipulation

- Join data from multiple data sources and build ETLs to be sent to Tableau (front-end dashboard) for reporting purpose

- Measure & Improve

- Implement success indicators to continuously measure and improve, while providing relevant insight and reporting to leadership and teams.

- Must be able to optimize performance tuning/monitoring and development at the same time. Mostly we are looking for an expert in SQL/Hive and moderate skills in python/shell and Hadoop. (A lot of times candidates screened have been really good in SQL but not in python/shell/Hadoop or vice versa.)

Contact:

This job and many more are available through The Judge Group. Find us on the web at www.judge.com


Company Information

The Judge Group, celebrating its 50th anniversary, is a leading professional services firm specializing in talent, technology, and learning solutions. We consult, staff, train, and solve. Through our work we make people and organizations better. Our services are successfully delivered through a network of more than 30 offices in the United States, Canada, and India. The Judge Group serves more than 50 of the Fortune 100 and is responsible for over 9,000 professionals on assignment annually across a wide range of industries.

Dice Id : cxjudgpa
Position Id : 709158
Originally Posted : 1 month ago

Similar Positions at Judge Group, Inc.

Big Data Architect
  • Plano, TX
  • 17 hours ago
Big Data Lead (Fulltime)
  • Irving, TX
  • 17 hours ago
Big Data Architect
  • Dallas, TX
  • 17 hours ago
Sr Data Engineer
  • The Colony, TX
  • 17 hours ago
Sr Data Architect (FULLTIME)
  • Plano, TX
  • 17 hours ago
BUSINESS DATA ANALYST - II
  • Richardson, TX
  • 17 hours ago
Lead Data Scientist
  • Plano, TX
  • 17 hours ago
Data Warehouse Engineer
  • Dallas, TX
  • 17 hours ago
Java & Hive Engineer (Fulltime)
  • Dallas, TX
  • 17 hours ago
Data Scientist
  • Grand Prairie, TX
  • 17 hours ago