Big Data Engineer/Architect

Big Data, HortonWorks HDP (Big Data), Hadoop, MapReduce, Pig, Hive, Spark, Python, Java/J2EE, spring boot, Groovy, RESTful web services, Web API, R
Contract W2, 12 Months
Depends on Experience

Job Description

Job Title: Big Data Engineer/Architect
Location: Dallas, TX
Duration: Long Term Contract
 
Requirements:
  • Bachelor’s degree or equivalent in computer science/engineering, computer information systems or information technology.
  • At least 5 years’ experience in Big Data/Hadoop based Infrastructure.
  • At least 6 years’ experience in Developing and Designing Software Applications.
  • Experience with multiple SQL flavors, MapReduce/Pig/Hive, Spark/scala, Python, Kafka, HBase/Phoenix, Druid, Airflow.
  • Developing petabyte-scale data-processing workflows with complicated business requirements covering various search, visualization, analytics, and reporting functions
  • Certified Big Data Architect.
  • Expertise and experience in software architecture, development and on-prem application design and migration.
  • HortonWorks HDP (Big Data), Hadoop, MapReduce, Pig, Hive, Spark
  • Core Big Data tools/products Kafka, HBase/Phoenix, Druid, Airflow
  • Languages like Scala, Python and Java
  • Java/J2EE, spring boot, Groovy, RESTful web services Web API, R.
  • Agile
 
Role Description:
  • Developing petabyte-scale data-processing workflows with complicated business requirements covering various search, visualization, analytics, and reporting functions
  • Subject matter expert for the few dozen data sources that the System collects
  • Ensuring data integrity for processed data sources
  • All development related to data processing job orchestration
  • Supporting machine learning experts that use the processed data
  • New development, including bug fixes, feature enhancements, hotfixes
  • Automation of builds and deployments
  • Researching and prototyping new technologies and features.
 
Key Responsibilities:
  • Subject matter expert for data processing and serving systems using legacy and state-ofthe-art frameworks, systems, and languages including but not limited to: multiple SQL flavors, Mapreduce/Pig/Hive, Spark/scala, Python, Kafka, HBase/Phoenix, Druid, Airflow
  • Production support of two data-processing Hadoop based infrastructures that power web applications used by security groups.
  • Developing petabyte-scale data-processing workflows with complicated business requirements covering various search, visualization, analytics, and reporting functions
  • Subject matter expert for the few dozen data sources that the System collects
  • Ensuring data integrity for processed data sources
  • All development related to data processing job orchestration
  • New development, including bug fixes, feature enhancements, hotfixes
  • Automation of builds and deployments
  • Researching and prototyping new technologies and features.
 
Skills Requirements:
Big Data, HortonWorks HDP (Big Data), Hadoop, MapReduce, Pig, Hive, Spark, Python, Java/J2EE, spring boot, Groovy, RESTful web services Web API, R

About IDEXCEL, INC
Idexcel is an IT services organization, with a mission to bring great people and great organizations together. Our diverse client base represents a wide range of industries, including technology, telecom, insurance, healthcare, manufacturing, banking & financial services, food & commodities trading and federal organizations. Our teams of experienced recruiters directly work with client companies seeking exceptional people to help with their business initiatives.
 
Idexcel, Inc. is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, disability, military status, national origin or any other characteristic protected under federal, state, or applicable local law.
Dice Id : eveva001
Position Id : IDXL_BH_36651
Originally Posted : 5 months ago
Have a Job? Post it

Similar Positions

Data Engineer - Hadoop
  • Maveric NXT Inc
  • Dallas, TX
SR BigData Developer
  • Object Technology Solutions, Inc.
  • Irving, TX
Data Engineer
  • Matlen Silver
  • Dallas, TX
Big Data / Hadoop Developer
  • DIVERSANT, LLC.
  • Addison, TX
Big Data Developer
  • Xoriant Corporation
  • Irving, TX
Big Data Engineer
  • Sky Consulting Inc
  • Dallas, TX
Hadoop/ BigData Specialist
  • AgreeYa Solutions
  • Plano, TX
Big Data - PySpark
  • Wipro Ltd.
  • Irving, TX
Sr. Big Data Engineer
  • Adept Scripts
  • Irving, TX
Big Data Engineer - Python
  • ResolveTech Solutions Inc.
  • Irving, TX
Scala Developer
  • Pyramid Consulting, Inc.
  • Irving, TX
Hadoop developer
  • Collabera
  • Addison, TX
Big Data Engineer
  • Success In Cloud, Inc
  • Plano, TX
Big Data Architect
  • Metafore Consulting Services
  • Dallas, TX