Data Engineer

Plano, TX, US • Posted 4 hours ago • Updated 4 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Data Management
  • FOCUS
  • Artificial Intelligence
  • Supervision
  • HDFS
  • Workflow
  • Software Development
  • Test Plans
  • Information Technology
  • Data Engineering
  • Analytical Skill
  • Oracle
  • CA Workload Automation AE
  • Agile
  • PL/SQL
  • RDBMS
  • Apache Hive
  • Database
  • Scripting
  • OOD
  • Big Data
  • Apache Spark
  • PySpark
  • SQL
  • Apache Hadoop
  • Extract
  • Transform
  • Load
  • Statistical Models
  • Python
  • Jupyter
  • NumPy
  • Pandas
  • scikit-learn
  • Machine Learning (ML)

Summary

The Enterprise Data Management Services team is looking for a strong, self-motivated Technology Developer to become an integral part of the Data Resiliency program.

Responsibilities include but are not limited to: Developing and enhancing application components for supporting ML/AI models and data ingestion processes, with focus on code resiliency and stability. Interacting & leading a team of developers, and interacting with business partners and develop processes to ensure that ML/AI models are production-ready Developing, enhancing, modifying and/or maintaining applications Working in a fast paced agile environment, under minimal supervision, with guidance from senior team members Participating in analysis on operational issues Participating in peer reviews for designs, code, and other work productsStrong knowledge of Oracle, SQL, RDBMS along with Python, Hadoop, Hive, Spark Experience in developing Hive & DBMS based applications Python programming background (scripting and object-oriented design) Coding experience with "big data" (Spark/PySpark, SQL, Hadoop, ETL development) Experience implementing statistical models in python (Jupyter notebooks, scipy, numpy, pandas, Scikit-learn) Machine learning experience or knowledge

Overview:
Assess requirement and evaluate existing solutions
Build Process to interact with HDFS and Oracle using Python/ PySpark and Oracle PL/ SQL
Create Workflows, jobs and schedule them using Autosys
Works across development teams to contribute to the story refinement and delivery of data requirements through the delivery life cycle
Leverages architecture components in solution development, codes solutions to integrate, clean, transform, and control data as per acceptance criteria
Develops and executes test plans to produce quantitative results, identifies test issues and errors, and triages underlying causes
Drives complex information technology projects to ensure on-time delivery and adheres to team delivery and release processes
Identifies, defines, and documents data engineering requirements, communicating required information for deployment, maintenance, support, and business functionality
Ability to work independently with solid analytical skills
Ability to work with the team; excellent team player with great attitude
Data Resiliency Capabilities

Top 3 skills:
1. Oracle & PL/SQL Knowledge (Expert level)
2. Hadoop ecosystem, Hive Tables
3. Python/PySpark

Preferred Skills:
1. Autosys
2. Agile

Other Required Skills:Strong knowledge of Oracle, SQL, RDBMS along with Python, Hadoop, Hive, Spark Experience in developing Hive & DBMS based applications Python programming background (scripting and object-oriented design) Coding experience with "big data" (Spark/PySpark, SQL, Hadoop, ETL development) Experience implementing statistical models in python (Jupyter notebooks, scipy, numpy, pandas, Scikit-learn) Machine learning experience or knowledge
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80183517
  • Position Id: f071c2a090a4fa0071cd3020aa763242
  • Posted 4 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Richardson, Texas

Today

Full-time

USD 22.50 - 25.00 per hour

Irving, Texas

Today

Easy Apply

Full-time

Depends on Experience

No location provided

Today

Full-time

No location provided

Today

Full-time

Search all similar jobs