Data Engineer

Remote • Posted 30+ days ago • Updated 6 days ago
Full Time
No Travel Required
Remote
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Snowflake
  • DBT
  • SQL
  • Python
  • data Pipelines
  • Medallion

Summary

Data Engineer

The Data Engineer is a hands-on technical role focused on full stack software development within the Enterprise Data organization.  The role will play curtail part in shaping future big data and analytics initiatives. 

 

PRINCIPAL RESPONSIBILITIES:

·       Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services.

·       Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data.

·       Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python.

·       Data modeling and building Data Warehouse using Snowflake, DBT.

·       Designs and develops code and data pipelines to ingest relational databases, file shares, and web services.

·       Participates in requirements definition, system architecture design, and data architecture design.

·       Participates in all aspects of the software life cycle using Agile development methodologies.

·        Experience designing and implementing Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data platforms.

·       Hands-on experience with SQLDBM for data modeling, schema design, and data warehouse architecture documentation.

·       Experience developing conceptual, logical, and physical data models using SQLDBM and collaborating with business and technical stakeholders on model reviews.

 


MINIMUM QUALIFICATIONS:

·       Bachelor’s degree in computer science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required).

·       Experience in AWS services for data and analytics (required).

·       5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required).


PREFERRED QUALIFICATIONS:

·       7+ years of experience in Enterprise Information Solution Architecture, Design, and development required.

·       7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies.

·       7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology.

·       5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required.

·       5+ years’

·       Experience with JSON or XML data modeling required.

·       Experience with Git/GitHub, branching, and other modern source code management methodologies required.

·       Domain knowledge of NoSQL or relational database required.

·       Understanding of database architecture and performance implications required.

·       Experience integrating Business Intelligence applications like PowerBI.

·       Experience with Machine Learning and Artificial Intelligence.

·       Ability to multi-task effectively.

·       Ability to work collaboratively as part of an Agile Team.

·       Extensive knowledge and experience with Python and Snowflake Streamlit.

·       Excellent written and verbal communication skills, sense of ownership, urgency and drive.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90768808
  • Position Id: 9103904
  • Posted 30+ days ago
Contact the job poster
JG

Jyothi Guntapati

Recruiter @ Sahi Softtech

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.