Data Engineer

Agile, Amazon Web Services, Apache Kafka, Big data, Business requirements, Cloud, Data analysis, Data engineering, Data marts, Data science, Database, Documentation, ETL, Python, QA, RDBMS, Real-time, Snow flake schema, Software development, Streaming, Transformation
Full Time
Depends on Experience
Work from home not available Travel not required

Job Description

Data Engineer

Position Summary :

Under general supervision, utilizes expertise to design, model, develop, construct, maintain and support data pipelines/database systems for analytical and business applications. Provides support to our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent across projects. Identifies and uses technology to solve data problems. Demonstrates ability to choose the right method, standards and techniques to use in delivery, practicality in solutions and creativity in solving problems.

Essential Duties and Responsibilities :

  • Leverages agile strategies to understand and solve business problems while collaborating on technical decisions and their implantation.
  • Consistently engages as a member of self-organized high-performing team focused on delivering continuous value.
  • Shares in the ownership of the ongoing support and takes responsibility for the team s solutions.
  • Influences peers on the team with questions and insight.
  • Identifies, analyzes, and documents business/technical requirements and systems specifications.
  • Specializes at least in one of these areas: data pipelines, database systems, stream processing, big data tools, programming, cloud infrastructure
  • Identifies ways to improve data reliability, efficiency and quality.
  • Builds the infrastructure required for optimal ingestion and transformation of data in real-time/batch and uses programming languages/tools to assemble large, complex data sets that meet business requirements.
  • Develops, constructs, tests and maintains streaming and batch data pipeline architectures to build data marts.
  • Uses stream processing to produce value added business events for downstream consumers.
  • Evaluates vendor-supplied applications and deploys/integrates vendor-supplied software.
  • Builds simple solutions to complex business problems through technology innovation and process improvements while owning the full lifecycle of each product.
  • Leverages knowledge of design patterns, architecture, infrastructure, and frameworks at an enterprise scale for fault-tolerant solutions with exceptional quality.
  • Communicates status of assigned work to management and follows practices and procedures covered by precedents, standards, or policies.
  • Ensures the efficient development of effective information systems through a variety of duties including projection of budgetary constraints, generation/presentation of users training material, and expansion of personal knowledge of applicable technical platforms and applications.
  • Seeks guidance when direction is needed and speaks up about technology risks identified and owns addressing them with the team
  • Among others, utilizing the following tools: Cloud based platform solutions, Snowflake, Kafka, Python, Kafka, RDBMS (Db2, PostgreSQL), Git, AWS, Docker and additional software tools as need to solve data problems.
  • Performs a variety of other duties as assigned.

Qualifications :

Education, License or Certification:

  • Bachelor s degree in Information Systems or equivalent experience.

Experience:

  • 1-3 years of experience in data engineering

Posted By

Michelle Kann

One Premier Dirve B2 Fenton, MO, 63026

Dice Id : RTX15307b
Position Id : 6417896
Originally Posted : 2 weeks ago
Have a Job? Post it