Job ID: 43393
***Not able to use 3rd Party Agencies***
Senior Data Engineer
Our client is hiring a Senior Data Engineer for their team in Beaverton, Oregon. As the Senior Data Engineer, you will be working on development projects related to consumer behavior, commerce, and web analytics.
Senior Data Engineer Responsibilities
Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem.
Ability to design and implement end to end solution.
Build utilities, user defined functions, and frameworks to better enable data flow patterns.
Research, evaluate and utilize new technologies/tools/frameworks centered around Hadoop and other elements in the Big Data space.
Build and incorporate automated unit tests, participate in integration testing efforts.
Work with teams to resolving operational & performance issues.
Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
Senior Data Engineer Qualification
MS/BS degree in a computer science field or related discipline.
6+ years' experience in large-scale software development.
2+ year experience in Hadoop/Big Data.
Strong development skills around Hadoop, Spark, Hive.
1+ years' experience in workflow orchestration tools like Airflow.
Strong skills in Python, shell scripting, and SQL.
Experience with AWS components and services, particularly, EMR, S3, and Lambda.
Good understanding of file formats including Parquet, Avro, JSON and others.
Good understanding of R, TensorFlow, SAS or similar.
Experience with performance/scalability tuning, algorithms and computational complexity.
Experience (at least familiarity) with data warehousing, dimensional modeling and ETL development.
Proven ability to work cross functional teams to deliver appropriate resolution.
Front end UI development experience, specifically Node JS or Angular JS.
Machine learning frameworks.
Benefits are available to eligible VanderHouwen contractors and include coverage for medical, dental, vision, life insurance, short and long term disability, and matching 401k.
VanderHouwen is an award-winning, Women-Owned, WBENC certified professional staffing firm. Founded in 1987, VanderHouwen has been successfully placing experienced professionals throughout the Pacific Northwest and nationwide. Our recruitment teams are highly specialized in either Technology and IT, Engineering, or Accounting and Finance career markets. Our recruiters value building meaningful, professional relationships with each candidate as well as developing honed knowledge of companies' staffing needs and workplaces. Partner with us to land your next exciting career.
VanderHouwen is an Equal Opportunity Employer and participates in E-Verify. VanderHouwen does not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other characteristic protected by applicable local, state or federal civil rights laws.