Senior Big Data Software Engineer

Full Time
Market related
Work from home not available Travel not required

Job Description

What is your favorite “Big?” Ben? Lots? O? Data? If that last one pique your interest, please read on. We need talented software engineers who love creating innovated solutions for real-time streaming and storage of massive amounts of data. You’ll be working to solve big data challenges in a fast-paced environment. How about “Big” the movie? Now that’s a classic. No offense, but I think that’s my favorite “Big.”

Your role:

  • Design, build and maintain near real-time big data applications and pipelines to process billions of records into and out of high-performance layers and data lakes
  • Lakes? Now that’s a lot of data…
  • Characterize and optimize application and pipeline performance
  • Troubleshoot and resolve data processing issues
  • Engage in application design and data modeling discussions
  • Engage in engaging discussions of any sort, example topics include: “Do woodpeckers get headaches?”, “Dutch tax laws during the Eighty Years’ War”, or bees
  • Participate in developing and enforcing data security policies
  • Participate in capacity monitoring and planning
  • Actively incubate new technologies and tools for big data initiatives
  • Build, maintain and execute unit test cases with high coverage
  • Work closely with other data and analytics team members to optimize the company’s data systems and pipeline architecture

What you’ve got:

  • Bachelor’s degree required in Computer Science or related field, advanced degree preferred
  • 7+ years programming in Java, Python
  • At least 3 years developing on Hadoop/Spark
  • 4+ years developing on an RDBMS such as PostgreSQL, MySQL or Oracle
  • Exposure to data hygiene routines and models
  • Exposure to personal hygiene also required
  • Experience in database design, development and data modeling
  • No actual modeling experience required – there will be no cat walks
  • Ability to work in a dynamic multi-team environment, as well as independently
  • Deep understanding of highly available distributed systems architecture and development
  • Full software development life-cycle experience with a proven track record of shipping products
Dice Id : 10107731
Position Id : 3514
Have a Job? Post it