Senior Data Engineer

company banner
The Judge Group
Agile, Analysis, Hadoop, Java, Libraries, Metrics, Python, Security, SQL, Unix
Full Time, Full Time
Negotiable
Telecommuting not available Travel not required

Job Description


Our client is currently seeking a Senior Data Engineer. If you believe your skill set aligns with the description below, please send updated resume to nsharma01@judge.com
*THIS IS A FULL-TIME/PERMANENT OPPORTUNITY*

About the Job
Data is an essential part of our client's business. We use it to build financial profiles for our users, to inform product and business strategy, and to understand and optimize every aspect of our service.
Data engineers work with data scientists, product managers, fellow engineers and other internal stakeholders. We design internal data services and tools, develop pipelines and APIs for our various data feeds, build libraries and frameworks to enable new types of analysis for our data science team, and instrument, measure and monitor key metrics within the company.
As a senior data engineer you'll be a member of a small team with a big impact. You will create systems that shape the future of how our client uses data. Your work will reach millions of people worldwide, and help bring modern financial services to the developing world.
Responsibilities
* Build data pipelines and frameworks to automate ETL for batch and streaming data
* Define and lead the build out of architectures and best practices for big data processing
* Decompose complex data handling challenges to design robust, fault-tolerant systems
* Recommend and implement ways to improve data reliability, efficiency, transparency and quality
* Manage, scale and operate data system infrastructure
* Work with Product Owners, Developers, Data Scientists and Customers in a collaborative and agile environment

Qualifications
* Prior experience working on data intensive systems building robust ETL pipelines
* Comfortable working in a UNIX environment
* Experience writing high quality code in Python, Java, Go, Clojure or a similar general purpose language
* Background working with distributed data processing frameworks (Spark, Hadoop, etc) and understand when to use them (and when not to)
* Solid understanding of SQL and relational databases
* Experience defining large data systems including provisions for security, availability and recovery
* Experience with deployment tools and infrastructure such as Terraform, Ansible, Docker, Teamcity or equivalents
* Experience with AWS infrastructure provisioning and configuration

 

ID: 588425
Type: Contingency
Salary: Open


Company Information

The Judge Group is a privately-owned, leading professional services firm. What does that mean? It means we provide technology, talent and learning solutions to businesses around the globe, and we're great at it. Our expertise is positioned at the crossroads of people and technology—two of the most important aspects of successful business today.
Dice Id : cxjudgpa
Position Id : 588425

Similar Positions at The Judge Group

Big Data Developer
  • San Francisco, CA
  • 20 hours ago
Sr. DevOps, Engineering
  • San Francisco, CA
  • 20 hours ago
Sr. Full stack Enterprise App Developer
  • San Francisco, CA
  • 20 hours ago
Senior Software Engineer
  • Oakland, CA
  • 20 hours ago
Sr. Systems Engineer I
  • San Francisco, CA
  • 20 hours ago
Sr. Systems Engineer 2
  • San Francisco, CA
  • 20 hours ago
Sr. Tableau Developer
  • San Francisco, CA
  • 20 hours ago
Solution Architect, Sr.
  • San Francisco, CA
  • 20 hours ago
Sr. Engineer, DevOps
  • Pleasanton, CA
  • 20 hours ago
Senior DevOps Engineer
  • San Jose, CA
  • 20 hours ago