Big Data Engineer

Big Data, Hadoop eco system, Java, Python(nice to have), HDFS data distribution, processing, workflow, Hive/Impala/Spark/Oozie, On-prem
Full Time
Work from home not available Travel not required

Job Description

Title: Big Data Engineer (Data Engineer)
Location(s): San Francisco, CA or Salt Lake City, Utah

Remote option: This role is available for 2 days/week as a remote worker.

The Federal Reserve Bank of San Francisco believes in the diversity of our people, ideas, and experiences and are committed to building an inclusive culture that is representative of the communities we serve.

Work for the Fed:
We like to say we work for the Fed, not at the Fed. That s because the SF Fed is not just another employer or government agency. Here, you have the opportunity to become part of an important public service organization whose work touches lives across the globe.

The Federal Reserve Bank of San Francisco is looking for a Big Data Engineer for full time position here in our San Francisco, CA or Salt Lake City, Utah locations.

The Advanced Data and Analytics Capabilities (ADAC) team leads and develops solutions for various business lines in the system as well as National IT. We employ state of the art technologies that are part of the Hadoop ecosystem, which includes tools used for data integration, data modeling, and data analytics. You will have an opportunity to apply your critical thinking and technical skills across many disciplines.

In this role, you will contribute to high quality technology solutions that address business needs by developing solutions for the platform or applications for the customer business lines. You should have strong communication skills as you will work closely with other groups, including development and testing efforts of your assigned application components to ensure the successful delivery of the project.

Highlights of Responsibilities:
Develop code in Big Data environments using Java/Python/Scripting etc.
End-to-end solution implementation, including designing, developing, integrating, testing, deploying, and supporting solutions on Hadoop environment
Collaborate with Developers, DevOps, Release Management and Operations
Maintain security in accordance with Bank security policies
Participate in an Agile development environment by attending daily standups and sprint planning activities
Use your judgment and analytical skills in selecting methods, techniques and evaluation criteria for obtaining results
Develop, execute and document unit test plans and support application testing
Provide operational support for applications and utilities
Tackle issues and participate in defect and incident root cause analyses
Assist in the deployment of new modules, upgrades and fixes to the production environment
Independently determine methods and procedures on new assignments, and may provide work direction to others
Work on one or more projects as a team member designing and developing data solutions

Undergraduate degree in computer science, MIS, engineering, statistics, data science, related field, or equivalent work experience
Typically requires 5+ years data engineering, or software engineering experience, including knowledge of Big Data ecosystem
Experience in Java required. Python preferred and will need to understand and learn Python.
Experience with the Hadoop ecosystem including HDFS data distribution, processing, workflow, Hive/Impala/Spark/Oozie, On-prem
Experience programming and scripting on UNIX / Linux. (i.e. Python or Bash)
Experience with CTRL-M, Cron and scheduling of batch jobs and performing operational support
Passion for technology and data, a critical thinker, problem solver and a self-starter
Experienced quantitative and analytical skills; and strong attention to detail
Ability to communicate effectively (both verbal and written) and work in a team environment
Ability to balance multiple assignments and shift gears when new priorities arise
Familiar with Agile methodologies
Must be a Those authorized to work in the United States without sponsorship are encouraged to apply. with the intent to become a Those authorized to work in the United States without sponsorship are encouraged to apply.

Nice to have:
Working experience at Government or quasi-Government organizations
Cloud experience and using big data technologies on the Cloud

The Federal Reserve Bank of San Francisco is an Equal Opportunity Employer.

Dice Id : FRBSF
Position Id : 263171
Originally Posted : 3 weeks ago
Have a Job? Post it

Similar Positions

Bigdata Engineer
  • LeadStack, Inc.
  • San Francisco, CA
BigData Engineer
  • Logic Soft, Inc.
  • Concord, CA
Data Engineer
  • BayOne Solutions
  • San Francisco, CA
Senior Data Engineer
  • WWT Advanced Solutions
  • San Francisco, CA
Big data Engineer
  • Xebia US
  • San Francisco, CA
Big Data Engineer
  • Intone Networks Inc.
  • San Francisco, CA
Big Data Analytics with Azure- Remote
  • Sysintelli, Inc.
  • Oakland, CA
Data Engineer
  • Cloudious LLC
  • Concord, CA
Python/ Spark Data Engineer
  • Essani International LLC
  • Newark, CA
Kafka Specialist
  • New Digital IT Inc.
  • Fremont, CA
Big Data Engineer
  • SIGNin Solutions Inc.
  • Menlo Park, CA
Data engineer (C2C/W2-Contract/Full time)
  • Factspan Inc
  • Palo Alto, CA
Big Data Engineer
  • IndraSol
  • Menlo Park, CA