Title: Data Engineer_ ETL _ W2
Location: Durham, NC.
Skills
ETL, Scala, Spark, AWS, Cassandra, Snowflake, Control M
Top Skills Details
ETL,Scala,Spark,AWS,Cassandra,Snowflake,Control M
Description
We are currently sourcing for a Data Engineer (ETL) to work in our Durham, NC office!
Data Engineer
We are seeking a highly motivated Data Engineer to join the Data Aggregation team at Fidelity Brokerage. Data Aggregation is a growing area, and we are looking for a skilled engineer to drive design and development of industry leading external facing solutions. The comprehensive data solutions will seek to bring together retail, clearing and custody capabilities to help external FinTech partners with the financial goal planning, investment advice and financial projections capabilities to better serve our clients and more efficiently partner with them to accomplish their financial objectives.
The Expertise You Have
Bachelor’s degree in computer science, Information Systems, or a related field
Proven track record in data engineering
10+ years’ experience developing Spark Services for Data movement.
Schedule, Monitor and debug ETL Spark Batch.
Hands on Experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application.
Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs.
Utilizing Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte.
Experience with cloud-based data warehousing and data lake solutions such as Snowflake
Experience with data storage and data management for large datasets like parquet, HDF5, etc.
Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS.
The Skills You Bring
Champions innovative technology solutions to resolve sophisticated business problems
Works across groups to find opportunities for organization-wide technology initiatives
Brings external information, ideas, and expertise back to the team
Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning
Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples.
Collaborate with peers through code reviews, pair programming or interactive discussions daily.
Ability to work across multiple squads and adaptable to change.
Embrace customer-first mentality and enjoy developing user-friendly internet facing web applications that tackle real life problems.
Have a passion for following outstanding software engineering practices and always looking to improve your engineering skills and industry knowledge.
Bring a data-driven & collaborative approach to decision making, both in day-to-day work and in making strategic trade-offs.
Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others.