DATA ENGINEER

company banner
Randstad Technologies
DATA ENGINEER
Full Time
USD180,000 - USD200,000

Job Description

job summary:

Our client, a growing Financial Services firm is looking for a Senior Data Engineer to improve critical data systems used widely by internal and external stakeholders. The ideal candidate is someone who:


  • Has 5+ years of data engineering experience developing large data pipelines
  • Has solid experience developing in Python.
  • Has solid experience with relational SQL and NoSQL databases


Required Skills


  • Solid experience developing in Python.
  • 5+ years of data engineering experience developing large data pipelines
  • Solid SQL and NoSQL skills and ability to create queries to extract data and build performant datasets.
  • Experience with relational SQL and NoSQL databases, any RDBMS (Oracle, Postgres) and NoSQL (Cassandra, Mongo, or Redis, etc.).
  • Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data.
  • Hands-on experience with message queuing and stream data processing (Kafka Streams).
  • Solid analytic skills related to working with unstructured datasets.
  • Hands-on experience in using AWS cloud services: EC2, Lambda, S3, Athena, Glue, and EMR.


Pluses


  • Java or Scala.
  • Redshift/Snowflake.
  • Experience in the Financial Services industry

 

location: NEW YORK, New York

job type: Permanent

salary: $180,000 - 200,000 per year

work hours: 8am to 4pm

education: Bachelors

 

responsibilities:


  • Build data pipelines and applications to stream and process datasets at low latencies.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, NoSQL, Kafka using AWS Big Data technologies.
  • Collaborate with Data Product Managers, Data Architects, and other Data Engineers to design, implement, and deliver successful data solutions.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Track data lineage, ensure data quality and improve discoverability of data.
  • Work in Agile Environment (Scrum) and interact with multi-functional teams (Product Owners, Scrum Masters, Developers, Designers, Data Analysts)



 

qualifications:


  • Experience level: Experienced
  • Minimum 5 years of experience
  • Education: Bachelors (required)
 

skills:
  • Data Warehouse (6 years of experience is required)
  • NoSQL (6 years of experience is required)
  • AWS (8 years of experience is required)
  • SQL (8 years of experience is required)
  • pyspark (6 years of experience is required)
  • kafka (6 years of experience is required)
  • Excel (5 years of experience is required)
  • agile (6 years of experience is required)



  • Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

    At Randstad, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.







    For certain assignments, Covid-19 vaccination and/or testing may be required by Randstad's client or applicable federal mandate, subject to approved medical or religious accommodations. Carefully review the job posting for details on vaccine/testing requirements or ask your Randstad representative for more information



    Company Information

    As one of North America’s largest and most trusted technology talent and solutions firms, Randstad Technologies provides collaborative, customizable solutions to companies of all sizes. Whether we’re helping you find the right job — or the right person for your team— or providing consulting, project or outsourcing services, Randstad Technologies is fully committed to supporting you.

    We accomplish that by leveraging our knowledge, experience, and innovative practices to uncover opportunities and provide solutions to your technology challenges. As a critical division of the world’s largest HR services firm, we’ve served clients across all industries since 1994.

    We offer discrete professional services focused on applications, infrastructure, end-user, and engineering services, along with shared services internally and client-facing related to PMO and strategy. The wealth of knowledge we’ve acquired over three decades of work in IT sets us apart from the competition.

    Dice Id : cxsapwma1
    Position Id : 932840
    Originally Posted : 1 month ago

    Similar Positions at Randstad Technologies

    Data Engineer
    • New York, NY
    • 17 hours ago
    Lead Data Engineer
    • New York, NY
    • 17 hours ago
    Senior Cloud Data engineer
    • New York, NY
    • 17 hours ago
    Data Analytics Engineer
    • , NJ
    • 17 hours ago
    Cloud/Data Engineer
    • Merrimack, NH
    • 17 hours ago
    Principle Analyst (Data Analytics)
    • Orange, CT
    • 17 hours ago
    Cloud Data Engineer
    • Pittsburgh, PA
    • 17 hours ago
    Data Engineer
    • Saint Louis, MO
    • 17 hours ago
    DATA ENGINEER
    • Houston, TX
    • 17 hours ago