Big Data Engineer

company banner
Robert Half
Engineer, Business Intelligence, Python, SQL, Informatica, API, Database, Application
Full Time

Job Description

Description

As a Data Engineer on the Data Integration team your primary focus is to design and build durable data pipelines. You will be working on data integration processes to enable our growing Business Intelligence and Data Science teams. You will work both on-premise and in the cloud with a focus on modernizing our data pipelines and integration strategy to increase data accuracy and availability, lower support cost, and increase speed to shelf. We are looking for people who can be great individual contributors who are also open to pair programming and have a willingness to learn and work with new technologies.
KEY RESPONSIBILITIES
· Build performant and scalable data pipelines
· Create, monitor, and maintain data pipelines
· Ensures new and existing code meets company standards for readability, testability, automation, documentation and performance
· Pair with other team members to increase efficiency and collaboration
· Continually bring features from conception to production, leveraging a DevOps mindset
· Integrate with both existing legacy systems and new modern systems
· Provide after hours on-call support on a rotational basis
KNOWLEDGE, SKILLS AND EXPERIENCE
Required
· Proficient with a programming language (Python)
· Proficient with SQL
· Experience designing, modeling, and implementing snowflake, star, and relational data models.
· Experience using ETL/ELT tools (e.g. SSIS, Informatica) and best practices
· Ability to independently troubleshoot issues, think critically, and clearly communicate findings/recommendations
· Experience using workflow management/orchestration tools (Airflow)
· Experience working on stream-processing systems (Google Pub/Sub, Kafka, etc.)

Advantageous
· Experience using CI/CD technologies (Concourse, Jenkins, Travis CI, etc.)
· Experience building containerized applications (Kubernetes, Docker, etc.)
· Experience with streaming analytics (e.g. Spark, Google Dataflow, Azure Streaming Analytics, etc.)
· Knowledge of cloud databases (e.g. Azure Synapse, Google BigQuery, Snowflake, etc.)
· Experience ingesting data via API's
· Experience with centralizing data from disparate sources, transforming data, and resolving data conflicts

Requirements

Azure SQL Database, Google Cloud Platform, Application Integration, Continuous Integration / Continuous Delivery (CICD), BigSQL, ETL-SSIS

Technology Doesn't Change the World, People Do.®

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half puts you in the best position to succeed by advocating on your behalf and promoting you to employers. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - even on the go. Download the Robert Half app and get 1-tap apply, instant notifications for AI-matched jobs, and more.

Questions? Call your local office at All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals. Visit https://roberthalf.gobenefits.net/ for more information.

© 2021 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use.


Company Information

Robert Half is America’s top staffing agency, dedicated to helping talented people like you find rewarding temporary and full-time jobs with today’s leading companies. Our staffing experts work closely with local hiring managers and use AI-powered matching technology to find opportunities that match your skills and professional goals. With decades of experience in placing accounting, finance, administrative, technology, creative, marketing and legal professionals, we’ll help ensure your next career move is a successful one.
Our staffing services
Accountemps – Temporary and temp-to-hire jobs for accounting and finance professionals
Robert Half Finance & Accounting – Full-time positions for accounting and finance professionals
Robert Half Management Resources – Project and interim roles for senior-level finance, accounting and business systems professionals
Robert Half Technology – Project and full-time roles for IT professionals
OfficeTeam – Temporary and temp-to-hire positions for administrative professionals
The Creative Group – Freelance and full-time roles for creative, digital, marketing, advertising and public relations professionals
Robert Half Legal – Project positions and full-time roles for legal professionals

Dice Id : rhalfint
Position Id : 01500-0011988205
Originally Posted : 2 months ago

Similar Positions at Robert Half

Big Data Engineer
  • West Des Moines, IA
  • 8 hours ago
Senior Data Engineer
  • Des Moines, IA
  • 1 day ago
Big Data Engineer
  • Bloomington, MN
  • 1 day ago
Big Data Engineer
  • Chicago, IL
  • 1 day ago
Hadoop Big Data Engineer
  • Wichita, KS
  • 1 day ago
Big Data Engineer
  • Oklahoma City, OK
  • 1 day ago
Big Data Engineer
  • Wyomissing, PA
  • 1 day ago
Big Data Engineer
  • King Of Prussia, PA
  • 8 hours ago
Data Scientist
  • Omaha, NE
  • 1 day ago
Data Architect
  • Overland Park, MO
  • 8 hours ago