GENERAL PURPOSE:
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based data processing solutions to support scalable and efficient data movement into enterprise data platforms and data lakes. The role requires strong expertise in cloud-based architecture, middleware, and secure data transfer mechanisms. It also includes providing L3 production support, troubleshooting complex data pipeline issues, and enhancing system reliability and performance. Additionally, the engineer collaborates with cross-functional teams to implement best practices, automation, and continuous improvements.
The base salary range for this role is $113,200 - $195,000. The base salary range is dependent on factors including, but not limited to, experience, skills, qualifications, relevant education, certifications, seniority, and location. The range listed is just one component of the total compensation package for employees. Other rewards vary by position and location.
ESSENTIAL FUNCTIONS:
Design, develop, and maintain scalable data ingestion pipelines using StreamSets or similar technologies.
Develop, enhance, and optimize Python scripts for efficient data processing, transformation, and integration across multiple systems.
Implement data ingestion solutions aligned with cloud architectures and enterprise data lake strategies.
Monitor, troubleshoot, and resolve complex production issues, providing L3 support and ensuring system stability.
Collaborate with cross-functional teams to design solutions, implement automation, and follow best practices in delivery.
Ensure secure data handling by applying knowledge of networking, authentication, SSL, certificates, and related protocols.
Maintain technical documentation, operational procedures, and ensure adherence to change management and testing standards.
COMPETENCIES:
People
Building Effective Teams
Developing Talent
Collaboration
Self
Leading by Example
Communicates Effectively
Ensures Accountability and Execution
Manages Conflict
Business
Business Acumen
Plans, Aligns and Prioritizes
Organizational Agility
With particular emphasis on the following specific position-related competencies:
Dealing with Ambiguity
Interpersonal Effectiveness
Drive for Results
Technical Competence/Expertise
QUALIFICATIONS AND SPECIAL SKILLS REQUIRED:
Minimum 7 years of experience in software engineering, with extensive hands-on experience designing and managing StreamSets pipelines, including Control Hub operations, pipeline orchestration, and implementing standard data ingestion patterns for batch and real-time processing.
Bachelor's degree in computer science, Information Technology, or related field (or equivalent experience).
Strong hands-on experience with StreamSets or similar data ingestion/integration platforms.
Proficiency in Python development for data processing, transformation, and automation.
Solid understanding of cloud platforms (AWS, Azure, or Google Cloud Platform) and data lake architectures.
Experience working with structured and semi-structured data formats (JSON, XML, CSV, etc.).
Strong knowledge of operating systems (Linux/Windows), networking, and system-level concepts.
Experience with security protocols including SSL, certificates, authentication, and secure data transfer mechanisms.
Familiarity with JDBC, Java-based applications, and integration with databases and enterprise systems.
Proven ability to troubleshoot complex production issues, provide L3 support, and optimize system performance.
Strong analytical, problem solving, and debugging skills
Excellent oral and written communication skills.
PHYSICAL REQUIREMENTS/ADA:
Job requires ability to work in an office environment, primarily on a computer.
Requires sitting, standing, walking, hearing, talking on the telephone, attending in-person meetings, typing, and working with paper/files, etc.
Consistent timeliness and regular attendance.
Vision requirements: Ability to see information in print and/or electronically.
This position may be performed remotely anywhere within the United States. #LI-Remote
SUPERVISORY RESPONSIBILITIES:
None
DISCLAIMER:
This job description is a summary of the primary duties and responsibilities of the job and position. It is not intended to be a comprehensive or all-inclusive listing of duties and responsibilities. Contents are subject to change at management's discretion.
Ross is an equal employment opportunity employer. We consider individuals for employment or promotion according to their skills, abilities and experience. We believe that it is an essential part of the Company's overall commitment to attract, hire and develop a strong, talented and diverse workforce. Ross is committed to complying with all applicable laws prohibiting discrimination based on race, color, religious creed, age, national origin, ancestry, physical, mental or developmental disability, sex (which includes pregnancy, childbirth, breastfeeding and medical conditions related to pregnancy, childbirth or breastfeeding), veteran status, military status, marital or registered domestic partnership status, medical condition (including cancer or genetic characteristics), genetic information, gender, gender identity, gender expression, sexual orientation, as well as any other category protected by federal, state or local laws.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10102130
- Position Id: f04a116a26c478c3c28d23fe379b9e95
- Posted 30+ days ago
Never miss an opportunity! Create an alert based on the job you applied for.
