Technology Engineering Lead - NY/NJ/PA - Fulltime
Full Time
On-site
$100,000 - $120,000/yr
Promantis Inc
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Agile
- Analytics
- Apache Hive
- Artificial Intelligence
- Banking
- Bitbucket
- Business Analytics
- CA-7
- Change Management
- Cloudera Impala
- Communication
- Continuous Delivery
- Continuous Integration
- Data Engineering
- Data Quality
- Design Review
- ELT
- Enterprise Software
- Extract
- Transform
- Load
- Financial Services
- Git
- IT Management
- JIRA
- Linux
- Mentorship
- Oracle
- Performance Monitoring
- Performance Tuning
- PySpark
- Recovery
- SQL
- Scheduling
- Scripting
- Software Development Methodology
- Technical Direction
- Technical Drafting
- Testing
- Use Cases
Summary
Job Title: Technology Engineering Lead
Location: NY/NJ/PA - Onsite
Type: Fulltime
Job Description:
We are seeking an experienced Technology Lead to own the design and delivery of an enterprise batch feature store. The ideal candidate is a hands-on data engineering leader who can make sound architecture decisions, guide developers, and take complex data pipelines through to production.
Experience requirements
- 8+ years of experience in data engineering, data platforms, or enterprise application development.
- 5+ years of hands-on experience with PySpark, large-scale ETL/ELT development, and advanced SQL.
- 3+ years leading technical design and delivery for data engineering teams.
- Experience in banking or financial services is a plus.
Key responsibilities
- Lead the architecture, development, and production rollout of a batch feature store supporting analytics and AI use cases.
- Design scalable PySpark and Impala SQL pipelines that transform data from Hive and Oracle into consistent, reusable features.
- Define technical standards for feature logic, data quality, reconciliation, performance, monitoring, and failure recovery.
- Own batch scheduling and dependencies using CA7 or an equivalent platform.
- Provide hands-on technical direction through design reviews, code reviews, troubleshooting, and mentoring.
- Establish effective Git/Bitbucket, CI/CD, testing, and AI-assisted development practices.
- Coordinate production releases and change management in line with SDLC requirements.
- Work closely with business, analytics, and technology stakeholders to resolve requirements, communicate trade-offs, and deliver against milestones.
- Plan and track work in an Agile environment using Jira.
Required skills
- Advanced PySpark and Impala SQL, including query and pipeline performance tuning.
- Proven experience designing enterprise-scale ETL/ELT pipelines.
- Strong expertise with Hive and Oracle data platforms.
- Experience with CA7 or equivalent batch scheduling.
- Proficiency in Linux scripting, Git/Bitbucket, and CI/CD.
- Working knowledge of Agile delivery, Jira, SDLC, production release, and change management.
- Practical experience with AI-assisted development tools.
- Strong communication skills and a track record of leading delivery across multiple stakeholder groups.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91007012
- Position Id: 9120045
- Posted 2 days ago
Company Info
About Promantis Inc
Since 2007, Promantis has been offering competitive services in consulting, technology and outsourcing. With scalability and flexibility to support long-term growth, we leverage this people advantage coupled with technology to develop industry-specific solutions in the domains of Health, Insurance, Telecommunications, Service, Pharmacy, Retail, Banking and Government.
Promantis offers services ranging from Contract Consulting, Staff Augmentation Services, Enterprise Application Solutions, Software Application Solutions, Systems and Network Engineering to Service and Support. Promantis has an expert staff of consultants waiting to assist you. This includes Project Managers, Business System Analysts, Functional Consultants, and Technical Consultants with skills ranging from legacy systems to the latest technologies.
As a recognized leader providing customized software services and solutions to companies around the world, our ability to deliver is a granted that makes companies put their trust in us to answer their day-to-day business challenges and put them on a path for greater success.
Careers
Promantis offers services ranging from Contract Consulting, Staff Augmentation Services, Enterprise Application Solutions, Software Application Solutions, Systems and Network Engineering to Service and Support. Promantis has an expert staff of consultants waiting to assist you. This includes Project Managers, Business System Analysts, Functional Consultants, and Technical Consultants with skills ranging from legacy systems to the latest technologies.
As a recognized leader providing customized software services and solutions to companies around the world, our ability to deliver is a granted that makes companies put their trust in us to answer their day-to-day business challenges and put them on a path for greater success.
Careers
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.