Data Engineer
MetaSense, Inc.
Dice Job Match Score™
🤯 Applying directly to the forehead...
Job Details
Skills
- Extract, Transform, Load
- Data Engineering
- Core Data
- Continuous Integration
- Continuous Delivery
- Data Quality
- Distribution
- Documentation
- Cloud Computing
- Kubernetes
- Python
- Reporting
- SLA
- SQL
- Testing
- Apache Airflow
- Modeling
- Performance Tuning
- Scheduling
Summary
Implement best practices for DAG performance, dependency management, retries, SLA monitoring, and alerting
Optimize Airflow scheduler, executor, and worker configurations for high-concurrency workloads
Design and maintain robust dbt models (staging, intermediate, marts) following analytics engineering best practices
Implement dbt tests, documentation, macros, and incremental models to ensure data quality and performance
Optimize dbt query performance for large-scale datasets and downstream reporting needs
Design strategies for workload distribution, horizontal scaling, and resource optimization
Configure CPU/memory requests and limits, autoscaling, and pod scheduling for data workloads
Troubleshoot container-level performance issues and resource contention
Identify bottlenecks in query execution, orchestration, and infrastructure
Implement observability solutions (logs, metrics, alerts) for proactive issue detection
Ensure high availability, fault tolerance, and resiliency of data pipelines
Support financial reporting, accounting, and regulatory data use cases
Enforce data engineering standards, security best practices, and governance policies
Proven experience designing and supporting enterprise-scale data platforms in production environments
Expert-level DBT Core (data modeling, testing, macros, implementation)
Strong proficiency in Python for data engineering and automation
Deep understanding of Kubernetes and/or OpenShift in production environments
Extensive experience with distributed workload management and performance optimization
Strong SQL skills for complex transformations and analytics
Familiarity with containerized deployments, CI/CD pipelines, and Git-based workflows
- Dice Id: 10282828
- Position Id: 8926577
- Posted 14 hours ago
Company Info
Join MetaSense, Inc.™, a leading force in IT placement nationwide! As an Inc. 5000 award-winning talent and technology powerhouse, we're experiencing rapid growth and gaining widespread recognition. Our main office is in West Berlin, NJ, with a branch in Philadelphia, PA.
We're transforming the industry with our dedication to exceptional service.
When you join our dynamic team, you'll have the opportunity to make a real difference. Whether you're helping job seekers find their dream roles or providing essential staffing solutions to companies in transition, your role will be impactful. You'll work closely with our amazing team of Coaches, Staffing Consultants, and IT Professionals, understanding the unique needs of individuals and businesses, and delivering personalized career and talent solutions that lead to success.
At MetaSense, Inc., we value innovative thinking, practical solutions, and an unwavering commitment to excellence. With decades of combined experience in career coaching and staffing solutions, our leadership and staff are dedicated to creating strategies that help our clients thrive. We're passionate about our mission and driven to connect people with meaningful opportunities.
Join us at MetaSense, Inc. We are more than just a team – we’re family. Let us support you on your journey because, at MetaSense, your success is our top priority.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs