Job Title: Data Engineer
Hiring Company: Epik Solutions
Location: Remote - USA
Employment Type: Long Term Contract
Pay Rate Range: $55/hr-$57/hr on W2
Job Description:
Key Responsibilities
- Design, develop, and support end to end data pipelines from source systems through curated analytics datasets
- Build and optimize batch and incremental pipelines using Spark based technologies
- Implement lakehouse and data warehouse design patterns, including layered/medallion architectures and dimensional models
- Develop data transformations using Python and PySpark, including joins, aggregations, window functions, deduplication
- Leverage Delta Lake features (e.g., ACID transactions, MERGE, schema evolution, partitioning, optimization) to ensure scalable and reliable data processing
- Deliver and operate solutions in Databricks, including jobs/workflows, cluster usage, performance tuning, and production support
- Build and support data solutions including Lakehouse/Warehouse assets, Pipelines, notebooks, and operational monitoring
- Ensure pipelines are production ready with monitoring, alerting, error handling, reruns, and clear operational documentation
- Troubleshoot and resolve performance, data quality, and reliability issues in production environments
- Experience in Oracle Cloud
- Collaborate with reporting, analytics, and business stakeholders to deliver trusted, analytics ready datasets
Required Technical Experience
- Data Engineering (General)
- Strong experience delivering end to end data engineering solutions in production
- Deep understanding of ETL/ELT patterns, incremental processing, and data quality controls
- Big Data & Lakehouse
- Hands on experience with Delta Lake and large scale data processing concepts
- Experience designing and operating layered data architectures (e.g., bronze/silver/gold)
- Databricks
- Practical, hands on experience using Databricks for production workloads
- Experience with job orchestration, performance tuning, and operational support
- Programming
- Strong Python and PySpark experience for data transformations
- Solid SQL skills for data modeling, transformations, and analytics use cases
- Data Modeling
- Experience designing dimensional (star) schemas, curated analytical datasets, and reporting friendly data structures
Desired / Nice to Have Experience
- Modernizing or migrating legacy ETL/BI solutions to cloud platforms
- Performance and cost optimization in Azure environments
- Experience supporting analytics, BI, or reporting teams
- Familiarity with CI/CD and environment promotion (Dev/Test/Prod)
Epik Solutions is an Equal Opportunity Employer. All qualified applicants are encouraged to apply and will receive consideration for employment. All employment decisions at Epik are based on business needs, job requirements and individual qualifications and merit, without regard to race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or any other status protected by applicable law or regulations. Epik participates in the E-Verify program.
Never miss an opportunity! Create an alert based on the job you applied for.
