Data Engineer
Zenox Global, LLC
Dice Job Match Score™
🔗 Matching skills to job...
Job Details
Skills
- Apache Spark
- PySpark
- CI/CD
- Control-M
- Airflow
Summary
Job Title: Data Engineer
Location: Pittsburgh, PA, Cleveland, OH, or Dallas, TX – (5 days Onsite) - Local to any of these locations
Job Type: Permanent Full Time
Required qualifications to be successful in this role:
- 5+ years of experience in data engineering and big data processing
- Strong expertise in Apache Spark (Spark Core, Spark SQL) and PySpark for large-scale batch processing
- Experience working with structured and semi-structured data, including complex transformations and performance tuning
- Proficiency in data ingestion and integration from sources like Oracle, SQL Server, Hive, HDFS, and S3; transform data into ‘curated data models''
- Experience writing data to Hive tables, Data Lakes (Iceberg), and downstream reporting systems
- Strong knowledge of SQL and data modeling concepts
- Hands-on experience with Apache Airflow for workflow orchestration (DAG design, scheduling expectations, monitoring)
- Proficiency in shell scripting for job automation, file validation, dependency handling, and logging. Trigger Spark Jobs, perform file checks and validation; Archive & purge data; mange job dependency, logging & error handling
- Strong understanding of batch processing and batch job scheduling frameworks
- Experience migrating from CA7/Control-M Airflow (daily, hourly, weekly schedules) CI/CD for data pipelines
- Experience ensuring data quality, reliability, and compliance in regulated environments
- Good communication and documentation skills
- Dice Id: 91165942
- Position Id: 9011907
- Posted 7 days ago
Company Info
Established in 2020, Zenox Global embarked on a mission to redefine staffing solutions. From our inception, we recognized the evolving needs of businesses and the workforce, driven by a commitment to innovation and excellence.
In our early days, we focused on building a robust network of talent and establishing strong relationships with clients across various industries. By understanding the unique challenges each sector faced, we tailored our approach to deliver customized staffing solutions that aligned with our clients' strategic goals.
In 2021, we expanded our services to include specialized recruitment sectors, allowing us to cater to a broader range of client needs. Our commitment to diversity and inclusion became a cornerstone of our strategy, ensuring that we provided opportunities for all candidates while enhancing the talent pool available to our clients.
As we progressed into 2023, the foundation we built allowed us to thrive in a competitive market. Our reputation for delivering high-quality candidates promptly made us the go-to staffing solution for numerous organizations. We invested in technology, utilizing advanced tools for candidate sourcing and management, which streamlined our operations and improved efficiency.
Now, as we look forward to the future, Zenox Global continues to embrace innovation and remain ahead of industry trends. Our journey is not just about providing staffing solutions; it is about forging lasting partnerships and creating a positive impact on the workforce landscape. We remain dedicated to supporting our clients and candidates as we navigate the ever-changing world of employment together.
With each milestone, we strengthen our resolve to be at the forefront of staffing solutions, ensuring that we are not only meeting today’s needs but also anticipating tomorrow's challenges.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs