Data Engineer
Techstra Solutions
Dice Job Match Score™
🛠️ Calibrating flux capacitors...
Job Details
Skills
- Big Data
- Apache Spark
- Continuous Integration
- Data Integration
- Apache Airflow
- Data Lake
- Databricks
- ELT
- Continuous Delivery
- IoT
- PySpark
- Python
- Pandas
- Apache Kafka
- Oracle
- MySQL
- RESTful
- Apache Hadoop
Summary
Role Overview
We are seeking an experienced Data Engineer contractor to support our operations. This individual will design, build, and optimize data pipelines and infrastructure, enabling advanced analytics, process automation, and data-driven decision-making. The Data Engineer will work closely with data scientist, process engineering, and IT teams to ensure data reliability and actionable insights across the manufacturing lifecycle.
Key Responsibilities
- Develop/maintain scalable and reliable data pipelines for industrial data (like real-time streaming, time series, IoT, sensors, MES, ERP systems data)
- Integrate data from different sources (databases, clouds, on premises) and Engineer workflows for efficient ETL/ELT processing and data validation.
- Collaborate with architects, data engineers, data scientists, analysts, and business stakeholders to define and deliver solutions.
- Collaborate with IT admins, network/security engineers, and cross-functional teams to support stable production operations and troubleshoot infrastructure issues (including managing and integrating IaaC, PaaS, and SaaS solutions).
- Capable of managing backlog, supporting QA/testing, and communicating requirements with business stakeholders in the steel manufacturing domain.
- Mentoring team members, providing guidance, facilitating skill growth, offering technical coaching, and encouraging best practices across teams via code reviews.
- Build and maintain data infrastructure in compliance with data governance and security best practices
- Bachelor’s degree in computer science or related fields with 5+ years’ experience as a Data Engineer.
- Strong experience in building, maintaining, and optimizing ETL/ELT data pipelines using Python, Pandas, PySpark and orchestrating workflows like Apache Airflow and Kedro framework.
- Advanced SQL/ KQL query development and optimization across Oracle, MSSQL, and MySQL databases (hosted on-premises or via PaaS offerings).
- Developing and consuming Flask-based and Fast API RESTful APIs for data services and integration.
- Proficiency in Linux shell scripting for automation and data workflow management.
- Experience with DevOps practices, including CI/CD for data pipelines and use of tools such as Git, Docker, and IaaC frameworks for provisioning and deployment.
- Hands-on experience deploying solutions across multiple clouds (OCI, Azure, Google Cloud Platform), including the setup of cross-cloud data integration and transfer techniques.
- Experience with cloud platforms (OCI, Azure, Google) and big data tools (Spark, Hadoop, Kafka, Databricks)
- Understanding data modeling, data profiling, data quality, data lake/warehouse architectures, and data indigestion from operational technologies.
- Familiarity with industrial protocols, time-series databases (like OSIsoft PI), and manufacturing data (MES, PLC)
- Strong troubleshooting, process automation, and root-cause analysis skills
Preferred Qualifications
- Role Responsibility Area Preferred Tools & Skills
- Data Ingestion Pipeline Python, PySpark, Airflow, Kedro, Linux shell scripting
- API Development Flask, Fast API, RESTful design
- Data Storage & Querying SQL (Oracle, MSSQL, MySQL), KQL (Azure Data Explorer), Bigdata (Hadoop, Oracle BDS), OSIsoft PI
- Cloud Integration Multi-cloud platforms (OCI, Azure, Google Cloud Platform), Data Sharing across cloud (Data Bricks)
- Real-Time Data Streaming Kafka, Azure Event Hub, EMQX
- Reporting Tools Tableau, OAC, Power BI
- Collaboration Wiki, Azure DevOps Boards, MS Office 365
- Data Governance & Quality Data profiling/validation tools (Pandas Profiling), SaaS monitoring (e.g., Great Expectations), lineage tracking (Cloud Data Catalogs)
Locations: Pittsburgh, PA
About Techstra Solutions
Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information:
Equal Employment Opportunity Statement
Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.
- Dice Id: 91115673
- Position Id: 8926189
- Posted 5 hours ago
Company Info
About Techstra Solutions
Techstra Solutions helps companies achieve the business value of Digital and Talent Transformation. Our client-focused services include strategy, technology and innovation in the areas of Cloud, Data, Digital and Automation. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results.
Our services focus on three key areas:
- Management Consulting: We are innovative in our approach to co-creating solutions with your team, with an eye towards the repeatability and sustainability of the change.
- Technology Services: We champion technology as a key business driver. Our technology professionals strategize, design and build the best possible digital experience that achieves measurable, long lasting results across all parts of your business.
- Cloud: A holistic approach that optimizes and accelerates cloud deployment and maturity. It considers the impact on people, processes, and technology in conjunction with a rigorous review of DevSecOps, infrastructure, finance, data, operations, and security in order to deliver business value. Expertise focusing on Cloud Operationalization and Application Migration (Lift &Shift, DR, Refactor). Read More
- Data: Unlock actionable insights by building artificial intelligence and machine learning platforms that deliver value to customers. Core elements of success include data governance; data pipelines: movement, streaming, traceability, and transformation; data protection; reporting, analytics, and visualizations.
- Digital: Consulting and development expertise applied to custom development and the integration of end-to-end digital web and mobile solutions. Transform, connect and enhance your digital experience with meaningful interactions both inside and outside of your organization. Our engineering expertise employs best practices in Cloud, Legacy Modernization, Digital Marketing and DevSecOps.
- Automation: Transform and automate repetitive transactional business processes by combining the power of Robotic Process Automation (RPA) and cognitive capabilities such as AI/ML, NLP, and OCR technologies to streamline operation and drive business efficiencies.
- Performance & Measurement: Our Techstra TPI™ platform predicts the probability of transformation success. It provides visibility into factors critical to achieving the expected outcomes and identifies high-risk factors for failure enabling leaders to make better decisions and proactively address potential issues earlier in the initiative.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs