Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 1 Month(s)
Skills
Analytical Skill
Apache Airflow
Apache Kafka
Apache Spark
Artificial Intelligence
BMC Control-M
Cloud Computing
Collaboration
Job Details
We are looking for Data Engineer for our client in Austin, TX
Job Title: Data Engineer
Job Type: Contract
Job Description:
- The Data Engineering & AI Specialist will be responsible for designing, building, and maintaining end-to-end data and AI/ML pipelines, with a focus on cutting-edge Agentic AI systems.
- This role requires deep expertise across the full data stack, AI/ML frameworks, and enterprise-scale data engineering.
- The specialist will work on autonomous AI agents, multi-agent systems, and advanced data solutions, ensuring seamless integration with enterprise applications and external data sources.
- Develop and maintain AI/ML pipelines and agent-based architectures.
- Design and implement autonomous AI agents and multi-agent systems, including planning, memory, and decision-making capabilities.
- Integrate AI agents with external tools, APIs, and data sources.
- Apply prompt engineering and chain-of-thought reasoning for complex task decomposition.
- Implement retrieval-augmented generation (RAG) workflows and vector database integration.
- Orchestrate, monitor, and evaluate AI agent workflows and performance.
- Build and maintain large-scale data pipelines using Python, Spark, SQL, and cloud/data warehouse technologies.
- Ensure data quality, integrity, and validation using tools such as Deequ, Pandas, and NumPy.
- Utilize deep learning frameworks (TensorFlow, PyTorch) for AI agent model development.
- Work with ETL and data integration tools, including Informatica PowerCenter, IICS, StreamSets, and Apache Kafka.
- Manage, schedule, and automate workflows using Apache Airflow, Informatica Workflow Manager, and Control-M.
- Collaborate with cross-functional teams using CI/CD pipelines, GitHub, Jira, and related tools.
- Build dashboards and visualizations with Power BI, Tableau, Qlik Sense, or SAP for business insights.
- Apply MLOps best practices for model deployment, monitoring, and continuous improvement.
- Master s degree in Data Science, Data Engineering, Computer Science, or related field.
- 3+ years of experience in data engineering, AI/ML, and enterprise-scale applications.
- Advanced proficiency in Python, R, Spark, SQL, PL/SQL, and UNIX shell scripting.
- Strong experience with Teradata, Greenplum, Oracle 11g, SQL Server, PostgreSQL, Azure Data Lake, and Snowflake.
- Hands-on experience with Azure Databricks, Informatica PowerCenter/IICS, StreamSets, and Apache Kafka.
- Proficiency in deep learning frameworks (TensorFlow, PyTorch) for agent model development.
- Experience developing AI agents with planning, reasoning, and autonomous task execution.
- Strong knowledge of LLM-based agents, retrieval-augmented generation (RAG), and vector databases.
- Experience with CI/CD, GitHub, Jira, ServiceNow, Team Foundation Server (TFS).
- Strong command of Windows, UNIX, and Linux environments.
- Experience with enterprise applications, Salesforce (SFDC), Microsoft SharePoint, Power BI, Tableau, Qlik Sense, and SAP integration.
- Knowledge of agent orchestration, monitoring, and evaluation frameworks.
- Expertise in multi-agent systems and autonomous AI solutions in global enterprise contexts.
- Advanced analytical and problem-solving skills.
- Strong collaboration and communication skills.
- Ability to translate business requirements into technical solutions and AI workflows.
- Experience in full data lifecycle management, ETL processes, and large-scale data processing.
- Master s degree in Data Science, Data Engineering, Computer Science, or related field.
- Minimum 3 years of relevant professional experience in AI, data engineering, and enterprise solutions.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.