Overview
On Site
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12th Month(s)
Skills
Data Architect
Job Details
Job Title: Data Architect
Location: New jersey/ NY
Job Type: - Contract
On-Site
Job Description:-
Responsibilities:
- Architect streaming data ingestion and integration with downstream systems
- Implement AI-driven controller to orchestrate tens of millions of streams and micro-batches
- Design AI-powered onboarding of new data sources
- Develop AI-powered compute engine and data serving semantic layer
- Deliver scalable cloud data services and APIs with sub-second response times over petabytes of data
- Develop a unified alerting and monitoring framework supporting streaming transformations and compute across thousands of institutional clients and hundreds of external data sources
- Build a self-service data management and operations platform
- Implement a data quality monitoring framework
Qualifications:
- Bachelor's degree in Computer Science, related field; advanced degree preferred
- 12+ years of experience in data technology
- At least 5 years as a Data Engineer with hands-on experience in cloud environments
- 8+ years of Python programming focused on data processing and distributed systems
- 8+ years working with relational databases, SQL, dimensional modeling, and DBT
- 8+ years designing and administering cloud-based data warehousing solutions (e.g., Snowflake, Databricks)
- 8+ years experience with Kafka or other streaming platforms
- Exposure to AI based advance techniques and tools
- Strong understanding of database fundamentals, including data modeling, advanced SQL development and optimization, ELT/ETL processes and DBT.
- Experience with Java, Oracle, MS SQL Server, Druid, Qlik/Golden Gate CDC, and Power BI is a plus
- Strong leadership abilities and excellent communication skills
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.