Azure Data Engineer-Onsite

Azure Data Engineer

Dallas, TX/ Atlanta, GA

Long Term

Education & Experience

• Bachelor s degree preferred, High School Diploma or Equivalent with relevant work experience required
• Experience designing Data Lakes and Data Warehouses
• Experience with Snowflake, Azure Synapse and Azure Databricks preferable
• Participate in driving best practices around data engineering and software development process
• Understand data and query optimization, query profiling, and query performance monitoring tools and techniques
• Experience with a range of AWS and/or Azure services, including Infrastructure and Security related services such as Azure AD, IaaS, Containers, Storage, Networking, and Azure Security, Airflow, SNS, SQS, S3
• Familiarity with designing and building data platforms supporting both batch and real-time (event-based) architecture for cloud data platforms is considered a strong plus
• Familiarity with big data platforms, tools, Kafka, predictive modeling, machine learning, etc. is considered a strong plus
• 2 5 years of hands-on experience designing and implementing large-scale distributed data architecture for BI and OLTP systems
• 2 5 years of hands-on experience designing and implementing large-scale data pipelines
• 2 5 years of hands-on experience in Snowflake, AWS and Azure data services
• 2 5 years of hands-on experience with data integration using ETL / ELT tools
• Experience with cloud-based technologies, preferably AWS and Azure, Airflow, SNS, SQS, S3, ADLS Gen 2, Data Factory, Snowflake, Databricks, Synapse Analytics preferred
• Experience with one or more Python parallel processing libraries preferable