Genesis10 is currently seeking a VP Data Engineer - Hybrid for a direct placement hybrid opportunity with a Global Financial Institution located in Charlotte, NC. This role involves building large-scale batch and real-time data pipelines using data processing frameworks within the Azure cloud platform. The ideal candidate will design and implement highly performant data ingestion pipelines from multiple sources using Azure Databricks and Azure Data Factory, developing scalable and re-usable frameworks for ingesting datasets. You will partner with architects, engineers, and business stakeholders to develop and deploy enterprise-grade platforms that enable data-driven solutions.
Responsibilities: - Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform
- Design and implement highly performant data ingestion pipelines from multiple sources using Azure Databricks
- Direct experience of building data pipelines using Azure Data Factory
- Develop scalable and re-usable frameworks for ingesting datasets
- Design and Develop ETL, data integration and data migration
- Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions
- Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
- Work with event based / streaming technologies to ingest and process data
- Work with other members of the project team to support delivery of additional project components (API interfaces, Search)
- Evaluate the performance and applicability of multiple tools against customer requirements
Requirements: - Experience in ADLS, Azure Databricks, Azure SQL DB and Datawarehouse
- Strong working experience in Implementation of Azure cloud components using Azure Data Factory, Azure Data Analytics, Azure Data Lake, Azure Data Catalogue and LogicApps
- Knowledge of Azure Storage services (ADLS, Storage Accounts)
- Expertise in designing and deploying data applications on cloud solutions on Azure
- Hands on experience in performance tuning and optimizing code running in Databricks environment
- Good understanding of SQL, T-SQL and/or PL/SQL
- Experience working on Agile projects with knowledge in Jira
- Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
Desired skills: - Experience handling Data Ingestion projects in Azure environment
- Experience on Python scripting, Spark SQL PySpark
Pay range: $160,000 - $175,000 per year If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: - Access to hundreds of clients, most who have been working with Genesis10 for 5-20 years.
- The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
- Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
- Behavioral Health Platform
- Medical, Dental, Vision
- Health Savings Account
- Voluntary Hospital Indemnity (Critical Illness & Accident)
- Voluntary Term Life Insurance
- 401K
- Sick Pay (for applicable states/municipalities)
- Commuter Benefits (Dallas, NYC, SF, and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Never miss an opportunity! Create an alert based on the job you applied for.