Principal / Lead Data Engineer

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract W2
Contract Independent
No Travel Required
Remote
$55 - $60/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Python
  • SQL
  • Hadoop
  • Hive
  • AWS
  • Azure
  • Spark
  • ETL
  • CI/CD
  • BigData
  • DATABRICKS
  • Ab Initio

Summary

Job Title: Principal / Lead Data Engineer (ETL & Cloud)

Location: Remote

Employment Type: W2 Contract / Full Time

Duration: Long Term

 

Job Summary:

We are seeking a Principal/Lead Data Engineer to design and build scalable ETL pipelines and cloud-based data platforms. This role focuses on real-time data processing, system optimization, and modernization across enterprise environments.

 

Key Responsibilities:

  • Design and develop ETL pipelines (batch & real-time)
  • Build scalable solutions using Big Data tools (Spark, Hadoop, Databricks)
  • Lead cloud migration and modernization (AWS/Azure)
  • Optimize performance, reliability, and cost efficiency
  • Implement data governance, security, and CI/CD practices
  • Support production systems and mentor junior engineers

 

Required Skills:

  • 10+ years of data engineering / ETL experience
  • Strong expertise in Ab Initio, Python, or similar tools
  • Experience with Big Data (Hadoop, Hive, Spark, Databricks)
  • Hands-on with AWS/Azure cloud platforms
  • Strong SQL and database skills (Oracle, Teradata, Snowflake)
  • Experience with real-time data processing and job schedulers

 

Preferred:

  • Financial services/banking experience
  • Cloud or Databricks certifications
  • Experience with data migration and monitoring tools

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX19c80a
  • Position Id: 5316-12801-
  • Posted 1 hour ago

Company Info

About Brilliant Infotech Inc.

Brilliant Infotech Inc. is a leading Product ,IT Services and training Company. While enabling the Digital Transformation for the enterprises, we are also Empowering Data Evolution, Cloud Modernization and Cybersecurity Resilience for companies across different verticals.

Data Science and Transformation, Data Engineering, Data Analysis, Cloud modernization, Cybersecurity Resilience, IT Managed Services Production support and Cloud Operations, DevOps, Software Development and IT Consulting in different tech stacks like Java/JEE, Python, PM, CSM, Cloud AWS, Azure, GCP,BA, QA are our core service offerings.

We specialize in providing technical solutions, resolving design issues, Database Services, Application Servers. We have a long experience in IT development with a variety of companies. Our business and technical expertise coupled with vast experience identifies us to be able to provide complete business solutions to our customers in a cost effective and efficient manner.
Brilliant Infotech offers high-quality, cost-effective software solutions through the use of highly efficient and productive Open-source technologies. We also provide IT consultancy services for strategic partnerships, Application and Product Development.

Since our inception in 2007, we have been building software applications and providing IT services to the Financial, Insurance, Banking, Telecom, Education, Retail and eCommerce industries.

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract

60 - 65

Remote or Hybrid in Houston, Texas

Today

Easy Apply

Contract

Depends on Experience

Remote or Hybrid in Dallas City, Illinois

4d ago

Easy Apply

Contract

$60,000 - $70,000

Remote

Yesterday

Easy Apply

Contract

Depends on Experience

Search all similar jobs