Sr. Data engineer

Hybrid in Rutherford, NJ, US • Posted 2 days ago • Updated 2 days ago
Full Time
75% Travel Required
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • databricks
  • snowflake
  • SQL
  • ETL
  • AWS

Summary

Role: Data engineer- Databricks

Location: Rutherford, NJ

 

Job description:

• Good decision-making and problem-solving skills
• Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, Machine Learning and SQL warehouse).
• Strong experience in coding custom ETL pipelines using spark and deploy in Databricks.
• Knowledge of medallion architecture, DLT and unity catalog within Databricks.
• Understanding of core AWS services, uses, and AWS architecture best practices
• Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
• Solid knowledge on Airflow
• Solid knowledge on CI/CD pipeline in AWS technologies
• Solid programming background on scala spark and/or pySpark
• Experience with Docker and Kubernetes is a plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91089021
  • Position Id: 9071751
  • Posted 2 days ago

Company Info

About DATAECONOMY

DATAECONOMY IS a fast-growing Data & Analytics company with a global presence headquartered in Dublin, OH with office in Providence, RI, and an advanced technology center in Hyderabad, India. DATAECONOMY is well recognized and are known for their thought leadership, out-of-the-box products, cutting-edge solution accelerators, innovative business use cases, and cost-effective service offerings.

DATAECONOMY focus on these six core competencies believing that these competencies put together create nimble data enterprises enabling them for better data monetization.


DATA ENGINEERING: We provide services and solutions ranging from data plumbing through data consumption using traditional and modern technologies on either on-prem or cloud.


DATA SCIENCE: We put heavy emphasis on advanced visual analytics using graph technologies while leveraging the AI/ML/NLP to powerup the business use cases.


CLOUD: We have partnerships with major cloud vendors and direct MSA with AWS to deliver their native data platform solutions. A notable offering here is our Data Platform Modernization Suite for quick cloud enablement.


DATA GOVERNANCE: At DATAECONOMY, we look at Data Governance as foundation for Data Monetization beyond compliance. We focus on operationalize the data governance as treat that as an organizational behavioral transformation.


DATAOPS Over the last decade, organizations have matured with their overall DevOps, but we still see lot of white spaces when comes to the DataOps. Our solutions and services address these white spaces while quickly bringing the data organizations catching up to enterprise DevOs.

BLOCKCHAIN: momentum has slowed down in adopting the blockchain across industries as success requires tremendous amount of cross organizational collaborations. We are now working to take our Data Mesh, Data Exchange solutions to Blockchain hoping future is all about sharing and exchanging data amongst the organizations.

Contact the job poster
LP

Lokesh Potnuri

Recruiter @ DATAECONOMY
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

It looks like there aren't any Similar Jobs for this job yet.

Search all similar jobs