Y & L Consulting Inc.
Y & L Consulting Inc.

Data Engineer

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract Independent
Contract W2
Remote
$0 - $0
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Microsoft Power BI
  • Data Lake
  • Data Modeling
  • Data Processing
  • Data Storage
  • Databricks
  • Communication
  • Conflict Resolution
  • Continuous Delivery
  • Continuous Integration
  • Analytics
  • Apache Spark
  • Business Intelligence
  • Git
  • Informatica
  • Caching
  • Collaboration
  • Problem Solving
  • Python
  • Real-time
  • SQL
  • Scala
  • Debugging
  • DevOps
  • ELT
  • Extract
  • Transform
  • Load
  • Microsoft Azure
  • Orchestration
  • Scalability
  • Storage
  • Tableau
  • Unstructured Data
  • Version Control
  • Warehouse

Summary

VENDORS OR C_2_C CANDIDATES WILL NOT BE CONSIDERED!!!

Data Engineer
Key Responsibilities


Design, develop, and maintain scalable ETL/ELT pipelines using Informatica, Azure Data Factory and Databricks.


Process and transform structured and unstructured data from various sources into a centralized data lake or warehouse.


Leverage Azure Data Lake Storage and Databricks Lakehouse to build efficient data storage and analytics solutions.


Ensure seamless integration with Azure services such as Azure Event Hubs, Azure Stream Analytics, and Azure Functions.


Optimize data pipelines for performance, scalability, and cost-effectiveness.


Implement partitioning, indexing, and caching strategies to handle large-scale datasets.

Key Skills :


5 years of experience as a data engineer or in a similar role.


Hands-on expertise with Informatica, Azure Data Factory, Azure Synapse, and Azure Data Lake.


Proficiency in Databricks for data transformation, analytics, and pipeline orchestration.


Strong programming skills in Python, Scala, or SQL.

Experience with distributed data processing frameworks (e.g., Apache Spark).


Familiarity with CI/CD pipelines and version control systems (e.g., Azure DevOps, Git).


Experience with Delta Lake and Databricks.


Knowledge of real-time data ingestion and processing.


Exposure to BI tools such as Power BI or Tableau.


Strong problem-solving and debugging capabilities.


Excellent communication and collaboration skills.


Knowledge of data modeling techniques and schema designs for analytics.


Preferred Azure / Databricks certifications.
\
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: ylcon
  • Position Id: 9135852
  • Posted 1 hour ago

Company Info

About Y & L Consulting Inc.

Y&L Consulting is a provider of the highest-caliber local and international IT professionals, positioned to help you maximize profitability and growth.

As a global corporation with local presence and sensitivity, Y&L offers IT services and support primarily to medium and large companies. Knowledgeable and proficient in all primary technologies, we customize programs to fit your current business needs while maintaining the flexibility to ramp up or down as your situations change. By avoiding stringent service provider contracts and rigid methodologies, you enjoy flexible capabilities, local relationships, international resources, and significant cost savings.

IT Consulting San Antonio Expertise

Design, architecture, development, and maintenance of custom applications using ATG, MS, .NET, Java/J2EE, and other popular technologies
Implementation, upgrade, and maintenance for packaged application solutions SAP, PeopleSoft, Oracle Apps, Cognos, and Actuate
Quality Assurance and Testing Services Mercury partner
Programmers and Database Administrators
In addition, we have a number of highly-qualified Project Managers, Business Analysts, and Technical Writers on our bench.

Go to company profile
Contact the job poster
Michael Tennell

Michael Tennell

Recruiter @ Y & L Consulting Inc.

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
Remote jobs at Y & L Consulting Inc.