Senior Data Engineer

In today s environment of constantly evolving user requirements and competition, businesses must leverage technology to the best of their capabilities to gain a competitive advantage. Today, more than ever before, companies seek innovative solutions in order to grow and prosper. As globalization intensifies, the levels of competition drive businesses to utilize the capabilities of outsourcing and having an experienced, capable and trusted IT partner has become imperative to success.

JRD Systems specializes in providing the top talent in the IT Industry to partner with organizations when their internal teams are simply not enough. We have IT professionals that work as remote team extensions, others that help our clients overcome daily technical issues or we can provide a team to execute custom applications development projects.

Onsite role (Los Angeles, CA)

Required Skills:

• Cloud Platforms: Deep understanding of Azure ecosystem, including Azure Data Factory, Data Lake Storage, Blob Storage, power apps, and Functions.
• Additionally, in-depth understanding and implementation of API management such as Apigee.
• Big Data Technologies: Proficiency in Databricks, Spark, PySpark, Scala, and SQL. Data
• Engineering Fundamentals: Expertise in ETL/ELT processes, data pipelines, data modeling, schema design, and data warehousing.
• Programming Languages: Strong Python and SQL skills, with knowledge of other languages like Scala or R beneficial.
• Data Warehousing and Business Intelligence: Strong ERD concepts, designs, and patterns,
• Understanding of OLAP/OLTP systems, performance tuning, Database Server concepts, and BI tools (Power BI, Tableau).
• Data Governance: Strong understanding of RBAC/ABAC, Data Lineage, Data leak prevention, Data security, and compliance.
• Deep understanding and implementation knowledge of audit and monitoring in Cloud.

Required Experience:

• 7 years of experience applying Enterprise Architecture principles
• 5 years of experience in a lead capacity.
• 5 years of hands-on experience with Azure Data Factory, Azure Databricks, API implementation and management solution, and managing Azure resources.
• 5 years of experience in the following:
• Developing data models and pipelines using Python
• working with Lakehouse platforms
• GitHub CI/CD pipelines and infrastructure automation
• Terraform scripting and with data warehousing systems
• OLAP/OLTP systems and integration of BI tools.
• Bachelor's degree in an IT-related or Engineering field.