Senior Databricks Admin and Data Engineer - Houston, TX (Onsite) - W2 only

Job Title: Senior Databricks Admin and Data Engineer Location: Houston, TX (Onsite)

Duration: Contract to hire - W2 onlyl

(No H1b, OPT and CPT and old LinkedIn profile is mandatory)

Note: Only genuine candidates will be considered, Non-compliance may result is your company being blocked.

About the Role:

Client is seeking a highly skilled and motivated Senior Databricks Admin and Data Engineer to join our dynamic team in Houston. This senior-level role offers the opportunity to work with cutting-edge technologies in a fast-paced, collaborative environment. You will be responsible for the administration, optimization, and development of Databricks environments, as well as building scalable data pipelines and architectures to support a wide range of data analytics and machine learning initiatives.

Key Responsibilities:

Databricks Administration:

• Administer and manage Databricks environments, ensuring high
• availability, reliability, and performance.
• Monitor and optimize Databricks clusters, notebooks, jobs, and
• integrations to improve operational efficiency.
• Manage Databricks workspace, user permissions, and security.
• Troubleshoot and resolve Databricks-related issues promptly and

Data Engineering:

• Design, develop, and implement robust, scalable, and efficient data
• pipelines to process large-scale data.
• Collaborate with cross-functional teams to gather and understand data
• requirements for various analytics and machine learning use cases.
• Implement best practices in data engineering, including data quality,
• validation, and data governance.

Collaboration and Leadership:

• Work closely with data scientists, analysts, and other engineers to optimize data workflows and pipelines.
• Mentor and provide guidance to junior team members on best practices for Databricks and data engineering processes.
• Lead complex technical projects and ensure alignment with business objectives.
• Continuous Improvement:
• Stay up-to-date with the latest Databricks features and data engineering trends.
• Recommend and implement new tools, technologies, and processes to improve efficiency and data flow.

Qualifications:

Education: Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Experience:

• 7+ years of experience in data engineering, with a strong focus on
• Databricks administration.
• Proven experience in administering and optimizing Databricks
• environments, including cluster management, security, and performance
• Strong experience in developing data pipelines and data architecture
• using tools like Apache Spark, SQL, and Python.
• Expertise in cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with ETL/ELT processes, data warehousing, and building data
• Solid understanding of data modeling, relational databases, and big data

Technical Skills:

• Expertise in Databricks, Apache Spark, and related technologies.
• Strong programming skills in Python, Scala, or Java.
• Experience with SQL, data engineering frameworks, and tools.
• Familiarity with machine learning workflows and tools.
• Experience in version control systems like Git.