Automation Engineer

Automation Engineer

BCforward is currently seeking a highly motivated Automation Engineer in Plano, TX

Position Title: Automation Engineer

Location: Plano, TX

Anticipated Start Date: 10/01/2025
Please note this is the target date and is subject to change. BCForward will send official notice ahead of a confirmed start date.

Expected Duration: 3 months contract to hire

Job Type: Contract: 40 hrs/week

Payrate - $58 to $/hr on W2

Job Description:

We are seeking an innovative and highly skilled Senior Platform Automation Engineer to drive the design, development, and maintenance of advanced platform-level automation and integrations for our Databricks data lake on AWS. This role is crucial for enhancing the efficiency, scalability, reliability, and security of our data platform, empowering our data science and analytics teams through cutting-edge automation and continuous innovation.

Responsibilities:

• Lead the design, development, and implementation of innovative platform automation solutions for the Databricks data lake on AWS.


• Automate the provisioning, configuration, and management of core AWS services (S3, IAM, EC2, VPC, Lambda, CloudWatch, SNS, SQS, ELB, Route53) using Infrastructure as Code (Terraform).


• Develop robust automation scripts and tools using Python for Databricks workspaces, clusters, jobs, and security configurations, leveraging Databricks APIs and CLI.


• Design, implement, and maintain CI/CD pipelines (e.g., GitHub Actions) for continuous delivery of infrastructure, platform, and automation code.


• Implement and enforce security best practices, compliance, and cost optimization strategies across the AWS and Databricks data platform.


• Integrate and automate the management of AWS data services (Redshift, DynamoDB, Glue, Athena) within the Databricks ecosystem.


• Drive continuous improvement and innovation in platform operations, monitoring, and performance.


• Collaborate with data engineers, data scientists, governance, and operations teams to deliver automated solutions that enhance productivity, platform stability and improve customer experience.

Required Skills & Qualifications:

Experience

• 5-7 years of professional experience in cloud platform engineering, DevOps, or data platform automation.


• Mandatory


• AWS (Mandatory): Extensive hands-on experience with S3, IAM, EC2, API Gateway, Step Functions, VPC, Lambda, CloudWatch, SNS, SQS, ELB, and Route53.


• DevOps and Automation (Mandatory):


• Proven expertise in Infrastructure as Code (IaC) with Terraform.


• Advanced Python scripting for platform automation, API integration, and data pipeline orchestration.


• A passion for identifying and implementing innovative automation solutions.


• Solid understanding of CI/CD principles and practical experience with tools like GitHub Actions.


• Proficiency with Git for version control.
  

  Nice to have

  
  


• Big Data & Data Platforms:


• Strong expertise in automating, managing, and optimizing Databricks workspaces, clusters, jobs, and security on AWS. Experience with Databricks APIs, CLI, Delta Lake, and Unity Catalog is highly desirable.


• Deep experience with Databricks.


• Familiarity with AWS data services (Redshift, DynamoDB, Glue, Athena) and data lake/warehousing concepts.


• Networking & Security: Strong understanding of AWS networking (VPC, subnets, security groups) and cloud security best practices, IAM roles, and data encryption.


• Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot complex issues across distributed systems.


• Communication: Excellent verbal and written communication skills, with the ability to articulate technical concepts to diverse audiences.

Keywords:

Automation, Devops, Databricks

Benefits:

BCforward offers all eligible employees a comprehensive benefits package including, but not limited to major medical, HSA, dental, vision, employer-provided group life, voluntary life insurance, short-term disability, long-term disability, and 401k.

About BCforward:
Founded in 1998 on the idea that industry leaders needed professional service, and workforce management expert, to fuel the development and execution of core business and technology strategies, BCforward is a Black-owned firm providing unique solutions supporting value capture and digital product delivery needs for organizations around the world. Headquartered in Indianapolis, IN with an Offshore Development Center in Hyderabad, India, BCforward's 6,000 consultants support more than 225 clients globally.

BCforward champions the power of human potential to help companies transform, accelerate, and scale. Guided by our core values of People-Centric, Optimism, Excellence, Diversity, and Accountability, our professionals have helped our clients achieve their strategic goals for more than 25 years. Our strong culture and clear values have enabled

BCforward to become a market leader and best in class place to work.

BCforward is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against based on disability.
To learn more about how BCforward collects and uses personal information as part of the recruiting process, view our Privacy Notice and CCPA Addendum. As part of the recruitment process, we may ask for you to disclose and provide us with various categories of personal information, including identifiers, professional information, commercial information, education information, and other related information. BCforward will only use this information to complete the recruitment process.
This posting is not an offer of employment. All applicants applying for positions in the United States must be legally authorized to work in the United States. The submission of intentionally false or fraudulent information in response to this posting may render the applicant ineligible for the position. Any subsequent offer of employment will be considered employment at-will regardless of the anticipated assignment duration.

Interested candidates please send resume in Word format Please reference job code 244128 when responding to this ad.