Role: Cloud Data Engineer-Healthcare
Location: Austin, TX (3 days a week office)
Duration: Long Term Contract (Contract W2)
Required Skills:
Strong development experience in Spark, PySpark, Shell scripting, Teradata, and DataBricks.
Experience with Ab Initio is required.
Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures.
Proficiency in Shell Scripting for automation, system administration, and data processing tasks.
Excellent work experience on DataBricks as data warehouse/Data Lake implementations.
Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory) Unix/Linux Shell scripting (KSH) and basic administration of Unix servers CA7 Enterprise Scheduler AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch) Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration).
Hands-on experience working with Teradata, including data modeling, SQL development, performance tuning, and large-scale data management.
Experience in Jira and Confluence Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
Strong experience developing large-scale data processing solutions using Apache Spark and PySpark.
Responsibilities:
Work with business and technical leadership to understand requirements.
Design to the requirements and document the designs.
Ability to write product-grade performant code for data extraction, transformations and loading using Spark, PySpark.
Do data modeling as needed for the requirements.
Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and DataBricks Unity Catalog.
Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS or DataBricks.
Implement DataBricks job orchestration using DataBricks.
About Company:
We represent Logisoft Technologies, Inc. with pride; We present ourselves as a premiere Technology, Consulting, Product Development, and Software Services Company.
Our Head Office is located in South Plainfield, NJ, and Our Offices location is in Hyderabad, INDIA & Accra, GHANA.
We are Microsoft Official Partners - A Microsoft Certified Partner that helps customers with a range of IT projects and specific IT solutions.
We started our journey in the year 2008. In the past 16+ years, we have acquired the trust of many IT market leaders.
LOGISOFT Technologies is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of age, sex, sexual orientation, race, color, creed, national origin, ancestry, disability, marital status, or any other legally protected basis under federal, state or local law.
Interested candidates can apply directly to this posting or they can reach
Never miss an opportunity! Create an alert based on the job you applied for.
