Databricks Architect with AWS, Java & Rest API exp

Job Role: Databricks Architect with AWS, Java & Rest API exp

Job Location: NYC (100% Onsite)

Job Type: Contract

Key Responsibilities:

• Lead technical architecture, design, and delivery of high-performance, highly available integrated systems, including low-latency trading and backend platforms.
• Re-architect and optimize Databricks platforms, ensuring efficient integration with existing and new services.
• Design and develop sophisticated REST API platforms to enable comprehensive system integration.
• Demonstrate expertise in Messaging Platforms (AMQ, Kafka, etc.) to facilitate effective inter-system communication and build integrated asynchronous platforms.
• Utilise deep knowledge of No SQL, SQL, and stored procedures (Postgres, MySQL) in the context of integrated environments.
• Assess health and performance of integrated software applications and databases, providing robust technology solutions for integration challenges.
• Collaborate with Operations and Business teams to support and enhance trading, backend, and asset management systems with strong integration capabilities.
• Analyse service and application performance using various programming languages, tools, and integration-focused techniques.
• Develop and maintain automated testing frameworks and CI/CD pipelines tailored for integrated systems.
• Provide technical leadership and mentorship to engineering teams, particularly in system integration best practices.
• Guide non-technical staff in the effective use of integrated software and hardware systems.
• Support applications with a strong understanding of system integration, test planning, scripting, and troubleshooting.

Required Qualifications & Experience:

• Bachelor's degree in Computer Science or related field, or equivalent experience.
• Minimum 10 years of experience in Software Engineering with a focus on system integration (Java, Python, GoLang).
• At least 5 years in fintech, preferably in Capital Markets, Trade Lifecycle, Equities, Mutual Funds, Wealth Management, Payments, or SaaS, with demonstrable integration skills.
• Hands-on experience re-architecting Databricks platforms and managing related integrations.
• Proficiency in Test Driven Development and writing effective unit/integration tests for integrated systems.
• Strong understanding of CI/CD and automated testing frameworks for integrated environments (Jenkins, Git, Jira).
• Expertise in Unix and Linux operating systems, including scripting to extract and transform data across integrated systems.
• Familiarity with Scrum and Agile processes tailored for integration projects.
• Experience with 24x7 highly available integrated architectures.
• Excellent communication skills, with the ability to explain complex integration concepts to diverse audiences.
• Strong analytical and problem-solving skills, with a focus on integration challenges.

Nice to Have:

• Experience with Amazon Web Services (AWS) in integrated environments.
• Advanced scripting skills on Linux for data extraction and transformation.