Databricks Lead/Architect
Isoftech Inc
Dice Job Match Score™
⏳ Almost there, hang tight...
Job Details
Skills
- Apache Kafka
- Amazon Web Services
- Amazon Kinesis
- Artificial Intelligence
- Business Intelligence
- Cloud Computing
- Collaboration
- Continuous Delivery
- Continuous Integration
- Advanced Analytics
- Data Engineering
- Data Masking
- Data Processing
- Databricks
- DevOps
- Encryption
- Leadership
- Machine Learning (ML)
- Management
- Mentorship
- Meta-data Management
- PySpark
- RBAC
- Real-time
- Regulatory Compliance
- SQL
- Storage
- Streaming
- Use Cases
Summary
Architecture & Design
- Define and design end-to-end data lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native services.
- Create reference architectures for batch, real-time, and streaming data pipelines.
- Architect data ingestion, curation, storage, and governance frameworks.
- Ensure the platform is scalable, secure, and optimized for performance and cost.
- Establish standards for data lineage, metadata management, and compliance.
- Work with enterprise architects to align Databricks solutions with overall cloud strategy (AWS).
Leadership & Delivery
- Lead and mentor a team of data engineers in building robust data pipelines.
- Collaborate with data scientists, BI teams, and business stakeholders to enable advanced analytics and AI/ML use cases.
- Drive adoption of DevOps and CI/CD practices for data engineering.
- Review designs and solutions to ensure adherence to architectural principles.
Implementation & Optimization
- Build, optimize, and manage large-scale PySpark/SQL pipelines in Databricks.
- Enable real-time data processing through Kafka, Kinesis, or Event Hubs.
- Implement security best practices including RBAC, data masking, and encryption.
- Dice Id: 10114734
- Position Id: 8919724
- Posted 18 hours ago
Company Info
About Isoftech Inc
With over 15 years of experience in providing next-generation technology, we help companies align their ITgoals to their business objectivities. Headquartered in Chantilly, VA, ISoftech serves clients throughout the US. With a balanced view of strategy, people, process, and technology, we work with companies to understand their unique business needs, to develop and implement practical technology solutions. Clients benefit from ISoftech’s commitment to excellence, our responsiveness, flexibility and authentic desire to help them meet, and often exceed, their goals.
We as a firm will help clients optimize their goals, improve their operations, and accelerate their organizational performance to greater heights. Our turnkey solutions include Application Development and Modernization, Enterprise Architecture, Cloud Migration, Operation and Maintenance, Big Data and Analytics and Quality Engineering Services. ISoftech Inc’s portfolio of Clients include Commercial and Government Clients across United States.
ISoftech also provides product development and consulting services to help organizations actualize their goals. ISoftech has a well-informed view of the industry that enables us to properly identify a winning approach and process, no matter the industry. Our frameworks, tools and domain expertise are our key to building strong industry relations.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs