PROCYON Technostructure
PROCYON Technostructure

Data Scientist

Hybrid in Indianapolis, IN, US • Posted 6 hours ago • Updated 6 hours ago
Contract W2
12 Months
No Travel Required
Hybrid
$43/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Developing with Databricks notebooks in PySpark
  • Spark SQL
  • and R
  • including transformations
  • joins
  • aggregations
  • and window functions
  • ACID transactions
  • MERGE upserts
  • schema enforcement/evolution
  • time travel
  • and table maintenance (OPTIMIZE
  • Z-order
  • VACUUM)
  • Working with medallion (bronze/silver/gold) architecture and incremental ingestion via Auto Loader
  • Structured Streaming
  • or Lakeflow/DLT
  • Using Unity Catalog for Workspace Catalogs
  • schemas
  • permissions
  • lineage
  • external locations
  • and storage credentials
  • Right-sizing clusters and SQL warehouses and diagnose partitioning
  • shuffle
  • skew
  • and caching issues via Spark UI
  • Scheduling and managing dependencies with ADF Pipelines
  • Databricks Workflows (Jobs)
  • and using Git folders (Repos) for source control
  • Designing MPP warehouse tables
  • including distribution (hash
  • round-robin
  • replicated)
  • columnstore indexes
  • and partitioning
  • Git and CI/CD in Azure DevOps or GitHub
  • including branching
  • PRs
  • and deploying Synapse artifacts and Databricks Asset Bundles
  • Microsoft Certified: Azure Data Engineer Associate (DP-203)
  • Monitoring pipelines and workloads with Azure Monitor/Log Analytics and alerting
  • and troubleshooting failed jobs

Summary

Data Scientist 

We are seeking a Data Scientist to support the design, development, and optimization of enterprise data solutions. This role will be responsible for building scalable data pipelines, integrating data from multiple sources, implementing data governance standards, and delivering reliable data products that support business and analytics needs.

<>Key Responsibilities:
  • Design, build, and maintain batch and real-time data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
  • Develop and optimize ETL/ELT processes for integrating data from diverse sources into centralized data platforms.
  • Implement and support lakehouse architectures following Bronze, Silver, and Gold data layers.
  • Create, load, and tune dimensional data models and SQL workloads in Azure Synapse Analytics to support reporting and analytics.
  • Orchestrate and monitor data workflows using Azure Data Factory, Databricks Workflows, and Synapse pipelines.
  • Collaborate with data architects, analysts, data scientists, project managers, and business stakeholders to translate requirements into technical solutions.
  • Apply data governance, security, and compliance controls, including role-based access, data masking, and sensitive data protection standards.
  • Support data quality initiatives, data stewardship practices, and enterprise data integration strategies.
  • Participate in requirements gathering, solution reviews, technical documentation, and knowledge-sharing activities.
  • Troubleshoot, optimize, and maintain data platform performance while ensuring reliability and scalability.
  • Provide technical guidance, support, and training to project teams and stakeholders.
  • Contribute to process improvements, operational support, and development of data engineering standards and best practices.
<>Required Skills:
  • Strong experience with Azure Databricks, PySpark, Spark SQL, and Delta Lake.
  • Hands-on experience with Azure Synapse Analytics and Azure Data Factory.
  • Expertise in ETL/ELT development, data integration, and data pipeline design.
  • Strong SQL and dimensional data modeling experience.
  • Knowledge of data governance, security, and compliance frameworks.
  • Experience working in cloud-based data platforms and modern data warehouse environments.
  • Excellent communication and collaboration skills with both technical and non-technical stakeholders.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10290032
  • Position Id: 9122773
  • Posted 6 hours ago
Contact the job poster
AN

Aishwarya Nadar

Recruiter @ PROCYON Technostructure

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at PROCYON Technostructure in Indianapolis, IN