RESPONSIBILITIES:
Kforce has a client seeking an onsite Software Engineer to join their team in New York.
Summary:
The Engineer will support and develop their Databricks-based data platform during the development phase. This role focuses on building, improving, and validating reliability patterns early, rather than production firefighting. The ideal candidate is hands-on with Databricks, PySpark, Python, and has working knowledge of Azure cloud services. This role partners closely with Data Engineering teams to ensure solutions are scalable, efficient, and production-ready.
Key Responsibilities:
* Develop and support Databricks notebooks, jobs, and workflows
* Write and optimize PySpark and Python code for data processing
* Assist in designing scalable and reliable data pipelines
* Apply Spark best practices (partitioning, caching, joins, file sizing)
* Work with Delta Lake tables and data models
* Perform data validation and quality checks during development
* Support cluster configuration and sizing for development workloads
* Identify performance bottlenecks early and recommend improvements
* Collaborate with Data Engineers to prepare solutions for future production rollout
* Document development standards, patterns, and best practices
REQUIREMENTS:
* 3+ years of hands-on experience
* Experience working in Microsoft Azure preferred
* Basic understanding of cloud resource usage and cost awareness
Databricks & Spark:
* Hands-on experience with Databricks
* Strong knowledge of PySpark and Spark fundamentals
* Experience working with Delta Lake
* Understanding of Spark execution concepts (jobs, stages, tasks)
* Experience using Git and version control
* Familiarity with Databricks Repos or similar workflows
* Ability to perform basic testing and validation of data pipeline
Programming:
* Strong Python development skills
* Ability to write clean, modular, and reusable code
Familiarity with:
* Azure Databricks
* Azure Data Lake Storage (ADLS)
* Azure Blob Storage
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: kforcecx
- Position Id: ITEQG2174127
- Posted 2 days ago