Apache Iceberg Data Engineer

Job Number: R0233771

Apache Iceberg Data Engineer
The Opportunity:

Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you to help our clients find answers in their data to impact important missions-from fraud detection to cancer research to national intelligence.

As a data engineer at Booz Allen, you'll use your skills and experience to help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You'll develop and deploy the pipelines and platforms that organize and make disparate data meaningful.

Here, you'll work with a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll sharpen your skills in analytical exploration and data examination while you support the assessment, design, developing, and maintenance of scalable platforms for your clients. Due to the nature of work performed within this facility, U.S. citizenship is required.

Work with us to use data for good.

Join us. The world can't wait.

You Have:

• 2+ years of experience developing and maintaining data pipelines and workflows for large-scale datasets, ensuring efficiency and reliability
• Experience working with Apache Iceberg or table formats, such as Delta Lake or Hudi, including data lake tra nsa ctions, schema evolution, data version control, and partition optimization
• Experience working with distributed file systems, such as S3, HDFS, S, and implementing scalable, high-performance data lake infrastructure
• Experience with query engines, such as Presto, Trino, Spark, or Hive, and integrating them with Iceberg-backed tables for efficient querying of large datasets
• Experience in Python and programming languages, such as Java or Scala, including implementing scalable ETL / ELT processes to populate and maintain Iceberg tables
• Experience working with data lifecycle management, including time-travel queries and optimizing data for both historical and real-time use cases
• Knowledge of data lake and warehouse architecture principles and platforms, including best practices for storage optimization and modern lakehouse paradigms
• Ability to debug and troubleshoot for data lake environments, addressing issues related to data consistency, governance, and performance bottlenecks, and design and document reusable, modular solutions for managing and interacting with Iceberg-backed datasets in complex ecosystems
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor's degree

Nice If You Have:

• Experience integrating Apache Iceberg with orchestration tools, such as Apache Airflow to automate workflows involving complex data lake operations
• Experience with containerized environments, such as Docker, and orchestration platforms, such as Kubernetes, and ensuring scalability for Iceberg-backed systems
• Experience working with AWS Glue Catalog, Hive Met astore, or other met adata or catalog systems to efficiently manage Iceberg schema and table met adata
• Experience adapting Iceberg implementations for the cloud
• Experience implementing data governance principles, including role-based access and compliance policies , into Iceberg workflows
• Knowledge of cloud-native object storage systems, such as AWS S3, Azure Data Lake, or Google Cloud Storage
• Knowledge of distributed computing systems, such as Spark or Flink, for both batch and real-time data processing involving Iceberg datasets
• Knowledge of partitioning strategies and optimization techniques for performance tuning of Iceberg analytics
• Knowledge of real-time data streaming and integrating tools, such as Kafka with Iceberg for near-real-time ingestion and analytics
• Knowledge of Agile engineering practices

Vetting :

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client .

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $62,000.00 to $141,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.

Identity Statement

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy

AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.

Work Model
Our people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.

• Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
• Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.
• Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.