Big data SQL & Spark engineer
- Strong with SQL.
- Experience with Hive QL
- Experience with Spark SQL and performance tuning both on SQL and Spark side.
- Experience with scripting – UNIX shell and Python (familiarity with data manipulation libraries like Pandas, Numpy, Scipy etc)
- Experience working with Json, Avro, Sequence, RC, ORC, Parquet files
- Good understanding of data granularities, summarizations, possibly data modelling (relational, dimensional etc)
- Some familiarity with Machine Leaning and natural language processing concepts will be preferred
7300 W 110th Street, Suite 774 Overland Park, KS, 66210