Must Haves:Big Data exp. (2 yrs.), Informatica experience.
Lead role in designing, architecting ETL solutions, Data analysis, Dimensional Modeling and
- ETL Design on assigned projects.
- Evaluate and design Conceptual /Logical and Physical Data Models; define logical views and physical data Security structures.
- Lead the efforts to develop Informatica code, Design, Develop and modify, Informatica mappings, workflows using all necessary Transformations as applicable.
- ETL performance tunings, Optimization, Code Quality and Standards.
- Adheres to Client BI documented Development Standards, Best Practices and Guidelines, ensure compatibility, scalability, and integration with other data platforms.
- Hadoop / BigInsights and the Netezza (Pure Data Analytics) Integration,
- Off-Loading Netezza data into HDFS, Hbase/Hive. Constructing the Staging or the day 'zero' archive in Hadoop.
- Building the unstructured data Hub or the data lake in Big data platform for Analytics and then to feed to Datawarehouse.
- Doing the Text Analytics, BigSheets, building BigSQL / Hive Queries.
- 7+ years of experience required in related field (i.e. ETL, Data Warehousing and SDLC);
- 7+ years of experience working with Informatica ETL tool (design and development).
- 2+ years of Big Data, Hadoop, BigInsights expertise
- Strong data analysis skills, Dimensional Modeling, experiences in designing Star Schemas.
- Strong in Big data Analytics
- Previous work experiences in large scale data integration and data warehouse solutions database exceeding 10 TB.
- Expertise in Hadoop ecosystem products such as HDFS, MapReduce, Hive, Pig, Spark, AVRO, HBase, Zookeeper
- Experience with SQL, Java (MapReduce), Python (linux shell like scripts) development
- Experience of Business Intelligence, data mining techniques and analytics functions
Responsible for delivering quality ETL work using Informatica in a Datawarehousing environment that involves NETEZZA, BigInsights, Linux, AutoSys, Informatica9.5.1.. Strong Data Modeling experiences, skilled in DW/ETL Requirement Analysis, Informatica ETL Design, Development, Testing and migration to Production.
An experienced Big Data resource, expertise in Administering, Developing and deploying IBM InfoSphere BigInsights solution in a massive Netezza based data warehouse environment. Proven work experience on h/w, s/w configs, enterprise level installation, configuration of BigInsights, its security framework, best practices and standards for development/deployment processes. BigInsights/Netezza Integration, comfortable in usage of the Sqoop, nz UDFs and the related utilities.