Test Lead - Data

Big Data Lead Responsibilities Design & Implement Data ingestion and Data lakes-based solutions using Big Data Technologies. The Tech Lead should be highly proficient in the use of Big Data / Open-Source Technologies and standard techniques of Data Integration, Data Manipulation. Should be able to design and develop cost efficient and performant data pipelines in the cloud platform Create data environment to support our data analytics, reporting and data science teams Experience with integration of data from multiple data sources Knowledge of various Data Pipeline techniques and frameworks Performance optimization - need to monitor the complete process and apply necessary infrastructure changes to speed up the query execution. Efficient data ingestion - Discovering patterns in data sets with data mining techniques and using different data ingestion APIs and inject data into the data lake as per need.