Data Engineer

Job Description & Skill Requirement:

Highly seasoned Data engineer to carry out complete implementation of functional requirements, end to end.

Required:
- Experience in creating, maintaining and managing Hadoop clusters
- Experience in development to centered around big data applications, and adhoc transformation of unstructured raw data
- Experience in Relational DBA experience, preferably with experience in SQL Server and/or MySQL.
- Design, build, and maintain Big Data workflows/pipelines to process continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.
- Demonstrated work experience in the following with Big Data and distributed programming models and technologies
- Knowledge of database structures, theories, principles and practices (both SQL and NoSQL).
- Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines
- Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive