Senior Data Engineer

Life at Ness: At Ness, people come first. Here, you'll be part of a vibrant team that values curiosity, innovation, and growth. We work with industry-leading clients on projects that truly make an impact while supporting every team member in carving out their unique career path. With resources for learning, certifications, and hands-on experiences, Ness offers you more than just a job - it’s a place where your ideas, ambition, and well-being matter.Job Description: We are looking for a Senior Data Engineer with excellent problem-solving and debugging skills, a keen eye for detail, and a high level of commitment and motivation. The ideal candidate should be capable of working independently and collaboratively, taking the lead. Effective communication with management and stakeholders about issues, incidents, and updates in a timely manner is also paramount. Further, this would require the Engineer to work in hybrid mode, 3-4 days from office.  • At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. 
• Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.
• Strong Application development experience in Scala/Python.
• Strong Database SQL experience, preferably Redshift.
• Experience in Snowflake is an added advantage.
• Experience with ETL/ELT process and frameworks is a must.
• Create integration and application technical design documentation.
• Conduct peer-reviews of functional design documentation.
• Complete development, configuration, test cases and unit testing 
• Perform code reviews and ensure standards are applied to each solution component.
• Resolve complex defects during testing phases and identify root causes.
• Support and execute performance testing.
• Familiar with Git repo and CI/CD deployment process
• Production Support: Assist in troubleshooting production environment and tuning environments.
• Ensure best practices are followed from a technical perspective during all phases of the project.