Lead Quality Assurance Engineer – Big Data

Lead Quality Assurance Engineer – Big Data

Location: San Jose, CA

The Williams-Sonoma, Inc. Data Platform organization is looking for you, an engaged and experienced Lead Quality Assurance Engineer - Big Data to build analytics and ML platform to collect, store, process, and analyze huge sets of data spread across the organization. The platform will provide frameworks for quickly rolling out new data analysis for data-driven products and micro-services. The platform will also enable machine/deep learning infrastructure that operationalizes data science models for broad consumption. As a Lead QA Engineer in the Big data Analytics organization, you'll join a small team focused on the delivery of the platform and actionable insights which moves the needle.

 KEY JOB FUNCTIONS

• Develop and execute complex software tests such as systems, integration, and regression testing to ensure the quality of software. 
• Using structured QA methodology, creates complex test cases, scripts and plans to support specific software testing objectives. 
• Conducts internal and external specifications reviews for functionality and testability.
• Demonstrate understanding and application of appropriate formal test design techniques. 
• Defines, tracks and reports on quality assurance metrics such as defects, defect counts, test results and test status.
• Performs quality audits across the various Tech functions to ensure quality standards, procedures, and methodologies are being followed. 
• Anticipate risks and provide contingency solutions and timelines. 
• Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practices.
• Facilitate problem diagnosis and resolution in technical and functional areas.
• Encourage change, especially in support of quality engineering best practices. 
• Write high-quality tests that are consistent with our standards, creating new standards as necessary.
• Demonstrate correctness with pragmatic automated tests.
• Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices.
• Develop strong working relationships with others across levels and functions.
• Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest.
• Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain.
• Serve as a member of an agile engineering team and participate in the team's workflow.
• Lead and mentor junior and senior engineers.

REQUIREMENTS AND QUALIFICATIONS

• 8 + years of experience as a professional QA engineer or software engineer
• 7+ years of experience with big data technologies including data warehouses
• Prior experience leading a team of 3 or more
• Experience in testing, distributed, scalable data pipelines that ingest and process data at scale and in batch and real-time
• Strong knowledge of programming languages/tools including Java, Scala, Python, Spark, SQL, and Hive 
• Experience with cloud-based data warehouses such as Snowflake
• Experience with streaming technologies such as Spark streaming
• Experience with various messaging systems, such as Kafka
• Experience working with Lambda Architecture
• Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, and/or Couchbase
• Familiarity with ML and Deep Learning
• Working knowledge of various columnar storage such as Parquet Kudu, and ORC
• An understanding of software development & testing best practices
• Enthusiasm for constant improvement as a Quality Engineer
• Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion
• Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood
• Ability to work independently on complex problems of varying complexity and scope
• Bachelor's degree in Computer Science, Engineering or equivalent work experience
  
   

We believe i