Data Engineer

Company Description

Join a multibillion-dollar global company that brings together amazing technology, people, and operational scale to become a powerhouse in the memory industry. Headquartered in Rancho Cordova, California, Solidigm combines elements of an established, successful technology company with the spirit, agility, and entrepreneurial mindset of a start-up. In addition to the U.S. headquarters and other facilities in the U.S., the company has international presence in Asia, Europe, and the Americas. Solidigm will continue to lead the world in innovating new Memory technologies with aspirations to be the #1 NAND memory company in the world. At Solidigm, we view problems as opportunities to define innovative solutions that hold the power to change the world and unleash the potential technological needs that the future holds. At Solidigm, we are One Team that fosters a diverse, equitable, and inclusive culture that embraces individual uniqueness and empowers us to bring our best selves to deliver excellence in support of Solidigm's vision and mission to be the go-to partner for optimized data storage solutions. You can be part of the takeoff of an innovative business that develops cutting-edge products, delivers strong business value for customers, provides an engaging workplace for its employees, and serves a greater impact on the world. This is a golden opportunity for the right applicant to join us and help design, build, and lead Solidigm. We want a diverse team of dedicated professionals who will not just be Solidigm team members but contribute to how we shape the future of the organization. We are seeking applicants who will grow and thrive in our culture; be customer inspired, trusting, innovative, team-oriented, inclusive, results driven, collaborative, passionate, and flexible.

Job Description

We are seeking a skilled and motivated Data Engineer to join our global and innovative team of data professionals. The ideal candidate will have extensive experience in ETL processes, Python programming, Kubernetes, GitHub, SQL and system monitoring. This role involves modernizing, designing, developing, and maintaining our backend manufacturing data architecture. You will work closely with various teams to understand data requirements and deliver solutions that drive business insights and efficiencies.

Develops, implements, and maintains computer-based systems to meet business requirements. Application Developers analyze, design, construct, train, and implement application systems. Activities include documenting decisions, adhering to standards and communicating with business groups. Other responsibilities may include providing standards/guidelines for development, responding to customer/client requests or events as they occur, and developing solutions to problems utilizing formal education and judgement.
 

Key Responsibilities:

• Programming:
  • Write clean, efficient, and maintainable code for data manipulation and automation tasks.
  • Ability to read, debug, support and improve code written by other developers.
  • Develop and implement data processing scripts and workflows.
  • Use GitHub for version control, code reviews, CI/CD, and collaboration with team members.
• Kubernetes:
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure the scalability, reliability, and performance of data infrastructure on Kubernetes.
• Databases:
  • Manage and optimize databases in SingleStore, Microsoft SQL, and MySQL environments.
  • Ensure data integrity, security, and performance across database systems.
• ETL Processes:
  • Design, develop, and maintain ETL pipelines to ensure seamless data flow across various sources and destinations.
  • Optimize ETL processes for performance, scalability, and reliability.
• Monitoring and Logging:
  • Implement and configure monitoring solutions to track system performance, data pipelines, and applications.
  • Set up alerts and dashboards to proactively address issues and ensure system health and best practices.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in ETL tools and processes.
• Expertise in Python and C# programming languages.
• Experience with Azure and cloud services.
• Proficiency with container orchestration using Kubernetes.
• Familiarity with version control systems and CI/CD, particularly GitHub and GitHub Actions.
• Experience with SingleStore, Microsoft SQL, and MySQL databases.
• Knowledge of monitoring tools like Datadog or Grafana.
• Excellent problem-