Jobs and Careers
KI

Principal Big Data Architect

KION Group
United Statesfull_timeVerifiedPosted 5 Dec 2023
💰 $198,000/yr($94,000/yr$198,000/yr)

About the role

As customers grapple with the challenges of e-commerce fulfillment with ever increasing need to handle more volume, variety and variation with ever decreasing delivery time expectations, Dematic’s growth directly depends on bringing the next generation of intelligent supply chain solutions to market. These solutions include flexible order fulfillment, warehouse management systems, warehouse and supply chain execution systems, and supply chain optimization. These solutions employ cloud-native and AI / ML technologies, and work with a blend of fixed and mobile automation (e.g., autonomous mobile robots). A key strategy for Dematic to deliver on these growth priorities is to create a Big Data Platform that will support operational analytics, process optimization, training of Machine Learning models and other differentiating features for Dematic customers.  This position is within the Dematic Software R&D team and will provide technical and architectural leadership to define and implement the Big Data Platform.

What we offer:

  • What We Offer:

    • Career Development
    • Competitive Compensation and Benefits
    • Pay Transparency
    • Global Opportunities

     

    Learn More Here: https://www.dematic.com/en-us/about/careers/what-we-offer

     

    Dematic provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

     

    This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

    The base pay range for this role is estimated to be $94,000.00 - $198,000.00 at the time of posting. Final compensation will be determined by various factors such as work location, education, experience, knowledge and skills.

    #LI-DP1

Tasks and Qualifications:

This is What You Will do in This Role:

  • Design and develop the overall big data architecture, ensuring it aligns with the company's strategic objectives and business requirements.
  • Lead all data platform initiatives: Data Lake Strategy, Data Governance, Data Security and Compliance, Data Platform Cloud Infrastructure, MLOps and Master Data Management.
  • Develop data models and data integration patterns for various data sources, enabling seamless data flow across the enterprise.
  • Provide technical leadership and guidance to the development team, ensuring best practices and standards are followed in big data projects.

What We are Looking For:

  • 5+ years of industry experience architecting and designing holistic Big Data Platforms
  • Expertise in Big Data Platform architecture with a focus on scalability, performance, and cost to serve.
  • Expert level hand-on experience in cloud technologies in GCP, AWS or Azure (preferably GCP)
  • Expertise in architecting, designing, and building end to end data platforms in the GCP environment using BigQuery and other services while adhering to best practices guidelines such as open standards, cost, performance, time to market and minimize vendor lock.
  • Hands-on experience in architecting and designing solutions using Big Data table formats like Apache Iceberg, Apache Druid or Apache Delta Lake
  • Proficient in setting up and defining observability tools and metrics, including Grafana, Splunk, Datadog.
  • Expert level understanding and experience designing cloud Data models.
  • Working knowledge of Python, Java, Pyspark, Airflow.
  • Expertise in enterprise data management policies and principles with a focus on data lineage and data cataloging strategy
  • Deep expertise of architectural patterns for real-time and batch data processing at large scale.
  • Ability to draft proposals of cost vs. use/benefit of proposed architectural changes.
  • Expert level understanding and use of software and data engineering design principles and best practices
  • Understanding of modern SDLC processes (Agile, CI, CD, etc.) and how architecture fits
  • The ability to think strategically and align design and architecture patterns to drive current needs as well as future growth
  • The ability to tailor technical communications to any level (Exec to Jr. Software Engineers)
  • Bachelor’s degree in business, Computer Science, Information Technology, Engineering or equivalent.
  • Applicants must be authorized to work f

Apply for this role

Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.

Apply Now →Generate Application Kit

Free account required — sign up in 30s

Company

KION Group

View company profile →