Data Management Specialist

Requisition Number: 66941

 

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 

The Global Supply Management (GSM) Function is recognized as a critical function for business success.  It delivers the training, tools and opportunities needed to create innovative solutions for the function & the corporation.  GSM has leading edge, effective processes to anticipate and exceed customer requirements.

As a Data Engineer at you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the Global Supply Chain (GSM) in Corning.

What will you be doing?

 

• Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.
• Create, Develop & Implement Data Quality rules within Databricks and connectàexecuteàSync. Data visualization tool, i.e. Power BI.
• Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.
• Utilize Unity Catalog(databricks) to scan End to End Data pipelines i.e. from Data Source to Data Consumption and establish Data Mapping as well as Data lineage.
• Proficiency in designing and building complex data pipelines and data processing systems.
• Develop data models and schemas to support reporting and analytics needs.
• Ensure data quality, integrity, and security by implementing appropriate checks and controls.
• Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
• Ensuring data quality and integrity through data validation, cleansing, and error handling.
• Develop Data Quality Rules using SQL/Python and integrate with Power BI for reporting and data visualization.
• Utilize Alation for data catalog management, standardizing data terminology, and promoting a common understanding of data concepts.
• Data Catalog Management: Utilize Alation to maintain a comprehensive data catalog, ensuring that data assets are accurately described, categorized, and searchable.
• Data Lineage and Profiling: Create and manage data lineage diagrams using Alation to track the flow of data throughout our organization. Perform data profiling to identify data quality issues.
• Data Glossary Management: Maintain and expand the data glossary in Alation, standardizing data terminology and promoting a common understanding of data concepts.
• Develop and manage data architectures in line with business needs, considering scalability, reliability, and security.
• Use front-end development tools to design intuitive user interfaces for data visualization.
• Write, test, and debug code in Python, SQL, and JavaScript, following best coding practices.
• Manage database operations and optimization using various database tools.
• Leverage AWS services for data storage, processing, and analytics tasks.

 

Who will you be interacting with?

• IT solution architects
• Business DMOs
• GSM and Shared Services global process owners
• Power users & super users