Platform Software Engineer

As a Cloud Data Platform Specialist, you will be a vital member of our Enterprise Data Platforms team, tasked with driving the evolution and optimization of our data capabilities on the Google Cloud Platform (GCP). This role is central to ensuring that our data infrastructure is scalable, efficient, and aligned with the latest technological advancements.

You will be responsible for designing and implementing cutting-edge data solutions that leverage a blend of cloud-native technologies, service-oriented architectures (SOA), and microservices. Your role will require a comprehensive understanding of both front-end and back-end development to ensure seamless integration and operation of the platform's components.

In this position, you will work closely with cross-functional teams, including data architects, software engineers, and business stakeholders, to translate complex business requirements into robust and scalable data solutions. Your full-stack expertise will be crucial in facilitating the development of user-friendly interfaces and data exploration tools, ensuring that users across the organization can access and interact with data efficiently and effectively.

Moreover, you will lead efforts in data ingestion, integration, and governance, ensuring that data is standardized, secure, and optimized for analytics. This includes implementing GCP’s native security features and best practices to protect sensitive information. Your role will also involve ongoing performance monitoring and optimization to enhance the scalability, efficiency, and reliability of data pipelines and storage solutions.

Additionally, you will champion automation initiatives to streamline platform processes, reduce manual intervention, and improve overall operational efficiency. Your ability to adapt to new technologies and methodologies will be essential in fostering innovation and ensuring that our data platform remains at the forefront of industry standards.

Ultimately, your contributions will directly impact our organization's ability to leverage data for strategic decision-making and business growth, making this role pivotal to the success of our data governance and platform services.

Architect and Develop Data Pipelines: Lead the design and development of scalable data pipelines and microservices, facilitating both real-time and batch data processing on GCP. Ensure data pipelines are efficient, reliable, and capable of handling large volumes of data.

Implement SOA and Microservices: Design and implement service-oriented and microservices-based architectures to promote modularity, flexibility, and maintainability within the data platform.

Full-Stack Integration: Collaborate with front-end and back-end developers to integrate various platform components, ensuring robust data access and seamless user interface-driven data exploration experiences.

Data Ingestion and Integration: Oversee the ingestion and integration of data from diverse sources, ensuring it is standardized and optimized for analytical needs. This includes working with both structured and unstructured data.

Leverage GCP Services: Utilize GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Functions to build and manage data solutions that align with business objectives and enhance data accessibility and usability.

Data Governance and Security: Establish and manage data governance practices, access controls, and security measures. Implement GCP’s native security features, including row- and column-level security, to protect sensitive data.

Optimize Performance: Continuously monitor system performance and implement optimizations to enhance the scalability, efficiency, and reliability of data pipelines and storage solutions.

Collaborate and Establish Best Practices: Work with data architects, software engineers, and cross-functional teams to define and promote best practices, design patterns, and frameworks for cloud data engineering.

Automate Processes: Develop and implement automation strategies to streamline data platform operations, improve reliability, and minimize manual intervention.

Education & Experience:

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or equivalent work experience.
• A Master’s degree or equivalent experience is preferred, demonstrating advanced knowledge and specialization.
• 5+ years in software engineering, a combination of data engineering and software engineering will be considered
• 2+ years dedicated to cloud data platforms, preferably on GCP

 

Technical Skills:

• Proficiency in programming languages such as Java, Python, and JavaScript frameworks (e.g., Angular).
• De