Senior Data Infrastructure Engineer

<h1><strong>About Workato</strong></h1> <p>Workato is the only integration and automation platform that is as simple as it is powerful — and because it’s built to power the largest enterprises, it is quite powerful. </p> <p>Simultaneously, it’s a low-code/no-code platform. This empowers any user (dev/non-dev) to painlessly <a href="https://academy.workato.com/quickstart-introduction">automate workflows</a> across any apps and databases.</p> <p>We’re proud to be named a leader by both <a href="https://resources.workato.com/forrester-wave-ipaas/">Forrester</a> and <a href="https://discover.workato.com/gartner-ipaas-mq/p/1">Gartner</a> and trusted by 7,000+ of the world's top brands such as <a href="https://blog.workato.com/2019/09/box-workflow-automation/#.XysqY5NKjlw">Box</a>, <a href="https://blog.workato.com/2018/12/how-grab-asias-hottest-startup-has-saved-3000-man-hours-with-chatops-and-automation/#.Xys-i_gzblx">Grab</a>, <a href="https://medium.com/slack-developer-blog/slack-on-slack-delivering-impactful-internal-products-9f3e62403492">Slack</a>, and more. But what is most exciting is that this is only the beginning. </p> <h1><strong>Why join us?</strong></h1> <p>Ultimately, Workato believes in fostering a <strong>flexible, trust-oriented culture that empowers everyone to take full ownership of their roles</strong>. We are driven by <strong>innovation </strong>and looking for<strong> team players </strong>who want to actively build our company. </p> <p>But, we also believe in <strong>balancing productivity with self-care</strong>. That’s why we offer all of our employees a vibrant and dynamic work environment <a href="http://www.workato.com/careers">along with a multitude of benefits</a> they can enjoy inside and outside of their work lives. </p> <p>If this sounds right up your alley, please submit an application. We look forward to getting to know you!</p> <p>Also, feel free to check out why:</p> <ul> <li> <p><a href="https://www.businessinsider.com/47-enterprise-startups-to-bet-your-career-on-in-2020-2019-12">Business Insider</a> named us an “enterprise startup to bet your career on”</p> </li> <li> <p><a href="https://www.forbes.com/cloud100/#a57477b5f941">Forbes’ Cloud 100</a> recognized us as one of the top 100 private cloud companies in the world</p> </li> <li> <p><a href="https://www2.deloitte.com/us/en/pages/technology-media-and-telecommunications/articles/fast500-winners.html">Deloitte Tech Fast 500</a> ranked us as the 17th fastest growing tech company in the Bay Area, and 96th in North America</p> </li> <li> <p><a href="https://qz.com/work/2053446/the-best-companies-for-working-from-home/">Quartz</a> ranked us the #1 best company for remote workers</p> </li> </ul><h1><strong>Responsibilities</strong></h1> <p>As a <strong>Senior Data Infrastructure Engineer </strong>you will be responsible for deploying, scaling and maintenance of services at the core of Workato Data Platform such as analytical data storages, real time ingestion services, data lakes, orchestration tools. You will closely work with Data Engineers, and Developers as a part of a small, flexible team and will have a direct impact on the process of modernisation and maturation of the platform including infrastructure architecture decisions.</p> <p>Workato Data Platform is based on the industry leading technologies such as Snowflake Data Warehouse, Clickhouse Database, Airflow, Apache Kafka and AWS (RDS, Lambda, Fargate, etc), Prometheus, VictoriaMetrics and Workato SAAS solution itself for collecting data from third party business supporting services. We are currently working on upgrading the platform to meet new requirements of rapidly growing business such as:</p> <ul> <li> <p>Increase the confidence in analytical data.</p> </li> <li> <p>Make a clearest possible vision of the user journey.</p> </li> <li> <p>Minimize the gap between data emitting and data availability for analytical purposes.</p> </li> <li> <p>Support for a fast growing amount of data.</p> </li> </ul> <p>We plan to achieve this by adopting some additional leading edge technologies such as DBT, Trino, Kafka Streams, Kafka Connect and DataHub unified metadata management platform. Thus, you will work with the technologies that are relevant in the industry and will have challenging tasks.</p> <h1><strong>Requirements</strong></h1> <h3><strong>Qualifications / Experience / Technical Skills</strong></h3> <ul> <li> <p>8+ years of trackable work experience with deploying and supporting data-intensive services.</p> </li> <li> <p>Production experience with building deployments of services commonly used as a part of data platform stack such as Kafka, Debezium, Airflow, Trino/Presto, Spark, Flink, Clickhouse, S3, Firehose, Kinesis, Snowflake, Big Query, Red Shift.</p> </li> <li> <p>Experience monitoring, logging, and analyzing service health. Ability to troubleshoot common bottlenecks of data intensive applications.</p> </li> <li> <p>Experience with managing complex infrastruct