Senior Software Engineer, Big Data

Attentive® is the AI-powered SMS and email marketing platform that delivers unparalleled messaging performance on the channels that matter most. Infusing intelligence at every stage of the consumer's purchasing journey, Attentive empowers businesses to achieve hyper-personalized communication with their customers on a large scale. Leveraging AI-powered tools, a mobile-first approach, two-way conversations, and enterprise-grade technology, Attentive drives billions in online revenue for brands around the globe. Trusted by over 8,000 leading brands such as CB2, Urban Outfitters, GUESS, Dickey’s Barbeque Pit, and Wyndham Resort, Attentive is the go-to solution for delivering powerful commerce experiences for consumers with the brands they love.
Attentive’s growth has been recognized by Deloitte’s Fast 500, Linkedin’s Top Startups and Forbes Cloud 100 all thanks to the hard work from our global employees!
Who we areOur engineering department consists of 200+ people across multiple teams, such as application development, infrastructure, data platform, machine learning, and security. We believe our company will win in the long run through product innovation. To get there, we obsess over iteratively delivering customer value through rapid prototyping and data-driven decision-making. 
We’re looking for a self-motivated, highly driven Big Data Engineer to bolster our Data Platform teams. Our team is focused on building the data platform to support data driven products and strategic outcomes for our customers. We do this by providing an extensible and flexible compute platform to access highly available, mission critical data sets.

Why Attentive needs you

• Architect high-throughput data solutions that power our most critical operations, ensuring scalability and efficiency.
• Expand and enhance our self-service data platform, collaborating with cross-functional teams to fuel our AI, ML, and analytics goals.
• Tackle complex distributed data challenges, streamline system integrations, and uphold high standards of data quality and governance.
• Lead the charge in automating data workflows, driving innovation and enabling rapid prototyping across our entire data ecosystem.
• Champion cutting-edge big data technologies, keeping our platform at the forefront of industry advancements and enabling strategic outcomes.
• Unify data from diverse systems, paving the way for experimentation and innovation while empowering teams with intuitive tools and frameworks.

About you

• Proven experience as a Software Engineer with a focus on large-scale data processing.
• In-depth knowledge of big data technologies such as Hadoop, Spark, Flink and/or Kafka.
• Proficiency in Java and strong understanding of object-oriented design, data structures, algorithms, and optimization.
• Experience with ETL and Data pipeline orchestration tools like Apache Airflow, dbt, etc.
• You have development experience with data tools such as Snowflake, Google BigQuery, Databricks Lakehouse, AWS Athena, Apache Trino, or Presto
• You’ve experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi
• You are knowledgeable about data modeling, data access, and data replication techniques, such as CDC. 
• You have a proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform
• You are excited by new technologies but are conscious of choosing them for the right reasons

Our scale

• 8,000 brands powered by Attentive sent over 2.2 billion text messages over Cyber Week 2023 (Black Friday/Cyber Monday) representing a growth of 31% from 2022.
• We sent 32 billion SMS messages in 2023, up 32% YoY. That’s an average of 87 million per day.
• Our production cluster contains over 18,000 containers which serve 200+ services.
• Our streaming services process over 80 billion events per month.

What we use

• We use a wide variety of technology and we’re always looking for the best solutions to solve hard problems.
• Our backend is Java / Spring Boot microservices, built with Gradle, coupled with things like DynamoDB, Pulsar, AirFlow, Postgres, Planetscale, and Redis, hosted via AWS.
• Our frontend is built with React and TypeScript, and uses best practices like GraphQL, Storybook, Radix UI, Vite, esbuild, and Playwright.

You'll get competitive