Senior Data Engineer

<p dir="ltr"><strong>About us!</strong><br/><br/>TradingView was founded in 2011 in New York and London with a mission to empower millions of people to achieve success, whatever that means to them. We're building a space where anyone can maximize their chances of succeeding through financial markets because they've got all the best tools and data at their fingertips. Our product portfolio includes best-in-class charts, versatile commercial libraries, a social network, and many more tools for retail and business audiences.</p><p dir="ltr">Now, we're the world's largest financial analysis platform – used by <strong>1</strong><strong>00 million people</strong>, in over 1<strong>80 different countries</strong>. Even Antarctica. Every day, millions of users open TradingView for analysis, collaboration, and finding better trading opportunities.</p><p dir="ltr">To be on top of the game, we’re looking for passionate people to join our team, where <strong>product quality</strong> is everything. If you’re ready to do your best work, collaborate with <strong>cutting-edge technologies,</strong> and <strong>make an impact on millions every day</strong>, look no further  🚀</p><p dir="ltr"><strong>Your mission:<br/><br/></strong>As our user base continues to grow, so does the load on our service. That’s why we are looking for an experienced Data Engineer to contribute to the development of our data platform.</p><p>We maintain and develop infrastructure for <strong>data extraction, processing, loading, monitoring, and visualization</strong> of both product and financial data.</p><p>Our users include TradingView executives who require reports for decision-making, <strong>data analytics experts, ML engineers, and product teams</strong>. In fact, all product divisions at TradingView rely on the data we provide.</p><p><strong>Our Data at a Glance:</strong></p><ul> <li> <strong>500GB+</strong> of raw <strong>Clickstream data</strong> daily</li> <li> <strong>500GB+</strong> of raw <strong>Operational Data</strong> daily</li> <li> <strong>500+</strong> data marts</li> <li> <strong>10+</strong> types of data sources</li> </ul><p>🚨 <strong>IMPORTANT:</strong> We do <strong>not</strong> collect currency or stock quotes for charting or market trading event data.</p><p dir="ltr">This position requires a <strong>high degree of autonomy and independence</strong>, while also involving <strong>close collaboration</strong> with fellow <strong>Data Engineers, Analysts, ML Engineers, and Developers</strong>.</p><p dir="ltr"><strong>What you’ll do:</strong></p><ul> <li>Maintain and develop <strong>Airflow DAGs</strong> </li> <li>Optimize and develop <strong>SQL queries</strong> for data marts</li> <li>Maintain and improve <strong>data platform infrastructure</strong> </li> <li>Develop <strong>dbt models</strong> and migrate existing data marts to dbt</li> <li>Design, develop, and test <strong>ETL/ELT processes</strong> </li> <li>Conduct <strong>Proof of Concept (PoC)</strong> projects, present findings, and implement them in production</li> <li>Participate in <strong>architectural decisions</strong> for the data platform</li> <li>Document the technical aspects of projects</li> </ul><p dir="ltr"><strong>What you bring:<br/></strong></p><ul> <li> <strong>4-5+ years of experience</strong> as a Data Engineer</li> <li> <strong>Proficiency in Python</strong>, especially in writing <strong>Airflow DAGs</strong> </li> <li> <strong>Strong SQL skills</strong> (query optimization, query plan analysis, and performance tuning)</li> <li>Experience with <strong>Apache Airflow</strong> and data pipeline design principles</li> <li>Experience working with <strong>dbt</strong> </li> <li>Familiarity with <strong>MPP (Massive Parallel Processing) databases</strong> (e.g., Redshift, Greenplum, Vertica)</li> <li>Confident <strong>Linux user</strong> </li> <li>Ability to <strong>clearly define technical specifications</strong> and advocate for technical decisions</li> <li>Strong <strong>technical decision-making</strong> skills</li> </ul><p dir="ltr">It’ll also be an advantage if you have experience in:</p><ul> <li>Finance experience or knowledge of Trading</li> <li>Knowledge of TradingView 😁 We also love users who become teammates!<br/> </li> <li>Experience with <strong>AWS cloud infrastructure</strong> for building data platforms</li> <li>Experience in <strong>Lakehouse architecture</strong> using <strong>Parquet, AWS Athena, and other AWS technologies</strong> </li> <li>Experience with <strong>monitoring systems</strong> (e.g., Prometheus + Grafana, Zabbix)</li> <li>Experience with <strong>Postgres, ClickHouse</strong> </li> <li>Experience working with <strong>Apache NiFi</strong> </li> <li>Experience <strong>building and maintaining Docker containers</strong> </li> </ul><ul> </ul><h3 dir="ltr"><strong>Additional information</strong></h3><p dir="ltr">This is a hybrid role based in our Málaga office, located in the heart of the city at the prestigious Muelle Un