Lead Data Engineer

Calling All Upstarters!

LEAD DATA ENGINEER WANTED!

We are Upstart 13. We are humble, hungry, and competent people who are radically changing the expectation and experience of outsourcing for all participants by challenging barriers that create inequality and by bringing down borders in technology for people everywhere. We’re all about delivering value and doing big things. We have become a game-changer for teams around the world who look to Upstart’s services as a differentiator.

Job Description:

We are looking for a Latin-American-based Lead Data Engineer to join our international team. In this position, you will spearhead the development of a data strategy, architecture, data pipeline, and data warehouse/lake/lakehouse design. This role is crucial in supporting data analytics and AI teams by ensuring data is accessible, reliable, and scalable. Additionally, you will oversee project execution and mentor different teams of data engineers, fostering a culture of technical excellence and innovation. The ideal candidate will have a proven track record in data engineering, leadership skills, and a deep understanding of both traditional and modern data architectures and processing frameworks.

Responsibilities:

Data Architecture and Strategy:

• Design, construct, install, test, and maintain highly scalable data management systems.
• Ensure systems meet business requirements and industry practices for security and privacy.
• Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
• Research opportunities for data acquisition and new uses for existing data.
• Develop data set processes for data modeling, mining, and production.
• Integrate new data management technologies and software engineering tools into existing structures.
• Create custom software components and analytics applications.

• Evaluate emerging technologies and data processing frameworks to enhance data infrastructure and analytics capabilities.
• Lead the adoption of state-of-the-art data engineering tools, technologies, and practices.

• Develop and enforce policies for data governance, quality, and retention to ensure compliance with industry standards and regulations.
• Implement mechanisms for monitoring data quality and integrity, ensuring the availability of accurate and reliable data for decision-making.

• Work closely with data scientists, business analysts, and IT professionals to ensure seamless data integration and accessibility for analytics and reporting.
• Provide expert guidance and support on data-related issues to various stakeholders within the organization.

Qualifications

Experience:

• Bachelor's or Master’s degree in Computer Science, Information Technology, Data Science, or a related field.
• 10+ years of experience in data engineering, including a proven track record of successful leadership in designing and deploying scalable data systems.
• Strong experience in data engineering, data warehousing, and data modeling.
• Expertise in SQL and experience with big data technologies (e.g., Hadoop, Spark).
• Proficiency in programming languages for data engineering (e.g., Python, Java).
• Experience with Azure Fabric and understanding of data pipeline and workflow management tools.
• Excellent leadership skills with experience leading data engineering teams.
• Strong analytical skills and ability to work with large, complex data sets.

Soft skills: 

• Exceptional analytical and conceptual thinking skills.
• Strong leadership and mentorship abilities, capable of guiding and inspiring a team.
• Excellent communication and interpersonal skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
• Commitment to staying informed about industry trends, technologies, and best practices in data engineering.
• Willingness to be you, show you care, and solve problems.

Bonus skills: 

• Any Microsoft Certification is a big plus.
• Microsoft Fabric is a big plus.
• Hands-on professional ex