Contract: Senior Data Engineer

Upwork ($UPWK) is the world’s work marketplace. We serve everyone from one-person startups to over 30% of the Fortune 100 with a powerful, trust-driven platform that enables companies and talent to work together in new ways that unlock their potential.  

Last year, more than $3.3 billion of work was done through Upwork by skilled professionals who are gaining more control by finding work they are passionate about and innovating their careers. 

This is an engagement through Upwork’s Hybrid Workforce Solutions (HWS) Team. Our Hybrid Workforce Solutions Team is a global group of professionals that support Upwork’s business. Our HWS team members are located all over the world.

Work/Project Scope: 

Despite our success, we believe we can do better, which is why we’ve assembled a world-class team from around the world in fields ranging from computer science and electrical engineering to economics and statistics. If you’re passionate about solving hard problems at big data scale, knowing that your contribution to Upwork is enabling massive economic value and creating social value globally, then please read on.

The ideal candidate for this role will have experience building solutions for machine learning solutions to tackle business challenges. You don’t have to have a degree from one of the world’s top schools, but you’ve already done a few big things in your career and can hang with some of the brightest machine learning engineers, managers and architects in the world. One of your hallmarks is your ability to reconcile business needs with what the data is suggesting to come up with new ideas and approaches for ML teams. In the process, you derive much of your joy at work knowing that your inventions and your job matters. 

If you and the team you’re on are successful, you will change the company and the world.

• As a data engineer on our team, you will play a key role in developing our next-generation data science infrastructure and underlying core technologies. 
• You will work with Upwork’s world-class data scientists, analysts, and engineers to create products that solve important real-world business problems in a collaborative, fast-paced, and fun environment.
• You’ll work closely with our data science team to develop new platforms, infrastructure, and tools that will allow for machine learning applications at production scale over ever-growing datasets.
• Implements enterprise data management concepts (Data Governance, Data Engineering, Data Science, Data Lake, Data Warehouse, Data Sharing, Data Applications)
• Build data pipelines and modern ways of automating data pipelines using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
• Monitor and detect performance issues on Databricks and Spark ETL Pipelines and suggest improvements both on tuning and rewriting.

Must Haves (Required Skills):

• B.S., M.S., or Ph.D. in Computer Science (or a related field) or equivalent work experience
• Extensive hands-on experience (3+ years) working as a Big Data Engineer or Data Engineer or Developer in large-scale data processing and analytics projects.
• Strong proficiency in Spark and PySpark for distributed data processing and analytics.
• Experience designing and implementing large-scale, distributed systems
• Knowledge of workflow management tools like Airflow for orchestrating ETL pipelines.
• Familiarity with version control systems like GitHub for managing codebase.
• Experience with relational models (snowflake) and NoSql models (graph databases, DynamoDB)
• Experience in multi-threaded software development (or some form of parallelism)
• Previous experience working on startups and/or innovation teams
• Experience in working with Cloud providers such as AWS or GCP or Azure.
• Excellent presentation and communication skills, both written and verbal communication
• Experience with CI/CD pipelines using Jenkins for automated build, test, and deployment.
• Experience with ETL processes and query optimization in Databricks.

Upwork is proudly committed to fostering a diverse and inclusive workforce. We never discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical condition), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.   

#LI-BF1

To learn more about how Upwork processes and protects your personal information as part of the application process, please review our Global Job Applicant Privacy Notice