Full Stack Data Collection Engineer

Would you like to use your full stack engineering skills to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces? Two Six Technologies provides Information Advantage to Government, Military, and Fortune 50 customers tasked with mission critical decision making. 

Our products collect and synthesize huge quantities of publicly available data in multiple languages, then serve that data to be easily queried by our expert analysts and used in machine learning analytics. As a data collection engineer you will work with product engineering teams, data scientists, devops, and architects, to design and implement data collection solutions at scale, using the latest approaches and technologies in the web scraping space.

As a top candidate you have extensive knowledge of HTTP, HTML, CSS, JavaScript, and other web technologies, and you understand how these technologies interact to make websites work. You have previously built and maintained web scraping tools that navigate and collect publicly available data online at scale. You also enjoy working out novel solutions to technical challenges, and staying current with the latest developments in the web scraping community. 

You have experience working with AWS, Linux, and ideally with technologies like Docker and Kubernetes. You also have been a member of remote engineering teams working in Agile software development environments. Ideally you have experience with Python or similar programming and scripting languages. Previous experience collecting data in languages other than English is another plus.

Most importantly you share our passion for applying technology to solve hard problems and finding innovative ways to collect and derive insights from high-volume data.

What you will do:

• Developing and enhancing high volume data collection solutions that enable analysis by both human experts and machine learning solutions
• Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
• Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
• Considering security best practices at every phase of software development
• Continuously learning and improving
• Working within Agile software development methodologies and being an active part of our continuous improvement efforts
• Working in a fully remote team with a diverse set of skills and experiences
• Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions 
• Actively participating in the peer code review process
• Creating and executing both manual and automated testing

What you will need:

• Experience with web scraping and other techniques for collecting data from the internet
• Deep understanding of HTTP, HTML, JavaScript, CSS, and other technologies that power websites 
• Experience with Python or similar languages 
• Experience with AWS or similar cloud-based infrastructure
• Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
• Experience working independently and as a part of an Agile team

Nice If You Have: 

• Experience with Scrapy a huge plus 
• Experience with Object Oriented Programming (OOP)
• Experience with database technologies, ideally Elastic and Postgres
• AWS certification

Clearance Requirements:

• Eligibility for Security clearance

Location

• 100% Remote

Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law. 

If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to accomodations@twosixtech.com. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.

Additional