Data Engineer - Web Scraper (Remote) at The Dyrt
Portland, OR, US / Remote

The Dyrt is the largest digital camping platform in the world. Every second, a new user visits The Dyrt to access our community-driven campground information.

If you love the outdoors and want to be part of a fast-growing consumer app, you’re in the right place.

The Role

As a Web Scraping focused Data Engineer, you will be responsible for identifying new sources of information, extracting, and ingesting data from those sources using web crawling and other tools. In this role you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports and data management. We will rely on you to test the data and the scrape to insure accuracy and quality. You will own the process to identify and rectify any issues with breaks as well as scale scrapes as needed.

This position will report to the VP of Engineering.

We’re looking for people who:

  • Are great communicators — Effective communication is key to how we work. We value patience and empathy in our product planning, support, and day-to-day relations.
  • Work well both collaboratively and independently
  • Are ready to learn and share knowledge — Everyone comes to our company with their own set of skills and experiences. Cross-training, mentorship, and curiosity all help us build better products.

Key Responsibilities:

  • Identify new sources of campgrounds to aid in filling our lead generation funnel
  • Extract and verify data ingested from various websites
  • Develop tooling to efficiently monitor websites for changes and produce clean changesets
  • Maintain and scale scraping infrastructure as needed

Experience and Requirements:

  • Experience running large scale web scrapes
  • Solid Python knowledge
  • Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking
  • Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
  • Familiarity with extracting data from publicly available API endpoints
  • Experience with system monitoring/administration tools
  • Experience with version control, open source practices, and code review
  • Experience with applications designed to display archived web content

Extra Credit:

  • Experience with Scrapy, Mechanize or other scraping tools

Not sure you meet all of the requirements, but are passionate about the outdoors and have product management experience? We’d still love to hear from you!

Working Here

The Dyrt is built by campers, for campers—whether you’re new to camping or have been camping your whole life.

We encourage everyone to spend more time outside, including employees. We offer competitive market-rate salaries, a generous vacation plan, and we even pay employee bonuses for using The Dyrt in the wild.

This is a full-time remote position. Employees are expected to have high-speed internet and a professional working environment sufficient for clear video conferencing during regular working hours. Many of our employees work virtually from Portland, OR but we’re flexible on location and encourage all to explore. Our founders even work from their van.

The Dyrt is an equal opportunity workplace. We are especially proud to have a female founder and a higher percentage of female employees than the national average for tech companies. We believe that the outdoors are for everyone, and are committed to building an inclusive platform and community that encourages, supports, and celebrates all people interested in camping.

Interested candidates should submit a cover letter and resume.

About The Dyrt

The Dyrt was started in Portland, OR, is venture-backed, and has 40-50 employees working virtually around the U.S.