A modern web crawling programming language (written in Rust)

54 points detsood

Hello everyone!

I’ve been working on tools to make web crawling / scraping more approachable. My most recent project is ScoutLang - a web crawling DSL written in Rust.

Scout aims to combine a simple and easy to learn syntax with powerful web crawling capabilities, allowing anyone to gather web data with just a few lines of code.

Scout is still brand new so I’d love any comments or feedback you might have! Scout will always be free and open source under MIT and Apache 2.0.