Question

Often I would want to scan an entire directory tree (a directory, and everything inside it, including files, subdirs, and those subdir contents too, and their subdir contents too, etc etc).

How would one accomplish this with node? Requirements, is that it should be asynchronous to take advantage of super fast non-blocking IO – and not crash when processing too many files at once.

Answer 1

— I’ve updated this answer in 2017 for the progress since 2012 —

Ended up creating these to accomplish it:

• https://github.com/bevry/safefs – which now uses https://npmjs.org/package/graceful-fs (which didn’t exist before)

• https://github.com/bevry/scandirectory – there is also now a vast array of like projects like this

I also created this which is lightweight and super fast:

• https://github.com/bevry/readdir-cluster