Had massive data-loss due to a win10 update recently, a scraping tool i ahven't used for years but want now that i've forgotten the name of, it was basic, HTML reports, generated MASSIVE spreadsheets due to the cross-referencing (many GBs) and was free ?
Screaming frog?
https://www.screamingfrog.co.uk/seo-spider/
Xenu?
Xenu! Thanks Adam :)