Had to destroy all crawled/indexed data for Yarns and the public instance at search.twtxt.net Sorry 🤗 Refactored a bunch of stuff, improved performance, respect Last-Modified, re-crawl seed urls daily and add metadata to crawled/scraped feeds so we can do interesting things with that later (fetch time moving average, new updates moving average, last updated and last crawled) 🤞