Conversation #q4ismna

Recent tws in this reply to #q4ismna

Had to destroy all crawled/indexed data for Yarns and the public instance at search.twtxt.net Sorry ๐Ÿค— Refactored a bunch of stuff, improved performance, respect Last-Modified, re-crawl seed urls daily and add metadata to crawled/scraped feeds so we can do interesting things with that later (fetch time moving average, new updates moving average, last updated and last crawled) ๐Ÿคž


#q4ismna
There are no twts yet... come back later!
You must be Logged in to join the conversation.