StupidOS: A high-precision approach to boilerplate removal
Stefan Evert · 2007
StupidOS is a naive approach to boilerplate removal from English Web pages, based on n-gram models trained on the FIASCO gold standard. Despite its simplicity, the algorithm achieves a significant improvement over the baseline and trades off recall for substantially higher precision. Even the prototype implementation of StupidOS in pure Perl is lightweight and fast enough to process billions of words.