Comments on: Extracting The Main Content From a Webpage http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/ Slightly Advanced Computer Stuff (and some magic) Fri, 20 Nov 2009 22:08:06 +0200 http://wordpress.org/?v=2.8.6 hourly 1 By: ø Detecting Parked Domains | W-Shadow.com ø http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-32392 ø Detecting Parked Domains | W-Shadow.com ø Fri, 13 Nov 2009 20:14:30 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-32392 [...] a related note, my content extraction script could also be used for detecting is a site is low on actual content. Its algorithm is much simpler [...] [...] a related note, my content extraction script could also be used for detecting is a site is low on actual content. Its algorithm is much simpler [...]

]]> By: Dohn » links for 2009-07-15 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-30856 Dohn » links for 2009-07-15 Wed, 15 Jul 2009 08:33:03 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-30856 [...] ø Extracting The Main Content From a Webpage | W-Shadow.com ø [...] [...] ø Extracting The Main Content From a Webpage | W-Shadow.com ø [...]

]]> By: digiwebtools http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-30170 digiwebtools Tue, 12 May 2009 13:55:30 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-30170 Wow, that's what i am looking for! I'll try and give some feedback here. Thank you. Wow, that’s what i am looking for!
I’ll try and give some feedback here.
Thank you.

]]> By: White Shadow http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-20388 White Shadow Wed, 11 Mar 2009 18:29:25 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-20388 You could easily do that with a few regular expressions. However, I'm not doing your homework :P You could easily do that with a few regular expressions. However, I’m not doing your homework :P

]]> By: pahinettambadi http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-20307 pahinettambadi Wed, 11 Mar 2009 06:43:34 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-20307 hi i tried this html extractor and it is very useful..so i need another script for extracting img only and also leaving advertisement seperate.. thank u.. by pathy hi i tried this html extractor and it is very useful..so
i need another script for extracting img only and also leaving advertisement seperate.. thank u..
by
pathy

]]> By: White Shadow http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-12310 White Shadow Mon, 28 Jul 2008 09:31:45 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-12310 Heh, thanks :) For some sites you might need to tweak the $ratio parameter of the extract() method manually. The function tries to calculate a reasonable default if you leave it unspecified but this automatic calculation doesn't work for some webpage designs. Heh, thanks :)

For some sites you might need to tweak the $ratio parameter of the extract() method manually. The function tries to calculate a reasonable default if you leave it unspecified but this automatic calculation doesn’t work for some webpage designs.

]]> By: Rizqinofa http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-12304 Rizqinofa Mon, 28 Jul 2008 02:41:10 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-12304 yes, it works really great, it's like magic :D i found most of website i try is parsed correctly, it's working good but i found some website which using table based and ecommerce site is not working, i wonder why ? some of website which not shown main content using this script - http://www.cibuku.com/secret-happiness-p-2656.html - http://www.kutukutubuku.com/product_info.php?products_id=53 - and some other ecommerce website thanks! yes, it works really great, it’s like magic :D
i found most of website i try is parsed correctly, it’s working good

but i found some website which using table based and ecommerce site is not working, i wonder why ? some of website which not shown main content using this script
– http://www.cibuku.com/secret-happiness-p-2656.html
- http://www.kutukutubuku.com/product_info.php?products_id=53
- and some other ecommerce website

thanks!

]]> By: fp http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-12001 fp Thu, 05 Jun 2008 15:14:43 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-12001 aah...! my fault. i looked at it from console and first thought, it'll strip the whole html out of the page, not just partwise :) thanks for the fast answer. gonna start a python port now. :) aah…! my fault. i looked at it from console and first thought, it’ll strip the whole html out of the page, not just partwise :)

thanks for the fast answer. gonna start a python port now. :)

]]> By: White Shadow http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-12000 White Shadow Thu, 05 Jun 2008 14:52:14 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-12000 It works here. It returned most of the actual content (text), but stripped out navigation, menus, images etc. So it works as it's supposed to. It works here. It returned most of the actual content (text), but stripped out navigation, menus, images etc. So it works as it’s supposed to.

]]> By: fp http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/comment-page-1/#comment-11999 fp Thu, 05 Jun 2008 14:40:18 +0000 http://w-shadow.com/blog/2008/01/25/extracting-the-main-content-from-a-webpage/#comment-11999 hmm... does this class still work? i get always the full html back from your wikipedia example. cheers hmm… does this class still work?
i get always the full html back from your wikipedia example.

cheers

]]>