Old post, but some feedback can not harme.

Your script works fine, except in these situations:

1. Page with meta robots nofollow, noindex or none

2. If the remote page is restricted in the robots.txt

3. If there is not linked to the page from the main index file.

Thanks for sharing.