下载网页的本地副本



我想下载一个网页的本地副本,并获得所有的css、图像、javascript等。

在之前的讨论中(例如这里和这里,两者都有两年多的历史),通常会提出两个建议:wget -p和httrack。然而,这些建议都失败了。我非常感谢使用这两种工具中的任何一种来完成任务;备选方案也很不错。


选项1:wget -p

wget -p成功下载了网页的所有先决条件(css、images、js)。但是,当我在web浏览器中加载本地副本时,页面无法加载必备组件,因为这些必备组件的路径尚未从web上的版本中修改。

例如:

  • 在页面的html中,需要更正<link rel="stylesheet href="/stylesheets/foo.css" />以指向foo.css的新相对路径
  • 在css文件中,background-image: url(/images/bar.png)同样需要进行调整

有没有办法修改wget -p以使路径正确?


选项2:httrack

httrack似乎是一个镜像整个网站的好工具,但我不清楚如何使用它来创建单个页面的本地副本。httrack论坛上有很多关于这个话题的讨论(例如这里),但似乎没有人有一个防弹的解决方案。


选项3:另一个工具

有些人建议使用付费工具,但我不敢相信没有免费的解决方案。

wget能够满足您的要求。只需尝试以下操作:

wget -p -k http://www.example.com/

-p将为您提供正确查看网站所需的所有元素(css、图像等)。-k将更改所有链接(包括用于CSS和图像的链接),以允许您在联机时脱机查看页面。

来自Wget文档:

‘-k’
‘--convert-links’
After the download is complete, convert the links in the document to make them
suitable for local viewing. This affects not only the visible hyperlinks, but
any part of the document that links to external content, such as embedded images,
links to style sheets, hyperlinks to non-html content, etc.
Each link will be changed in one of the two ways:
    The links to files that have been downloaded by Wget will be changed to refer
    to the file they point to as a relative link.
    Example: if the downloaded file /foo/doc.html links to /bar/img.gif, also
    downloaded, then the link in doc.html will be modified to point to
    ‘../bar/img.gif’. This kind of transformation works reliably for arbitrary
    combinations of directories.
    The links to files that have not been downloaded by Wget will be changed to
    include host name and absolute path of the location they point to.
    Example: if the downloaded file /foo/doc.html links to /bar/img.gif (or to
    ../bar/img.gif), then the link in doc.html will be modified to point to
    http://hostname/bar/img.gif. 
Because of this, local browsing works reliably: if a linked file was downloaded,
the link will refer to its local name; if it was not downloaded, the link will
refer to its full Internet address rather than presenting a broken link. The fact
that the former links are converted to relative links ensures that you can move
the downloaded hierarchy to another directory.
Note that only at the end of the download can Wget know which links have been
downloaded. Because of that, the work done by ‘-k’ will be performed at the end
of all the downloads. 

相关内容

最新更新