From: PerlFAQ Server on
This is an excerpt from the latest version perlfaq9.pod, which
comes with the standard Perl distribution. These postings aim to
reduce the number of repeated questions as well as allow the community
to review and update the answers. The latest version of the complete
perlfaq is at http://faq.perl.org .

--------------------------------------------------------------------

9.8: How do I fetch an HTML file?

(contributed by brian d foy)

Use the libwww-perl distribution. The "LWP::Simple" module can fetch web
resources and give their content back to you as a string:

use LWP::Simple qw(get);

my $html = get( "http://www.example.com/index.html" );

It can also store the resource directly in a file:

use LWP::Simple qw(getstore);

getstore( "http://www.example.com/index.html", "foo.html" );

If you need to do something more complicated, you can use
"LWP::UserAgent" module to create your own user-agent (e.g. browser) to
get the job done. If you want to simulate an interactive web browser,
you can use the "WWW::Mechanize" module.



--------------------------------------------------------------------

The perlfaq-workers, a group of volunteers, maintain the perlfaq. They
are not necessarily experts in every domain where Perl might show up,
so please include as much information as possible and relevant in any
corrections. The perlfaq-workers also don't have access to every
operating system or platform, so please include relevant details for
corrections to examples that do not work on particular platforms.
Working code is greatly appreciated.

If you'd like to help maintain the perlfaq, see the details in
perlfaq.pod.