\input texinfo   @c -*-texinfo-*-@c %**start of header@setfilename wget.info@include version.texi@set UPDATED Mar 2008@settitle GNU Wget @value{VERSION} Manual@c Disable the monstrous rectangles beside overfull hbox-es.@finalout@c Use `odd' to print double-sided.@setchapternewpage on@c %**end of header@iftex@c Remove this if you don't use A4 paper.@afourpaper@end iftex@c Title for man page.  The weird way texi2pod.pl is written requires@c the preceding @set.@set Wget Wget@c man title Wget The non-interactive network downloader.@dircategory Network Applications@direntry* Wget: (wget).         The non-interactive network downloader.@end direntry@copyingThis file documents the GNU Wget utility for downloading networkdata.@c man begin COPYRIGHTCopyright @copyright{} 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003,2004, 2005, 2006, 2007, 2008 Free Software Foundation, Inc.@iftexPermission is granted to make and distribute verbatim copies ofthis manual provided the copyright notice and this permission noticeare preserved on all copies.@end iftex@ignorePermission is granted to process this file through TeX and print theresults, provided the printed document carries a copying permissionnotice identical to this one except for the removal of this paragraph(this paragraph not being relevant to the printed manual).@end ignorePermission is granted to copy, distribute and/or modify this documentunder the terms of the GNU Free Documentation License, Version 1.2 orany later version published by the Free Software Foundation; with noInvariant Sections, no Front-Cover Texts, and no Back-Cover Texts.  Acopy of the license is included in the section entitled ``GNU FreeDocumentation License''.@c man end@end copying@titlepage@title GNU Wget @value{VERSION}@subtitle The non-interactive download utility@subtitle Updated for Wget @value{VERSION}, @value{UPDATED}@author by Hrvoje Nik@v{s}i@'{c} and others@ignore@c man begin AUTHOROriginally written by Hrvoje Niksic <hniksic@xemacs.org>.Currently maintained by Micah Cowan <micah@cowan.name>.@c man end@c man begin SEEALSOThis is @strong{not} the complete manual for GNU Wget.For more complete information, including more detailed explanations ofsome of the options, and a number of commands availablefor use with @file{.wgetrc} files and the @samp{-e} option, see the GNUInfo entry for @file{wget}.@c man end@end ignore@page@vskip 0pt plus 1filll@insertcopying@end titlepage@contents@ifnottex@node Top@top Wget @value{VERSION}@insertcopying@end ifnottex@menu* Overview::            Features of Wget.* Invoking::            Wget command-line arguments.* Recursive Download::  Downloading interlinked pages.* Following Links::     The available methods of chasing links.* Time-Stamping::       Mirroring according to time-stamps.* Startup File::        Wget's initialization file.* Examples::            Examples of usage.* Various::             The stuff that doesn't fit anywhere else.* Appendices::          Some useful references.* Copying this manual:: You may give out copies of Wget and of this manual.* Concept Index::       Topics covered by this manual.@end menu@node Overview@chapter Overview@cindex overview@cindex features@c man begin DESCRIPTIONGNU Wget is a free utility for non-interactive download of files fromthe Web.  It supports @sc{http}, @sc{https}, and @sc{ftp} protocols, aswell as retrieval through @sc{http} proxies.@c man endThis chapter is a partial overview of Wget's features.@itemize @bullet@item@c man begin DESCRIPTIONWget is non-interactive, meaning that it can work in the background,while the user is not logged on.  This allows you to start a retrievaland disconnect from the system, letting Wget finish the work.  Bycontrast, most of the Web browsers require constant user's presence,which can be a great hindrance when transferring a lot of data.@c man end@item@ignore@c man begin DESCRIPTION@c man end@end ignore@c man begin DESCRIPTIONWget can follow links in @sc{html} and @sc{xhtml} pages and create local versions of remote web sites, fully recreating the directory structure of the original site.  This is sometimes referred to as ``recursivedownloading.''  While doing that, Wget respects the Robot ExclusionStandard (@file{/robots.txt}).  Wget can be instructed to convert thelinks in downloaded @sc{html} files to the local files for offlineviewing.@c man end@itemFile name wildcard matching and recursive mirroring of directories areavailable when retrieving via @sc{ftp}.  Wget can read the time-stampinformation given by both @sc{http} and @sc{ftp} servers, and store itlocally.  Thus Wget can see if the remote file has changed since lastretrieval, and automatically retrieve the new version if it has.  Thismakes Wget suitable for mirroring of @sc{ftp} sites, as well as homepages.@item@ignore@c man begin DESCRIPTION@c man end@end ignore@c man begin DESCRIPTIONWget has been designed for robustness over slow or unstable networkconnections; if a download fails due to a network problem, it willkeep retrying until the whole file has been retrieved.  If the serversupports regetting, it will instruct the server to continue thedownload from where it left off.@c man end@itemWget supports proxy servers, which can lighten the network load, speedup retrieval and provide access behind firewalls.  Wget uses the passive@sc{ftp} downloading by default, active @sc{ftp} being an option.@itemWget supports IP version 6, the next generation of IP.  IPv6 isautodetected at compile-time, and can be disabled at either build orrun time.  Binaries built with IPv6 support work well in bothIPv4-only and dual family environments.@itemBuilt-in features offer mechanisms to tune which links you wish to follow(@pxref{Following Links}).@itemThe progress of individual downloads is traced using a progress gauge.Interactive downloads are tracked using a ``thermometer''-style gauge,whereas non-interactive ones are traced with dots, each dotrepresenting a fixed amount of data received (1KB by default).  Eithergauge can be customized to your preferences.@itemMost of the features are fully configurable, either through command lineoptions, or via the initialization file @file{.wgetrc} (@pxref{StartupFile}).  Wget allows you to define @dfn{global} startup files(@file{/usr/local/etc/wgetrc} by default) for site settings.@ignore@c man begin FILES@table @samp@item /usr/local/etc/wgetrcDefault location of the @dfn{global} startup file.@item .wgetrcUser startup file.@end table@c man end@end ignore@itemFinally, GNU Wget is free software.  This means that everyone may useit, redistribute it and/or modify it under the terms of the GNU GeneralPublic License, as published by the Free Software Foundation (see thefile @file{COPYING} that came with GNU Wget, for details).@end itemize@node Invoking@chapter Invoking@cindex invoking@cindex command line@cindex arguments@cindex nohupBy default, Wget is very simple to invoke.  The basic syntax is:@example@c man begin SYNOPSISwget [@var{option}]@dots{} [@var{URL}]@dots{}@c man end@end exampleWget will simply download all the @sc{url}s specified on the commandline.  @var{URL} is a @dfn{Uniform Resource Locator}, as defined below.However, you may wish to change some of the default parameters ofWget.  You can do it two ways: permanently, adding the appropriatecommand to @file{.wgetrc} (@pxref{Startup File}), or specifying it onthe command line.@menu* URL Format::* Option Syntax::* Basic Startup Options::* Logging and Input File Options::* Download Options::* Directory Options::* HTTP Options::* HTTPS (SSL/TLS) Options::* FTP Options::* Recursive Retrieval Options::* Recursive Accept/Reject Options::@end menu@node URL Format@section URL Format@cindex URL@cindex URL syntax@dfn{URL} is an acronym for Uniform Resource Locator.  A uniformresource locator is a compact string representation for a resourceavailable via the Internet.  Wget recognizes the @sc{url} syntax as per@sc{rfc1738}.  This is the most widely used form (square brackets denoteoptional parts):@examplehttp://host[:port]/directory/fileftp://host[:port]/directory/file@end exampleYou can also encode your username and password within a @sc{url}:@exampleftp://user:password@@host/pathhttp://user:password@@host/path@end exampleEither @var{user} or @var{password}, or both, may be left out.  If youleave out either the @sc{http} username or password, no authenticationwill be sent.  If you leave out the @sc{ftp} username, @samp{anonymous}will be used.  If you leave out the @sc{ftp} password, your emailaddress will be supplied as a default password.@footnote{If you have a@file{.netrc} file in your home directory, password will also besearched for there.}@strong{Important Note}: if you specify a password-containing @sc{url}on the command line, the username and password will be plainly visibleto all users on the system, by way of @code{ps}.  On multi-user systems,this is a big security risk.  To work around it, use @code{wget -i -}and feed the @sc{url}s to Wget's standard input, each on a separateline, terminated by @kbd{C-d}.You can encode unsafe characters in a @sc{url} as @samp{%xy}, @code{xy}being the hexadecimal representation of the character's @sc{ascii}value.  Some common unsafe characters include @samp{%} (quoted as@samp{%25}), @samp{:} (quoted as @samp{%3A}), and @samp{@@} (quoted as@samp{%40}).  Refer to @sc{rfc1738} for a comprehensive list of unsafecharacters.Wget also supports the @code{type} feature for @sc{ftp} @sc{url}s.  Bydefault, @sc{ftp} documents are retrieved in the binary mode (type@samp{i}), which means that they are downloaded unchanged.  Anotheruseful mode is the @samp{a} (@dfn{ASCII}) mode, which converts the linedelimiters between the different operating systems, and is thus usefulfor text files.  Here is an example:@exampleftp://host/directory/file;type=a@end exampleTwo alternative variants of @sc{url} specification are also supported,because of historical (hysterical?) reasons and their widespreaded use.@sc{ftp}-only syntax (supported by @code{NcFTP}):@examplehost:/dir/file@end example@sc{http}-only syntax (introduced by @code{Netscape}):@examplehost[:port]/dir/file@end exampleThese two alternative forms are deprecated, and may cease beingsupported in the future.If you do not understand the difference between these notations, or donot know which one to use, just use the plain ordinary format you usewith your favorite browser, like @code{Lynx} or @code{Netscape}.