User Tools

Site Tools

tools:wget

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
tools:wget [2024/06/03 08:20] – created Humphrey Boa-Garttools:wget [2024/11/18 04:31] (current) – [Further Documentation] Humphrey Boa-Gart
Line 1: Line 1:
-{{wst>iw-cleanup}} 
- 
 ====== Wget ====== ====== Wget ======
  
-**Wget** is the /i/nsurgent's Swiss army knife. With knowing how to edit and set up batch scripts, you can basically have it do anything. From simple recursive downloading aka [[Bandwidth Raep]]to making it forum flooder, to simple downloading of a whole website or pictures like hooeg .jpg files that would otherwise make your browser crashwere you to look at them.+**Wget** is [[tools:bash|command line]] utility for downloading things from the internet. It is very simple to use: you feed URL to the ''wget'' command, and it downloads itIt can download pretty much anything that your web browser can, only faster and with less overhead. Because it runs in the terminal, you can also use it on remote machines to download things where there is no browser or GUI.
  
-Its features include //recursive download//, conversion of links for offline viewing of local HTML, //support for proxies//, and much more. It appeared in 1996, coinciding with the boom of popularity of the web, causing its wide use among Unix users and distribution with most major Linux distributions. Written in portable CWget can be easily installed on any Unix-like system and has been ported to diverse environments.+However, its simplicity belies its incredible versatility. As the [[anonymous:insurgency-wiki|Insurgency Wiki]] once said, it is //"the /i/nsurgent's Swiss army knife"//. It can do all sorts of things out of the box or with minor additional scriptingincluding but not limited to:
  
-===== Tutorials =====+  * Recursive downloads and unattended/background downloads. 
 +  * Save and resume interrupted downloads. 
 +  * Download huge images or files that would make your web browser crash. 
 +  * Download web pages for local [[diy:archival]] or later viewing. 
 +  * Download whole web sites and automatically convert the links to work offline as well. 
 +  * Downloading through proxies. 
 +  * Forum flooding and [[tactics:ddos|DDOS attacks]]. 
 +  * It also can be run [[wp>Headless_software|headless]] if you so desire.
  
-With bit of imagination, brainz and RTFMingwhich anon seems to have no lack ofdelicious raep can be achieved.+Since it is very old //(and lightweight)// packageit is usually installed by default on most modern *nix distrosor at the very least is available in their default [[tools:package-manager|package manager]] repos.
  
-To use wget in combination with [[tools:tor|Tor]] and [[tools:privoxy|Privoxy]] in their default configurations, use ''wget -e "http_proxy = http://ip:port/" "http://content"''. Slow, but anonymous. 
  
-The real raep666 instances of+ 
 + 
 +===== How to Use Wget ===== 
 + 
 +[{{ :tools:wget.jpg|Pictured: Wget syntax usage.}}] 
 + 
 +Basic usage is simple. Just run: 
 + 
 +  wget <target url here> 
 + 
 + 
 +==== Rename Downloaded Files ==== 
 + 
 +To save the file you are downloading under a new name, use the ''-O'' flag: 
 + 
 +  wget -O newfilename.zip https://domain.com/oldfilename.zip 
 + 
 + 
 +==== Download Multiple Files ==== 
 + 
 +To provide Wget with a list of files to download, create a TXT file with one target per line, then run Wget with the ''-i'' flag: 
 + 
 +  wget -i /path/to/txtfile.txt 
 + 
 + 
 +==== Download Whole Sites ==== 
 + 
 +Use the following flags to have Wget crawl and download an entire site: 
 + 
 +  wget -mpEk <target url here> 
 + 
 + 
 + 
 + 
 +==== Wget with FTP ==== 
 + 
 +Wget supports downloading files from FTP servers, like so: 
 + 
 +  wget ftp://user:password@host/path 
 +  
 +If the FTP server is running on a non-standard port, you can specify it like this: 
 + 
 +  wget ftp://user:password@host:port/path 
 + 
 + 
 + 
 +==== Wget with Proxies ==== 
 + 
 +To use wget in combination with [[tools:tor|Tor]] or [[tools:privoxy|Privoxy]] in their default configurations, use: 
 + 
 +  wget -e "http_proxy = http://ip:port/" <target url here> 
 + 
 + 
 +===== Weaponized Wget ===== 
 + 
 +[[anonymous:anonops|AnonOps]] has devised several ways to deploy Wget **offensively**. Some of these methods are outlined below //(more methods coming eventually)//: 
 + 
 + 
 +==== Bandwidth Drain Attacks ====
  
   wget --limit-rate=1 <target url here>   wget --limit-rate=1 <target url here>
  
-Just restart sometimes. What this does is downloading the target at a very low speed, so the connection stays alive for a loooong time. There's a maximum number of connections that a site can take. Using this method you can effectively raep many sites ALONE and still have enough bandwidth for BitTorrent. It has been confirmed that this even works on a 28k line.+Just restart sometimes. What this does is downloading the target at a very low speed, so the connection stays alive for a loooong time. There's a maximum number of connections that a site can take. Using this method you can effectively drain the bandwidth of many sites solo. It has been confirmed that this even works on a 28k line
 + 
 + 
 +===== Wget on Windows ===== 
 + 
 +In [[tools:powershell|PowerShell]], ''wget'' is aliased to [[https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.utility/invoke-webrequest|Invoke-WebRequest]], which provides similar functionality. 
 + 
 +There is also a Windows port of Wget as part of the [[https://gnuwin32.sourceforge.net/packages/wget.htm|GnuWin]] project.
  
-===== External links ===== 
  
-Downloads:+===== Further Documentation =====
  
-  * Wget is included with most Linux/BSD distros, so check if you already have it +Run ''wget -h'' or ''man wget'' to bring up more information about Wget's available options in your terminal.
-  * [[http://www.gnu.org/software/wget|General download link]] +
-  * [[http://www.christopherlewis.com/WGet/WGetFiles.htm|Windows port]] +
-  * [[http://darwinports.com/|Mac OS X port]]+
  
-[[http://www.gnu.org/software/wget/manual/wget.html|Wget manual]]+Or visit the [[https://www.gnu.org/software/wget/manual/wget.html|official site]] for even more detailed information. 
  
  
 {{tag>Tools}} {{tag>Tools}}
tools/wget.1717402823.txt.gz · Last modified: 2024/08/06 05:52 (external edit)

Find this page online at: https://bestpoint.institute/tools/wget