1# curl tutorial 2 3## Simple Usage 4 5Get the main page from a web-server: 6 7 curl https://www.example.com/ 8 9Get a README file from an FTP server: 10 11 curl ftp://ftp.funet.fi/README 12 13Get a web page from a server using port 8000: 14 15 curl http://www.weirdserver.com:8000/ 16 17Get a directory listing of an FTP site: 18 19 curl ftp://ftp.funet.fi 20 21Get the definition of curl from a dictionary: 22 23 curl dict://dict.org/m:curl 24 25Fetch two documents at once: 26 27 curl ftp://ftp.funet.fi/ http://www.weirdserver.com:8000/ 28 29Get a file off an FTPS server: 30 31 curl ftps://files.are.secure.com/secrets.txt 32 33or use the more appropriate FTPS way to get the same file: 34 35 curl --ftp-ssl ftp://files.are.secure.com/secrets.txt 36 37Get a file from an SSH server using SFTP: 38 39 curl -u username sftp://example.com/etc/issue 40 41Get a file from an SSH server using SCP using a private key (not 42password-protected) to authenticate: 43 44 curl -u username: --key ~/.ssh/id_rsa scp://example.com/~/file.txt 45 46Get a file from an SSH server using SCP using a private key 47(password-protected) to authenticate: 48 49 curl -u username: --key ~/.ssh/id_rsa --pass private_key_password 50 scp://example.com/~/file.txt 51 52Get the main page from an IPv6 web server: 53 54 curl "http://[2001:1890:1112:1::20]/" 55 56Get a file from an SMB server: 57 58 curl -u "domain\username:passwd" smb://server.example.com/share/file.txt 59 60## Download to a File 61 62Get a web page and store in a local file with a specific name: 63 64 curl -o thatpage.html http://www.example.com/ 65 66Get a web page and store in a local file, make the local file get the name of 67the remote document (if no file name part is specified in the URL, this will 68fail): 69 70 curl -O http://www.example.com/index.html 71 72Fetch two files and store them with their remote names: 73 74 curl -O www.haxx.se/index.html -O curl.se/download.html 75 76## Using Passwords 77 78### FTP 79 80To ftp files using name and password, include them in the URL like: 81 82 curl ftp://name:passwd@machine.domain:port/full/path/to/file 83 84or specify them with the `-u` flag like 85 86 curl -u name:passwd ftp://machine.domain:port/full/path/to/file 87 88### FTPS 89 90It is just like for FTP, but you may also want to specify and use SSL-specific 91options for certificates etc. 92 93Note that using `FTPS://` as prefix is the *implicit* way as described in the 94standards while the recommended *explicit* way is done by using `FTP://` and 95the `--ssl-reqd` option. 96 97### SFTP / SCP 98 99This is similar to FTP, but you can use the `--key` option to specify a 100private key to use instead of a password. Note that the private key may itself 101be protected by a password that is unrelated to the login password of the 102remote system; this password is specified using the `--pass` option. 103Typically, curl will automatically extract the public key from the private key 104file, but in cases where curl does not have the proper library support, a 105matching public key file must be specified using the `--pubkey` option. 106 107### HTTP 108 109Curl also supports user and password in HTTP URLs, thus you can pick a file 110like: 111 112 curl http://name:passwd@machine.domain/full/path/to/file 113 114or specify user and password separately like in 115 116 curl -u name:passwd http://machine.domain/full/path/to/file 117 118HTTP offers many different methods of authentication and curl supports 119several: Basic, Digest, NTLM and Negotiate (SPNEGO). Without telling which 120method to use, curl defaults to Basic. You can also ask curl to pick the most 121secure ones out of the ones that the server accepts for the given URL, by 122using `--anyauth`. 123 124**Note**! According to the URL specification, HTTP URLs can not contain a user 125and password, so that style will not work when using curl via a proxy, even 126though curl allows it at other times. When using a proxy, you _must_ use the 127`-u` style for user and password. 128 129### HTTPS 130 131Probably most commonly used with private certificates, as explained below. 132 133## Proxy 134 135curl supports both HTTP and SOCKS proxy servers, with optional authentication. 136It does not have special support for FTP proxy servers since there are no 137standards for those, but it can still be made to work with many of them. You 138can also use both HTTP and SOCKS proxies to transfer files to and from FTP 139servers. 140 141Get an ftp file using an HTTP proxy named my-proxy that uses port 888: 142 143 curl -x my-proxy:888 ftp://ftp.leachsite.com/README 144 145Get a file from an HTTP server that requires user and password, using the 146same proxy as above: 147 148 curl -u user:passwd -x my-proxy:888 http://www.get.this/ 149 150Some proxies require special authentication. Specify by using -U as above: 151 152 curl -U user:passwd -x my-proxy:888 http://www.get.this/ 153 154A comma-separated list of hosts and domains which do not use the proxy can be 155specified as: 156 157 curl --noproxy localhost,get.this -x my-proxy:888 http://www.get.this/ 158 159If the proxy is specified with `--proxy1.0` instead of `--proxy` or `-x`, then 160curl will use HTTP/1.0 instead of HTTP/1.1 for any `CONNECT` attempts. 161 162curl also supports SOCKS4 and SOCKS5 proxies with `--socks4` and `--socks5`. 163 164See also the environment variables Curl supports that offer further proxy 165control. 166 167Most FTP proxy servers are set up to appear as a normal FTP server from the 168client's perspective, with special commands to select the remote FTP server. 169curl supports the `-u`, `-Q` and `--ftp-account` options that can be used to 170set up transfers through many FTP proxies. For example, a file can be uploaded 171to a remote FTP server using a Blue Coat FTP proxy with the options: 172 173 curl -u "username@ftp.server Proxy-Username:Remote-Pass" 174 --ftp-account Proxy-Password --upload-file local-file 175 ftp://my-ftp.proxy.server:21/remote/upload/path/ 176 177See the manual for your FTP proxy to determine the form it expects to set up 178transfers, and curl's `-v` option to see exactly what curl is sending. 179 180## Piping 181 182Get a key file and add it with `apt-key` (when on a system that uses `apt` for 183package management): 184 185 curl -L https://apt.llvm.org/llvm-snapshot.gpg.key | sudo apt-key add - 186 187The '|' pipes the output to STDIN. `-` tells `apt-key` that the key file 188should be read from STDIN. 189 190## Ranges 191 192HTTP 1.1 introduced byte-ranges. Using this, a client can request to get only 193one or more sub-parts of a specified document. Curl supports this with the 194`-r` flag. 195 196Get the first 100 bytes of a document: 197 198 curl -r 0-99 http://www.get.this/ 199 200Get the last 500 bytes of a document: 201 202 curl -r -500 http://www.get.this/ 203 204Curl also supports simple ranges for FTP files as well. Then you can only 205specify start and stop position. 206 207Get the first 100 bytes of a document using FTP: 208 209 curl -r 0-99 ftp://www.get.this/README 210 211## Uploading 212 213### FTP / FTPS / SFTP / SCP 214 215Upload all data on stdin to a specified server: 216 217 curl -T - ftp://ftp.upload.com/myfile 218 219Upload data from a specified file, login with user and password: 220 221 curl -T uploadfile -u user:passwd ftp://ftp.upload.com/myfile 222 223Upload a local file to the remote site, and use the local file name at the 224remote site too: 225 226 curl -T uploadfile -u user:passwd ftp://ftp.upload.com/ 227 228Upload a local file to get appended to the remote file: 229 230 curl -T localfile -a ftp://ftp.upload.com/remotefile 231 232Curl also supports ftp upload through a proxy, but only if the proxy is 233configured to allow that kind of tunneling. If it does, you can run curl in a 234fashion similar to: 235 236 curl --proxytunnel -x proxy:port -T localfile ftp.upload.com 237 238### SMB / SMBS 239 240 curl -T file.txt -u "domain\username:passwd" 241 smb://server.example.com/share/ 242 243### HTTP 244 245Upload all data on stdin to a specified HTTP site: 246 247 curl -T - http://www.upload.com/myfile 248 249Note that the HTTP server must have been configured to accept PUT before this 250can be done successfully. 251 252For other ways to do HTTP data upload, see the POST section below. 253 254## Verbose / Debug 255 256If curl fails where it is not supposed to, if the servers do not let you in, if 257you cannot understand the responses: use the `-v` flag to get verbose 258fetching. Curl will output lots of info and what it sends and receives in 259order to let the user see all client-server interaction (but it will not show you 260the actual data). 261 262 curl -v ftp://ftp.upload.com/ 263 264To get even more details and information on what curl does, try using the 265`--trace` or `--trace-ascii` options with a given file name to log to, like 266this: 267 268 curl --trace trace.txt www.haxx.se 269 270 271## Detailed Information 272 273Different protocols provide different ways of getting detailed information 274about specific files/documents. To get curl to show detailed information about 275a single file, you should use `-I`/`--head` option. It displays all available 276info on a single file for HTTP and FTP. The HTTP information is a lot more 277extensive. 278 279For HTTP, you can get the header information (the same as `-I` would show) 280shown before the data by using `-i`/`--include`. Curl understands the 281`-D`/`--dump-header` option when getting files from both FTP and HTTP, and it 282will then store the headers in the specified file. 283 284Store the HTTP headers in a separate file (headers.txt in the example): 285 286 curl --dump-header headers.txt curl.se 287 288Note that headers stored in a separate file can be useful at a later time if 289you want curl to use cookies sent by the server. More about that in the 290cookies section. 291 292## POST (HTTP) 293 294It is easy to post data using curl. This is done using the `-d <data>` option. 295The post data must be urlencoded. 296 297Post a simple `name` and `phone` guestbook. 298 299 curl -d "name=Rafael%20Sagula&phone=3320780" http://www.where.com/guest.cgi 300 301Or automatically [URL encode the data](https://everything.curl.dev/http/post/url-encode). 302 303 curl --data-urlencode "name=Rafael Sagula&phone=3320780" http://www.where.com/guest.cgi 304 305How to post a form with curl, lesson #1: 306 307Dig out all the `<input>` tags in the form that you want to fill in. 308 309If there is a normal post, you use `-d` to post. `-d` takes a full post 310string, which is in the format 311 312 <variable1>=<data1>&<variable2>=<data2>&... 313 314The variable names are the names set with `"name="` in the `<input>` tags, and 315the data is the contents you want to fill in for the inputs. The data *must* 316be properly URL encoded. That means you replace space with + and that you 317replace weird letters with `%XX` where `XX` is the hexadecimal representation 318of the letter's ASCII code. 319 320Example: 321 322(page located at `http://www.formpost.com/getthis/`) 323 324```html 325<form action="post.cgi" method="post"> 326<input name=user size=10> 327<input name=pass type=password size=10> 328<input name=id type=hidden value="blablabla"> 329<input name=ding value="submit"> 330</form> 331``` 332 333We want to enter user `foobar` with password `12345`. 334 335To post to this, you enter a curl command line like: 336 337 curl -d "user=foobar&pass=12345&id=blablabla&ding=submit" 338 http://www.formpost.com/getthis/post.cgi 339 340While `-d` uses the application/x-www-form-urlencoded mime-type, generally 341understood by CGI's and similar, curl also supports the more capable 342multipart/form-data type. This latter type supports things like file upload. 343 344`-F` accepts parameters like `-F "name=contents"`. If you want the contents to 345be read from a file, use `@filename` as contents. When specifying a file, you 346can also specify the file content type by appending `;type=<mime type>` to the 347file name. You can also post the contents of several files in one field. For 348example, the field name `coolfiles` is used to send three files, with 349different content types using the following syntax: 350 351 curl -F "coolfiles=@fil1.gif;type=image/gif,fil2.txt,fil3.html" 352 http://www.post.com/postit.cgi 353 354If the content-type is not specified, curl will try to guess from the file 355extension (it only knows a few), or use the previously specified type (from an 356earlier file if several files are specified in a list) or else it will use the 357default type `application/octet-stream`. 358 359Emulate a fill-in form with `-F`. Let's say you fill in three fields in a 360form. One field is a file name which to post, one field is your name and one 361field is a file description. We want to post the file we have written named 362`cooltext.txt`. To let curl do the posting of this data instead of your 363favorite browser, you have to read the HTML source of the form page and find 364the names of the input fields. In our example, the input field names are 365`file`, `yourname` and `filedescription`. 366 367 curl -F "file=@cooltext.txt" -F "yourname=Daniel" 368 -F "filedescription=Cool text file with cool text inside" 369 http://www.post.com/postit.cgi 370 371To send two files in one post you can do it in two ways: 372 373Send multiple files in a single field with a single field name: 374 375 curl -F "pictures=@dog.gif,cat.gif" $URL 376 377Send two fields with two field names 378 379 curl -F "docpicture=@dog.gif" -F "catpicture=@cat.gif" $URL 380 381To send a field value literally without interpreting a leading `@` or `<`, or 382an embedded `;type=`, use `--form-string` instead of `-F`. This is recommended 383when the value is obtained from a user or some other unpredictable 384source. Under these circumstances, using `-F` instead of `--form-string` could 385allow a user to trick curl into uploading a file. 386 387## Referrer 388 389An HTTP request has the option to include information about which address 390referred it to the actual page. curl allows you to specify the referrer to be 391used on the command line. It is especially useful to fool or trick stupid 392servers or CGI scripts that rely on that information being available or 393contain certain data. 394 395 curl -e www.coolsite.com http://www.showme.com/ 396 397## User Agent 398 399An HTTP request has the option to include information about the browser that 400generated the request. Curl allows it to be specified on the command line. It 401is especially useful to fool or trick stupid servers or CGI scripts that only 402accept certain browsers. 403 404Example: 405 406 curl -A 'Mozilla/3.0 (Win95; I)' http://www.nationsbank.com/ 407 408Other common strings: 409 410- `Mozilla/3.0 (Win95; I)` - Netscape Version 3 for Windows 95 411- `Mozilla/3.04 (Win95; U)` - Netscape Version 3 for Windows 95 412- `Mozilla/2.02 (OS/2; U)` - Netscape Version 2 for OS/2 413- `Mozilla/4.04 [en] (X11; U; AIX 4.2; Nav)` - Netscape for AIX 414- `Mozilla/4.05 [en] (X11; U; Linux 2.0.32 i586)` - Netscape for Linux 415 416Note that Internet Explorer tries hard to be compatible in every way: 417 418- `Mozilla/4.0 (compatible; MSIE 4.01; Windows 95)` - MSIE for W95 419 420Mozilla is not the only possible User-Agent name: 421 422- `Konqueror/1.0` - KDE File Manager desktop client 423- `Lynx/2.7.1 libwww-FM/2.14` - Lynx command line browser 424 425## Cookies 426 427Cookies are generally used by web servers to keep state information at the 428client's side. The server sets cookies by sending a response line in the 429headers that looks like `Set-Cookie: <data>` where the data part then 430typically contains a set of `NAME=VALUE` pairs (separated by semicolons `;` 431like `NAME1=VALUE1; NAME2=VALUE2;`). The server can also specify for what path 432the cookie should be used for (by specifying `path=value`), when the cookie 433should expire (`expire=DATE`), for what domain to use it (`domain=NAME`) and 434if it should be used on secure connections only (`secure`). 435 436If you have received a page from a server that contains a header like: 437 438```http 439Set-Cookie: sessionid=boo123; path="/foo"; 440``` 441 442it means the server wants that first pair passed on when we get anything in a 443path beginning with `/foo`. 444 445Example, get a page that wants my name passed in a cookie: 446 447 curl -b "name=Daniel" www.sillypage.com 448 449Curl also has the ability to use previously received cookies in following 450sessions. If you get cookies from a server and store them in a file in a 451manner similar to: 452 453 curl --dump-header headers www.example.com 454 455... you can then in a second connect to that (or another) site, use the 456cookies from the `headers.txt` file like: 457 458 curl -b headers.txt www.example.com 459 460While saving headers to a file is a working way to store cookies, it is 461however error-prone and not the preferred way to do this. Instead, make curl 462save the incoming cookies using the well-known Netscape cookie format like 463this: 464 465 curl -c cookies.txt www.example.com 466 467Note that by specifying `-b` you enable the cookie engine and with `-L` you 468can make curl follow a `location:` (which often is used in combination with 469cookies). If a site sends cookies and a location field, you can use a 470non-existing file to trigger the cookie awareness like: 471 472 curl -L -b empty.txt www.example.com 473 474The file to read cookies from must be formatted using plain HTTP headers OR as 475Netscape's cookie file. Curl will determine what kind it is based on the file 476contents. In the above command, curl will parse the header and store the 477cookies received from www.example.com. curl will send to the server the stored 478cookies which match the request as it follows the location. The file 479`empty.txt` may be a nonexistent file. 480 481To read and write cookies from a Netscape cookie file, you can set both `-b` 482and `-c` to use the same file: 483 484 curl -b cookies.txt -c cookies.txt www.example.com 485 486## Progress Meter 487 488The progress meter exists to show a user that something actually is 489happening. The different fields in the output have the following meaning: 490 491 % Total % Received % Xferd Average Speed Time Curr. 492 Dload Upload Total Current Left Speed 493 0 151M 0 38608 0 0 9406 0 4:41:43 0:00:04 4:41:39 9287 494 495From left-to-right: 496 497 - `%` - percentage completed of the whole transfer 498 - `Total` - total size of the whole expected transfer 499 - `%` - percentage completed of the download 500 - `Received` - currently downloaded amount of bytes 501 - `%` - percentage completed of the upload 502 - `Xferd` - currently uploaded amount of bytes 503 - `Average Speed Dload` - the average transfer speed of the download 504 - `Average Speed Upload` - the average transfer speed of the upload 505 - `Time Total` - expected time to complete the operation 506 - `Time Current` - time passed since the invoke 507 - `Time Left` - expected time left to completion 508 - `Curr.Speed` - the average transfer speed the last 5 seconds (the first 509 5 seconds of a transfer is based on less time of course.) 510 511The `-#` option will display a totally different progress bar that does not 512need much explanation! 513 514## Speed Limit 515 516Curl allows the user to set the transfer speed conditions that must be met to 517let the transfer keep going. By using the switch `-y` and `-Y` you can make 518curl abort transfers if the transfer speed is below the specified lowest limit 519for a specified time. 520 521To have curl abort the download if the speed is slower than 3000 bytes per 522second for 1 minute, run: 523 524 curl -Y 3000 -y 60 www.far-away-site.com 525 526This can be used in combination with the overall time limit, so that the above 527operation must be completed in whole within 30 minutes: 528 529 curl -m 1800 -Y 3000 -y 60 www.far-away-site.com 530 531Forcing curl not to transfer data faster than a given rate is also possible, 532which might be useful if you are using a limited bandwidth connection and you 533do not want your transfer to use all of it (sometimes referred to as 534*bandwidth throttle*). 535 536Make curl transfer data no faster than 10 kilobytes per second: 537 538 curl --limit-rate 10K www.far-away-site.com 539 540or 541 542 curl --limit-rate 10240 www.far-away-site.com 543 544Or prevent curl from uploading data faster than 1 megabyte per second: 545 546 curl -T upload --limit-rate 1M ftp://uploadshereplease.com 547 548When using the `--limit-rate` option, the transfer rate is regulated on a 549per-second basis, which will cause the total transfer speed to become lower 550than the given number. Sometimes of course substantially lower, if your 551transfer stalls during periods. 552 553## Config File 554 555Curl automatically tries to read the `.curlrc` file (or `_curlrc` file on 556Microsoft Windows systems) from the user's home dir on startup. 557 558The config file could be made up with normal command line switches, but you 559can also specify the long options without the dashes to make it more 560readable. You can separate the options and the parameter with spaces, or with 561`=` or `:`. Comments can be used within the file. If the first letter on a 562line is a `#`-symbol the rest of the line is treated as a comment. 563 564If you want the parameter to contain spaces, you must enclose the entire 565parameter within double quotes (`"`). Within those quotes, you specify a quote 566as `\"`. 567 568NOTE: You must specify options and their arguments on the same line. 569 570Example, set default time out and proxy in a config file: 571 572 # We want a 30 minute timeout: 573 -m 1800 574 # ... and we use a proxy for all accesses: 575 proxy = proxy.our.domain.com:8080 576 577Whitespaces ARE significant at the end of lines, but all whitespace leading 578up to the first characters of each line are ignored. 579 580Prevent curl from reading the default file by using -q as the first command 581line parameter, like: 582 583 curl -q www.thatsite.com 584 585Force curl to get and display a local help page in case it is invoked without 586URL by making a config file similar to: 587 588 # default url to get 589 url = "http://help.with.curl.com/curlhelp.html" 590 591You can specify another config file to be read by using the `-K`/`--config` 592flag. If you set config file name to `-` it will read the config from stdin, 593which can be handy if you want to hide options from being visible in process 594tables etc: 595 596 echo "user = user:passwd" | curl -K - http://that.secret.site.com 597 598## Extra Headers 599 600When using curl in your own programs, you may end up needing to pass on your 601own custom headers when getting a web page. You can do this by using the `-H` 602flag. 603 604Example, send the header `X-you-and-me: yes` to the server when getting a 605page: 606 607 curl -H "X-you-and-me: yes" www.love.com 608 609This can also be useful in case you want curl to send a different text in a 610header than it normally does. The `-H` header you specify then replaces the 611header curl would normally send. If you replace an internal header with an 612empty one, you prevent that header from being sent. To prevent the `Host:` 613header from being used: 614 615 curl -H "Host:" www.server.com 616 617## FTP and Path Names 618 619Do note that when getting files with a `ftp://` URL, the given path is 620relative to the directory you enter. To get the file `README` from your home 621directory at your ftp site, do: 622 623 curl ftp://user:passwd@my.site.com/README 624 625If you want the README file from the root directory of that same site, you 626need to specify the absolute file name: 627 628 curl ftp://user:passwd@my.site.com//README 629 630(I.e with an extra slash in front of the file name.) 631 632## SFTP and SCP and Path Names 633 634With sftp: and scp: URLs, the path name given is the absolute name on the 635server. To access a file relative to the remote user's home directory, prefix 636the file with `/~/` , such as: 637 638 curl -u $USER sftp://home.example.com/~/.bashrc 639 640## FTP and Firewalls 641 642The FTP protocol requires one of the involved parties to open a second 643connection as soon as data is about to get transferred. There are two ways to 644do this. 645 646The default way for curl is to issue the PASV command which causes the server 647to open another port and await another connection performed by the 648client. This is good if the client is behind a firewall that does not allow 649incoming connections. 650 651 curl ftp.download.com 652 653If the server, for example, is behind a firewall that does not allow 654connections on ports other than 21 (or if it just does not support the `PASV` 655command), the other way to do it is to use the `PORT` command and instruct the 656server to connect to the client on the given IP number and port (as parameters 657to the PORT command). 658 659The `-P` flag to curl supports a few different options. Your machine may have 660several IP-addresses and/or network interfaces and curl allows you to select 661which of them to use. Default address can also be used: 662 663 curl -P - ftp.download.com 664 665Download with `PORT` but use the IP address of our `le0` interface (this does 666not work on Windows): 667 668 curl -P le0 ftp.download.com 669 670Download with `PORT` but use 192.168.0.10 as our IP address to use: 671 672 curl -P 192.168.0.10 ftp.download.com 673 674## Network Interface 675 676Get a web page from a server using a specified port for the interface: 677 678 curl --interface eth0:1 http://www.example.com/ 679 680or 681 682 curl --interface 192.168.1.10 http://www.example.com/ 683 684## HTTPS 685 686Secure HTTP requires a TLS library to be installed and used when curl is 687built. If that is done, curl is capable of retrieving and posting documents 688using the HTTPS protocol. 689 690Example: 691 692 curl https://www.secure-site.com 693 694curl is also capable of using client certificates to get/post files from sites 695that require valid certificates. The only drawback is that the certificate 696needs to be in PEM-format. PEM is a standard and open format to store 697certificates with, but it is not used by the most commonly used browsers. If 698you want curl to use the certificates you use with your favorite browser, you 699may need to download/compile a converter that can convert your browser's 700formatted certificates to PEM formatted ones. 701 702Example on how to automatically retrieve a document using a certificate with a 703personal password: 704 705 curl -E /path/to/cert.pem:password https://secure.site.com/ 706 707If you neglect to specify the password on the command line, you will be 708prompted for the correct password before any data can be received. 709 710Many older HTTPS servers have problems with specific SSL or TLS versions, 711which newer versions of OpenSSL etc use, therefore it is sometimes useful to 712specify what TLS version curl should use.: 713 714 curl --tlv1.0 https://secure.site.com/ 715 716Otherwise, curl will attempt to use a sensible TLS default version. 717 718## Resuming File Transfers 719 720To continue a file transfer where it was previously aborted, curl supports 721resume on HTTP(S) downloads as well as FTP uploads and downloads. 722 723Continue downloading a document: 724 725 curl -C - -o file ftp://ftp.server.com/path/file 726 727Continue uploading a document: 728 729 curl -C - -T file ftp://ftp.server.com/path/file 730 731Continue downloading a document from a web server 732 733 curl -C - -o file http://www.server.com/ 734 735## Time Conditions 736 737HTTP allows a client to specify a time condition for the document it requests. 738It is `If-Modified-Since` or `If-Unmodified-Since`. curl allows you to specify 739them with the `-z`/`--time-cond` flag. 740 741For example, you can easily make a download that only gets performed if the 742remote file is newer than a local copy. It would be made like: 743 744 curl -z local.html http://remote.server.com/remote.html 745 746Or you can download a file only if the local file is newer than the remote 747one. Do this by prepending the date string with a `-`, as in: 748 749 curl -z -local.html http://remote.server.com/remote.html 750 751You can specify a plain text date as condition. Tell curl to only download the 752file if it was updated since January 12, 2012: 753 754 curl -z "Jan 12 2012" http://remote.server.com/remote.html 755 756curl accepts a wide range of date formats. You always make the date check the 757other way around by prepending it with a dash (`-`). 758 759## DICT 760 761For fun try 762 763 curl dict://dict.org/m:curl 764 curl dict://dict.org/d:heisenbug:jargon 765 curl dict://dict.org/d:daniel:gcide 766 767Aliases for `m` are `match` and `find`, and aliases for `d` are `define` and 768`lookup`. For example, 769 770 curl dict://dict.org/find:curl 771 772Commands that break the URL description of the RFC (but not the DICT 773protocol) are 774 775 curl dict://dict.org/show:db 776 curl dict://dict.org/show:strat 777 778Authentication support is still missing 779 780## LDAP 781 782If you have installed the OpenLDAP library, curl can take advantage of it and 783offer `ldap://` support. On Windows, curl will use WinLDAP from Platform SDK 784by default. 785 786Default protocol version used by curl is LDAP version 3. Version 2 will be 787used as a fallback mechanism in case version 3 fails to connect. 788 789LDAP is a complex thing and writing an LDAP query is not an easy task. I do 790advise you to dig up the syntax description for that elsewhere. One such place 791might be: [RFC 2255, The LDAP URL Format](https://curl.se/rfc/rfc2255.txt) 792 793To show you an example, this is how I can get all people from my local LDAP 794server that has a certain sub-domain in their email address: 795 796 curl -B "ldap://ldap.frontec.se/o=frontec??sub?mail=*sth.frontec.se" 797 798If I want the same info in HTML format, I can get it by not using the `-B` 799(enforce ASCII) flag. 800 801You also can use authentication when accessing LDAP catalog: 802 803 curl -u user:passwd "ldap://ldap.frontec.se/o=frontec??sub?mail=*" 804 curl "ldap://user:passwd@ldap.frontec.se/o=frontec??sub?mail=*" 805 806By default, if user and password are provided, OpenLDAP/WinLDAP will use basic 807authentication. On Windows you can control this behavior by providing one of 808`--basic`, `--ntlm` or `--digest` option in curl command line 809 810 curl --ntlm "ldap://user:passwd@ldap.frontec.se/o=frontec??sub?mail=*" 811 812On Windows, if no user/password specified, auto-negotiation mechanism will be 813used with current logon credentials (SSPI/SPNEGO). 814 815## Environment Variables 816 817Curl reads and understands the following environment variables: 818 819 http_proxy, HTTPS_PROXY, FTP_PROXY 820 821They should be set for protocol-specific proxies. General proxy should be set 822with 823 824 ALL_PROXY 825 826A comma-separated list of host names that should not go through any proxy is 827set in (only an asterisk, `*` matches all hosts) 828 829 NO_PROXY 830 831If the host name matches one of these strings, or the host is within the 832domain of one of these strings, transactions with that node will not be done 833over proxy. When a domain is used, it needs to start with a period. A user can 834specify that both www.example.com and foo.example.com should not use a proxy 835by setting `NO_PROXY` to `.example.com`. By including the full name you can 836exclude specific host names, so to make `www.example.com` not use a proxy but 837still have `foo.example.com` do it, set `NO_PROXY` to `www.example.com`. 838 839The usage of the `-x`/`--proxy` flag overrides the environment variables. 840 841## Netrc 842 843Unix introduced the `.netrc` concept a long time ago. It is a way for a user 844to specify name and password for commonly visited FTP sites in a file so that 845you do not have to type them in each time you visit those sites. You realize 846this is a big security risk if someone else gets hold of your passwords, 847therefore most Unix programs will not read this file unless it is only readable 848by yourself (curl does not care though). 849 850Curl supports `.netrc` files if told to (using the `-n`/`--netrc` and 851`--netrc-optional` options). This is not restricted to just FTP, so curl can 852use it for all protocols where authentication is used. 853 854A simple `.netrc` file could look something like: 855 856 machine curl.se login iamdaniel password mysecret 857 858## Custom Output 859 860To better allow script programmers to get to know about the progress of curl, 861the `-w`/`--write-out` option was introduced. Using this, you can specify what 862information from the previous transfer you want to extract. 863 864To display the amount of bytes downloaded together with some text and an 865ending newline: 866 867 curl -w 'We downloaded %{size_download} bytes\n' www.download.com 868 869## Kerberos FTP Transfer 870 871Curl supports kerberos4 and kerberos5/GSSAPI for FTP transfers. You need the 872kerberos package installed and used at curl build time for it to be available. 873 874First, get the krb-ticket the normal way, like with the `kinit`/`kauth` tool. 875Then use curl in way similar to: 876 877 curl --krb private ftp://krb4site.com -u username:fakepwd 878 879There is no use for a password on the `-u` switch, but a blank one will make 880curl ask for one and you already entered the real password to `kinit`/`kauth`. 881 882## TELNET 883 884The curl telnet support is basic and easy to use. Curl passes all data passed 885to it on stdin to the remote server. Connect to a remote telnet server using a 886command line similar to: 887 888 curl telnet://remote.server.com 889 890And enter the data to pass to the server on stdin. The result will be sent to 891stdout or to the file you specify with `-o`. 892 893You might want the `-N`/`--no-buffer` option to switch off the buffered output 894for slow connections or similar. 895 896Pass options to the telnet protocol negotiation, by using the `-t` option. To 897tell the server we use a vt100 terminal, try something like: 898 899 curl -tTTYPE=vt100 telnet://remote.server.com 900 901Other interesting options for it `-t` include: 902 903 - `XDISPLOC=<X display>` Sets the X display location. 904 - `NEW_ENV=<var,val>` Sets an environment variable. 905 906NOTE: The telnet protocol does not specify any way to login with a specified 907user and password so curl cannot do that automatically. To do that, you need to 908track when the login prompt is received and send the username and password 909accordingly. 910 911## Persistent Connections 912 913Specifying multiple files on a single command line will make curl transfer all 914of them, one after the other in the specified order. 915 916libcurl will attempt to use persistent connections for the transfers so that 917the second transfer to the same host can use the same connection that was 918already initiated and was left open in the previous transfer. This greatly 919decreases connection time for all but the first transfer and it makes a far 920better use of the network. 921 922Note that curl cannot use persistent connections for transfers that are used 923in subsequent curl invokes. Try to stuff as many URLs as possible on the same 924command line if they are using the same host, as that will make the transfers 925faster. If you use an HTTP proxy for file transfers, practically all transfers 926will be persistent. 927 928## Multiple Transfers With A Single Command Line 929 930As is mentioned above, you can download multiple files with one command line 931by simply adding more URLs. If you want those to get saved to a local file 932instead of just printed to stdout, you need to add one save option for each 933URL you specify. Note that this also goes for the `-O` option (but not 934`--remote-name-all`). 935 936For example: get two files and use `-O` for the first and a custom file 937name for the second: 938 939 curl -O http://url.com/file.txt ftp://ftp.com/moo.exe -o moo.jpg 940 941You can also upload multiple files in a similar fashion: 942 943 curl -T local1 ftp://ftp.com/moo.exe -T local2 ftp://ftp.com/moo2.txt 944 945## IPv6 946 947curl will connect to a server with IPv6 when a host lookup returns an IPv6 948address and fall back to IPv4 if the connection fails. The `--ipv4` and 949`--ipv6` options can specify which address to use when both are 950available. IPv6 addresses can also be specified directly in URLs using the 951syntax: 952 953 http://[2001:1890:1112:1::20]/overview.html 954 955When this style is used, the `-g` option must be given to stop curl from 956interpreting the square brackets as special globbing characters. Link local 957and site local addresses including a scope identifier, such as `fe80::1234%1`, 958may also be used, but the scope portion must be numeric or match an existing 959network interface on Linux and the percent character must be URL escaped. The 960previous example in an SFTP URL might look like: 961 962 sftp://[fe80::1234%251]/ 963 964IPv6 addresses provided other than in URLs (e.g. to the `--proxy`, 965`--interface` or `--ftp-port` options) should not be URL encoded. 966 967## Mailing Lists 968 969For your convenience, we have several open mailing lists to discuss curl, its 970development and things relevant to this. Get all info at 971https://curl.se/mail/. 972 973Please direct curl questions, feature requests and trouble reports to one of 974these mailing lists instead of mailing any individual. 975 976Available lists include: 977 978### `curl-users` 979 980Users of the command line tool. How to use it, what does not work, new 981features, related tools, questions, news, installations, compilations, 982running, porting etc. 983 984### `curl-library` 985 986Developers using or developing libcurl. Bugs, extensions, improvements. 987 988### `curl-announce` 989 990Low-traffic. Only receives announcements of new public versions. At worst, 991that makes something like one or two mails per month, but usually only one 992mail every second month. 993 994### `curl-and-php` 995 996Using the curl functions in PHP. Everything curl with a PHP angle. Or PHP with 997a curl angle. 998 999### `curl-and-python` 1000 1001Python hackers using curl with or without the python binding pycurl. 1002 1003