1# curl tutorial 2 3## Simple Usage 4 5Get the main page from a web-server: 6 7 curl https://www.example.com/ 8 9Get the README file the user's home directory at funet's ftp-server: 10 11 curl ftp://ftp.funet.fi/README 12 13Get a web page from a server using port 8000: 14 15 curl http://www.weirdserver.com:8000/ 16 17Get a directory listing of an FTP site: 18 19 curl ftp://ftp.funet.fi 20 21Get the definition of curl from a dictionary: 22 23 curl dict://dict.org/m:curl 24 25Fetch two documents at once: 26 27 curl ftp://ftp.funet.fi/ http://www.weirdserver.com:8000/ 28 29Get a file off an FTPS server: 30 31 curl ftps://files.are.secure.com/secrets.txt 32 33or use the more appropriate FTPS way to get the same file: 34 35 curl --ftp-ssl ftp://files.are.secure.com/secrets.txt 36 37Get a file from an SSH server using SFTP: 38 39 curl -u username sftp://example.com/etc/issue 40 41Get a file from an SSH server using SCP using a private key (not 42password-protected) to authenticate: 43 44 curl -u username: --key ~/.ssh/id_rsa scp://example.com/~/file.txt 45 46Get a file from an SSH server using SCP using a private key 47(password-protected) to authenticate: 48 49 curl -u username: --key ~/.ssh/id_rsa --pass private_key_password 50 scp://example.com/~/file.txt 51 52Get the main page from an IPv6 web server: 53 54 curl "http://[2001:1890:1112:1::20]/" 55 56Get a file from an SMB server: 57 58 curl -u "domain\username:passwd" smb://server.example.com/share/file.txt 59 60## Download to a File 61 62Get a web page and store in a local file with a specific name: 63 64 curl -o thatpage.html http://www.example.com/ 65 66Get a web page and store in a local file, make the local file get the name of 67the remote document (if no file name part is specified in the URL, this will 68fail): 69 70 curl -O http://www.example.com/index.html 71 72Fetch two files and store them with their remote names: 73 74 curl -O www.haxx.se/index.html -O curl.se/download.html 75 76## Using Passwords 77 78### FTP 79 80To ftp files using name+passwd, include them in the URL like: 81 82 curl ftp://name:passwd@machine.domain:port/full/path/to/file 83 84or specify them with the -u flag like 85 86 curl -u name:passwd ftp://machine.domain:port/full/path/to/file 87 88### FTPS 89 90It is just like for FTP, but you may also want to specify and use SSL-specific 91options for certificates etc. 92 93Note that using `FTPS://` as prefix is the "implicit" way as described in the 94standards while the recommended "explicit" way is done by using FTP:// and the 95`--ftp-ssl` option. 96 97### SFTP / SCP 98 99This is similar to FTP, but you can use the `--key` option to specify a 100private key to use instead of a password. Note that the private key may itself 101be protected by a password that is unrelated to the login password of the 102remote system; this password is specified using the `--pass` option. 103Typically, curl will automatically extract the public key from the private key 104file, but in cases where curl does not have the proper library support, a 105matching public key file must be specified using the `--pubkey` option. 106 107### HTTP 108 109Curl also supports user and password in HTTP URLs, thus you can pick a file 110like: 111 112 curl http://name:passwd@machine.domain/full/path/to/file 113 114or specify user and password separately like in 115 116 curl -u name:passwd http://machine.domain/full/path/to/file 117 118HTTP offers many different methods of authentication and curl supports 119several: Basic, Digest, NTLM and Negotiate (SPNEGO). Without telling which 120method to use, curl defaults to Basic. You can also ask curl to pick the most 121secure ones out of the ones that the server accepts for the given URL, by 122using `--anyauth`. 123 124**Note**! According to the URL specification, HTTP URLs can not contain a user 125and password, so that style will not work when using curl via a proxy, even 126though curl allows it at other times. When using a proxy, you _must_ use the 127`-u` style for user and password. 128 129### HTTPS 130 131Probably most commonly used with private certificates, as explained below. 132 133## Proxy 134 135curl supports both HTTP and SOCKS proxy servers, with optional authentication. 136It does not have special support for FTP proxy servers since there are no 137standards for those, but it can still be made to work with many of them. You 138can also use both HTTP and SOCKS proxies to transfer files to and from FTP 139servers. 140 141Get an ftp file using an HTTP proxy named my-proxy that uses port 888: 142 143 curl -x my-proxy:888 ftp://ftp.leachsite.com/README 144 145Get a file from an HTTP server that requires user and password, using the 146same proxy as above: 147 148 curl -u user:passwd -x my-proxy:888 http://www.get.this/ 149 150Some proxies require special authentication. Specify by using -U as above: 151 152 curl -U user:passwd -x my-proxy:888 http://www.get.this/ 153 154A comma-separated list of hosts and domains which do not use the proxy can be 155specified as: 156 157 curl --noproxy localhost,get.this -x my-proxy:888 http://www.get.this/ 158 159If the proxy is specified with `--proxy1.0` instead of `--proxy` or `-x`, then 160curl will use HTTP/1.0 instead of HTTP/1.1 for any `CONNECT` attempts. 161 162curl also supports SOCKS4 and SOCKS5 proxies with `--socks4` and `--socks5`. 163 164See also the environment variables Curl supports that offer further proxy 165control. 166 167Most FTP proxy servers are set up to appear as a normal FTP server from the 168client's perspective, with special commands to select the remote FTP server. 169curl supports the `-u`, `-Q` and `--ftp-account` options that can be used to 170set up transfers through many FTP proxies. For example, a file can be uploaded 171to a remote FTP server using a Blue Coat FTP proxy with the options: 172 173 curl -u "username@ftp.server Proxy-Username:Remote-Pass" 174 --ftp-account Proxy-Password --upload-file local-file 175 ftp://my-ftp.proxy.server:21/remote/upload/path/ 176 177See the manual for your FTP proxy to determine the form it expects to set up 178transfers, and curl's `-v` option to see exactly what curl is sending. 179 180## Ranges 181 182HTTP 1.1 introduced byte-ranges. Using this, a client can request to get only 183one or more subparts of a specified document. Curl supports this with the `-r` 184flag. 185 186Get the first 100 bytes of a document: 187 188 curl -r 0-99 http://www.get.this/ 189 190Get the last 500 bytes of a document: 191 192 curl -r -500 http://www.get.this/ 193 194Curl also supports simple ranges for FTP files as well. Then you can only 195specify start and stop position. 196 197Get the first 100 bytes of a document using FTP: 198 199 curl -r 0-99 ftp://www.get.this/README 200 201## Uploading 202 203### FTP / FTPS / SFTP / SCP 204 205Upload all data on stdin to a specified server: 206 207 curl -T - ftp://ftp.upload.com/myfile 208 209Upload data from a specified file, login with user and password: 210 211 curl -T uploadfile -u user:passwd ftp://ftp.upload.com/myfile 212 213Upload a local file to the remote site, and use the local file name at the 214remote site too: 215 216 curl -T uploadfile -u user:passwd ftp://ftp.upload.com/ 217 218Upload a local file to get appended to the remote file: 219 220 curl -T localfile -a ftp://ftp.upload.com/remotefile 221 222Curl also supports ftp upload through a proxy, but only if the proxy is 223configured to allow that kind of tunneling. If it does, you can run curl in a 224fashion similar to: 225 226 curl --proxytunnel -x proxy:port -T localfile ftp.upload.com 227 228### SMB / SMBS 229 230 curl -T file.txt -u "domain\username:passwd" 231 smb://server.example.com/share/ 232 233### HTTP 234 235Upload all data on stdin to a specified HTTP site: 236 237 curl -T - http://www.upload.com/myfile 238 239Note that the HTTP server must have been configured to accept PUT before this 240can be done successfully. 241 242For other ways to do HTTP data upload, see the POST section below. 243 244## Verbose / Debug 245 246If curl fails where it isn't supposed to, if the servers don't let you in, if 247you can't understand the responses: use the `-v` flag to get verbose 248fetching. Curl will output lots of info and what it sends and receives in 249order to let the user see all client-server interaction (but it won't show you 250the actual data). 251 252 curl -v ftp://ftp.upload.com/ 253 254To get even more details and information on what curl does, try using the 255`--trace` or `--trace-ascii` options with a given file name to log to, like 256this: 257 258 curl --trace trace.txt www.haxx.se 259 260 261## Detailed Information 262 263Different protocols provide different ways of getting detailed information 264about specific files/documents. To get curl to show detailed information about 265a single file, you should use `-I`/`--head` option. It displays all available 266info on a single file for HTTP and FTP. The HTTP information is a lot more 267extensive. 268 269For HTTP, you can get the header information (the same as `-I` would show) 270shown before the data by using `-i`/`--include`. Curl understands the 271`-D`/`--dump-header` option when getting files from both FTP and HTTP, and it 272will then store the headers in the specified file. 273 274Store the HTTP headers in a separate file (headers.txt in the example): 275 276 curl --dump-header headers.txt curl.se 277 278Note that headers stored in a separate file can be very useful at a later time 279if you want curl to use cookies sent by the server. More about that in the 280cookies section. 281 282## POST (HTTP) 283 284It's easy to post data using curl. This is done using the `-d <data>` option. 285The post data must be urlencoded. 286 287Post a simple "name" and "phone" guestbook. 288 289 curl -d "name=Rafael%20Sagula&phone=3320780" http://www.where.com/guest.cgi 290 291How to post a form with curl, lesson #1: 292 293Dig out all the `<input>` tags in the form that you want to fill in. 294 295If there's a "normal" post, you use `-d` to post. `-d` takes a full "post 296string", which is in the format 297 298 <variable1>=<data1>&<variable2>=<data2>&... 299 300The 'variable' names are the names set with `"name="` in the `<input>` tags, 301and the data is the contents you want to fill in for the inputs. The data 302*must* be properly URL encoded. That means you replace space with + and that 303you replace weird letters with %XX where XX is the hexadecimal representation 304of the letter's ASCII code. 305 306Example: 307 308(page located at `http://www.formpost.com/getthis/`) 309 310```html 311<form action="post.cgi" method="post"> 312<input name=user size=10> 313<input name=pass type=password size=10> 314<input name=id type=hidden value="blablabla"> 315<input name=ding value="submit"> 316</form> 317``` 318 319We want to enter user 'foobar' with password '12345'. 320 321To post to this, you enter a curl command line like: 322 323 curl -d "user=foobar&pass=12345&id=blablabla&ding=submit" 324 http://www.formpost.com/getthis/post.cgi 325 326While `-d` uses the application/x-www-form-urlencoded mime-type, generally 327understood by CGI's and similar, curl also supports the more capable 328multipart/form-data type. This latter type supports things like file upload. 329 330`-F` accepts parameters like `-F "name=contents"`. If you want the contents to 331be read from a file, use `@filename` as contents. When specifying a file, you 332can also specify the file content type by appending `;type=<mime type>` to the 333file name. You can also post the contents of several files in one field. For 334example, the field name 'coolfiles' is used to send three files, with 335different content types using the following syntax: 336 337 curl -F "coolfiles=@fil1.gif;type=image/gif,fil2.txt,fil3.html" 338 http://www.post.com/postit.cgi 339 340If the content-type is not specified, curl will try to guess from the file 341extension (it only knows a few), or use the previously specified type (from an 342earlier file if several files are specified in a list) or else it will use the 343default type 'application/octet-stream'. 344 345Emulate a fill-in form with `-F`. Let's say you fill in three fields in a 346form. One field is a file name which to post, one field is your name and one 347field is a file description. We want to post the file we have written named 348"cooltext.txt". To let curl do the posting of this data instead of your 349favourite browser, you have to read the HTML source of the form page and find 350the names of the input fields. In our example, the input field names are 351'file', 'yourname' and 'filedescription'. 352 353 curl -F "file=@cooltext.txt" -F "yourname=Daniel" 354 -F "filedescription=Cool text file with cool text inside" 355 http://www.post.com/postit.cgi 356 357To send two files in one post you can do it in two ways: 358 359Send multiple files in a single "field" with a single field name: 360 361 curl -F "pictures=@dog.gif,cat.gif" $URL 362 363Send two fields with two field names 364 365 curl -F "docpicture=@dog.gif" -F "catpicture=@cat.gif" $URL 366 367To send a field value literally without interpreting a leading `@` or `<`, or 368an embedded `;type=`, use `--form-string` instead of `-F`. This is recommended 369when the value is obtained from a user or some other unpredictable 370source. Under these circumstances, using `-F` instead of `--form-string` could 371allow a user to trick curl into uploading a file. 372 373## Referrer 374 375An HTTP request has the option to include information about which address 376referred it to the actual page. Curl allows you to specify the referrer to be 377used on the command line. It is especially useful to fool or trick stupid 378servers or CGI scripts that rely on that information being available or 379contain certain data. 380 381 curl -e www.coolsite.com http://www.showme.com/ 382 383## User Agent 384 385An HTTP request has the option to include information about the browser that 386generated the request. Curl allows it to be specified on the command line. It 387is especially useful to fool or trick stupid servers or CGI scripts that only 388accept certain browsers. 389 390Example: 391 392 curl -A 'Mozilla/3.0 (Win95; I)' http://www.nationsbank.com/ 393 394Other common strings: 395 396- `Mozilla/3.0 (Win95; I)` - Netscape Version 3 for Windows 95 397- `Mozilla/3.04 (Win95; U)` - Netscape Version 3 for Windows 95 398- `Mozilla/2.02 (OS/2; U)` - Netscape Version 2 for OS/2 399- `Mozilla/4.04 [en] (X11; U; AIX 4.2; Nav)` - Netscape for AIX 400- `Mozilla/4.05 [en] (X11; U; Linux 2.0.32 i586)` - Netscape for Linux 401 402Note that Internet Explorer tries hard to be compatible in every way: 403 404- `Mozilla/4.0 (compatible; MSIE 4.01; Windows 95)` - MSIE for W95 405 406Mozilla is not the only possible User-Agent name: 407 408- `Konqueror/1.0` - KDE File Manager desktop client 409- `Lynx/2.7.1 libwww-FM/2.14` - Lynx command line browser 410 411## Cookies 412 413Cookies are generally used by web servers to keep state information at the 414client's side. The server sets cookies by sending a response line in the 415headers that looks like `Set-Cookie: <data>` where the data part then 416typically contains a set of `NAME=VALUE` pairs (separated by semicolons `;` 417like `NAME1=VALUE1; NAME2=VALUE2;`). The server can also specify for what path 418the "cookie" should be used for (by specifying `path=value`), when the cookie 419should expire (`expire=DATE`), for what domain to use it (`domain=NAME`) and 420if it should be used on secure connections only (`secure`). 421 422If you've received a page from a server that contains a header like: 423 424```http 425Set-Cookie: sessionid=boo123; path="/foo"; 426``` 427 428it means the server wants that first pair passed on when we get anything in a 429path beginning with "/foo". 430 431Example, get a page that wants my name passed in a cookie: 432 433 curl -b "name=Daniel" www.sillypage.com 434 435Curl also has the ability to use previously received cookies in following 436sessions. If you get cookies from a server and store them in a file in a 437manner similar to: 438 439 curl --dump-header headers www.example.com 440 441... you can then in a second connect to that (or another) site, use the 442cookies from the 'headers' file like: 443 444 curl -b headers www.example.com 445 446While saving headers to a file is a working way to store cookies, it is 447however error-prone and not the preferred way to do this. Instead, make curl 448save the incoming cookies using the well-known netscape cookie format like 449this: 450 451 curl -c cookies.txt www.example.com 452 453Note that by specifying `-b` you enable the "cookie awareness" and with `-L` 454you can make curl follow a location: (which often is used in combination with 455cookies). So that if a site sends cookies and a location, you can use a 456non-existing file to trigger the cookie awareness like: 457 458 curl -L -b empty.txt www.example.com 459 460The file to read cookies from must be formatted using plain HTTP headers OR as 461netscape's cookie file. Curl will determine what kind it is based on the file 462contents. In the above command, curl will parse the header and store the 463cookies received from www.example.com. curl will send to the server the 464stored cookies which match the request as it follows the location. The file 465"empty.txt" may be a nonexistent file. 466 467To read and write cookies from a netscape cookie file, you can set both `-b` 468and `-c` to use the same file: 469 470 curl -b cookies.txt -c cookies.txt www.example.com 471 472## Progress Meter 473 474The progress meter exists to show a user that something actually is 475happening. The different fields in the output have the following meaning: 476 477 % Total % Received % Xferd Average Speed Time Curr. 478 Dload Upload Total Current Left Speed 479 0 151M 0 38608 0 0 9406 0 4:41:43 0:00:04 4:41:39 9287 480 481From left-to-right: 482 483 - % - percentage completed of the whole transfer 484 - Total - total size of the whole expected transfer 485 - % - percentage completed of the download 486 - Received - currently downloaded amount of bytes 487 - % - percentage completed of the upload 488 - Xferd - currently uploaded amount of bytes 489 - Average Speed Dload - the average transfer speed of the download 490 - Average Speed Upload - the average transfer speed of the upload 491 - Time Total - expected time to complete the operation 492 - Time Current - time passed since the invoke 493 - Time Left - expected time left to completion 494 - Curr.Speed - the average transfer speed the last 5 seconds (the first 495 5 seconds of a transfer is based on less time of course.) 496 497The `-#` option will display a totally different progress bar that doesn't 498need much explanation! 499 500## Speed Limit 501 502Curl allows the user to set the transfer speed conditions that must be met to 503let the transfer keep going. By using the switch `-y` and `-Y` you can make 504curl abort transfers if the transfer speed is below the specified lowest limit 505for a specified time. 506 507To have curl abort the download if the speed is slower than 3000 bytes per 508second for 1 minute, run: 509 510 curl -Y 3000 -y 60 www.far-away-site.com 511 512This can very well be used in combination with the overall time limit, so 513that the above operation must be completed in whole within 30 minutes: 514 515 curl -m 1800 -Y 3000 -y 60 www.far-away-site.com 516 517Forcing curl not to transfer data faster than a given rate is also possible, 518which might be useful if you're using a limited bandwidth connection and you 519don't want your transfer to use all of it (sometimes referred to as 520"bandwidth throttle"). 521 522Make curl transfer data no faster than 10 kilobytes per second: 523 524 curl --limit-rate 10K www.far-away-site.com 525 526or 527 528 curl --limit-rate 10240 www.far-away-site.com 529 530Or prevent curl from uploading data faster than 1 megabyte per second: 531 532 curl -T upload --limit-rate 1M ftp://uploadshereplease.com 533 534When using the `--limit-rate` option, the transfer rate is regulated on a 535per-second basis, which will cause the total transfer speed to become lower 536than the given number. Sometimes of course substantially lower, if your 537transfer stalls during periods. 538 539## Config File 540 541Curl automatically tries to read the `.curlrc` file (or `_curlrc` file on 542Microsoft Windows systems) from the user's home dir on startup. 543 544The config file could be made up with normal command line switches, but you 545can also specify the long options without the dashes to make it more 546readable. You can separate the options and the parameter with spaces, or with 547`=` or `:`. Comments can be used within the file. If the first letter on a 548line is a `#`-symbol the rest of the line is treated as a comment. 549 550If you want the parameter to contain spaces, you must enclose the entire 551parameter within double quotes (`"`). Within those quotes, you specify a quote 552as `\"`. 553 554NOTE: You must specify options and their arguments on the same line. 555 556Example, set default time out and proxy in a config file: 557 558 # We want a 30 minute timeout: 559 -m 1800 560 # ... and we use a proxy for all accesses: 561 proxy = proxy.our.domain.com:8080 562 563Whitespaces ARE significant at the end of lines, but all whitespace leading 564up to the first characters of each line are ignored. 565 566Prevent curl from reading the default file by using -q as the first command 567line parameter, like: 568 569 curl -q www.thatsite.com 570 571Force curl to get and display a local help page in case it is invoked without 572URL by making a config file similar to: 573 574 # default url to get 575 url = "http://help.with.curl.com/curlhelp.html" 576 577You can specify another config file to be read by using the `-K`/`--config` 578flag. If you set config file name to `-` it'll read the config from stdin, 579which can be handy if you want to hide options from being visible in process 580tables etc: 581 582 echo "user = user:passwd" | curl -K - http://that.secret.site.com 583 584## Extra Headers 585 586When using curl in your own very special programs, you may end up needing 587to pass on your own custom headers when getting a web page. You can do 588this by using the `-H` flag. 589 590Example, send the header `X-you-and-me: yes` to the server when getting a 591page: 592 593 curl -H "X-you-and-me: yes" www.love.com 594 595This can also be useful in case you want curl to send a different text in a 596header than it normally does. The `-H` header you specify then replaces the 597header curl would normally send. If you replace an internal header with an 598empty one, you prevent that header from being sent. To prevent the `Host:` 599header from being used: 600 601 curl -H "Host:" www.server.com 602 603## FTP and Path Names 604 605Do note that when getting files with a `ftp://` URL, the given path is 606relative the directory you enter. To get the file `README` from your home 607directory at your ftp site, do: 608 609 curl ftp://user:passwd@my.site.com/README 610 611But if you want the README file from the root directory of that very same 612site, you need to specify the absolute file name: 613 614 curl ftp://user:passwd@my.site.com//README 615 616(I.e with an extra slash in front of the file name.) 617 618## SFTP and SCP and Path Names 619 620With sftp: and scp: URLs, the path name given is the absolute name on the 621server. To access a file relative to the remote user's home directory, prefix 622the file with `/~/` , such as: 623 624 curl -u $USER sftp://home.example.com/~/.bashrc 625 626## FTP and Firewalls 627 628The FTP protocol requires one of the involved parties to open a second 629connection as soon as data is about to get transferred. There are two ways to 630do this. 631 632The default way for curl is to issue the PASV command which causes the server 633to open another port and await another connection performed by the 634client. This is good if the client is behind a firewall that doesn't allow 635incoming connections. 636 637 curl ftp.download.com 638 639If the server, for example, is behind a firewall that doesn't allow 640connections on ports other than 21 (or if it just doesn't support the `PASV` 641command), the other way to do it is to use the `PORT` command and instruct the 642server to connect to the client on the given IP number and port (as parameters 643to the PORT command). 644 645The `-P` flag to curl supports a few different options. Your machine may have 646several IP-addresses and/or network interfaces and curl allows you to select 647which of them to use. Default address can also be used: 648 649 curl -P - ftp.download.com 650 651Download with `PORT` but use the IP address of our `le0` interface (this does 652not work on windows): 653 654 curl -P le0 ftp.download.com 655 656Download with `PORT` but use 192.168.0.10 as our IP address to use: 657 658 curl -P 192.168.0.10 ftp.download.com 659 660## Network Interface 661 662Get a web page from a server using a specified port for the interface: 663 664 curl --interface eth0:1 http://www.example.com/ 665 666or 667 668 curl --interface 192.168.1.10 http://www.example.com/ 669 670## HTTPS 671 672Secure HTTP requires a TLS library to be installed and used when curl is 673built. If that is done, curl is capable of retrieving and posting documents 674using the HTTPS protocol. 675 676Example: 677 678 curl https://www.secure-site.com 679 680curl is also capable of using client certificates to get/post files from sites 681that require valid certificates. The only drawback is that the certificate 682needs to be in PEM-format. PEM is a standard and open format to store 683certificates with, but it is not used by the most commonly used browsers. If 684you want curl to use the certificates you use with your (favourite) browser, 685you may need to download/compile a converter that can convert your browser's 686formatted certificates to PEM formatted ones. 687 688Example on how to automatically retrieve a document using a certificate with a 689personal password: 690 691 curl -E /path/to/cert.pem:password https://secure.site.com/ 692 693If you neglect to specify the password on the command line, you will be 694prompted for the correct password before any data can be received. 695 696Many older HTTPS servers have problems with specific SSL or TLS versions, 697which newer versions of OpenSSL etc use, therefore it is sometimes useful to 698specify what SSL-version curl should use. Use -3, -2 or -1 to specify that 699exact SSL version to use (for SSLv3, SSLv2 or TLSv1 respectively): 700 701 curl -2 https://secure.site.com/ 702 703Otherwise, curl will attempt to use a sensible TLS default version. 704 705## Resuming File Transfers 706 707To continue a file transfer where it was previously aborted, curl supports 708resume on HTTP(S) downloads as well as FTP uploads and downloads. 709 710Continue downloading a document: 711 712 curl -C - -o file ftp://ftp.server.com/path/file 713 714Continue uploading a document: 715 716 curl -C - -T file ftp://ftp.server.com/path/file 717 718Continue downloading a document from a web server 719 720 curl -C - -o file http://www.server.com/ 721 722## Time Conditions 723 724HTTP allows a client to specify a time condition for the document it requests. 725It is `If-Modified-Since` or `If-Unmodified-Since`. curl allows you to specify 726them with the `-z`/`--time-cond` flag. 727 728For example, you can easily make a download that only gets performed if the 729remote file is newer than a local copy. It would be made like: 730 731 curl -z local.html http://remote.server.com/remote.html 732 733Or you can download a file only if the local file is newer than the remote 734one. Do this by prepending the date string with a `-`, as in: 735 736 curl -z -local.html http://remote.server.com/remote.html 737 738You can specify a "free text" date as condition. Tell curl to only download 739the file if it was updated since January 12, 2012: 740 741 curl -z "Jan 12 2012" http://remote.server.com/remote.html 742 743Curl will then accept a wide range of date formats. You always make the date 744check the other way around by prepending it with a dash (`-`). 745 746## DICT 747 748For fun try 749 750 curl dict://dict.org/m:curl 751 curl dict://dict.org/d:heisenbug:jargon 752 curl dict://dict.org/d:daniel:gcide 753 754Aliases for 'm' are 'match' and 'find', and aliases for 'd' are 'define' and 755'lookup'. For example, 756 757 curl dict://dict.org/find:curl 758 759Commands that break the URL description of the RFC (but not the DICT 760protocol) are 761 762 curl dict://dict.org/show:db 763 curl dict://dict.org/show:strat 764 765Authentication support is still missing 766 767## LDAP 768 769If you have installed the OpenLDAP library, curl can take advantage of it and 770offer `ldap://` support. On Windows, curl will use WinLDAP from Platform SDK 771by default. 772 773Default protocol version used by curl is LDAPv3. LDAPv2 will be used as 774fallback mechanism in case if LDAPv3 will fail to connect. 775 776LDAP is a complex thing and writing an LDAP query is not an easy task. I do 777advise you to dig up the syntax description for that elsewhere. One such place 778might be: [RFC 2255, The LDAP URL 779Format](https://curl.se/rfc/rfc2255.txt) 780 781To show you an example, this is how I can get all people from my local LDAP 782server that has a certain sub-domain in their email address: 783 784 curl -B "ldap://ldap.frontec.se/o=frontec??sub?mail=*sth.frontec.se" 785 786If I want the same info in HTML format, I can get it by not using the `-B` 787(enforce ASCII) flag. 788 789You also can use authentication when accessing LDAP catalog: 790 791 curl -u user:passwd "ldap://ldap.frontec.se/o=frontec??sub?mail=*" 792 curl "ldap://user:passwd@ldap.frontec.se/o=frontec??sub?mail=*" 793 794By default, if user and password provided, OpenLDAP/WinLDAP will use basic 795authentication. On Windows you can control this behavior by providing one of 796`--basic`, `--ntlm` or `--digest` option in curl command line 797 798 curl --ntlm "ldap://user:passwd@ldap.frontec.se/o=frontec??sub?mail=*" 799 800On Windows, if no user/password specified, auto-negotiation mechanism will be 801used with current logon credentials (SSPI/SPNEGO). 802 803## Environment Variables 804 805Curl reads and understands the following environment variables: 806 807 http_proxy, HTTPS_PROXY, FTP_PROXY 808 809They should be set for protocol-specific proxies. General proxy should be set 810with 811 812 ALL_PROXY 813 814A comma-separated list of host names that shouldn't go through any proxy is 815set in (only an asterisk, `*` matches all hosts) 816 817 NO_PROXY 818 819If the host name matches one of these strings, or the host is within the 820domain of one of these strings, transactions with that node will not be 821proxied. When a domain is used, it needs to start with a period. A user can 822specify that both www.example.com and foo.example.com should not use a proxy 823by setting `NO_PROXY` to `.example.com`. By including the full name you can 824exclude specific host names, so to make `www.example.com` not use a proxy but 825still have `foo.example.com` do it, set `NO_PROXY` to `www.example.com`. 826 827The usage of the `-x`/`--proxy` flag overrides the environment variables. 828 829## Netrc 830 831Unix introduced the `.netrc` concept a long time ago. It is a way for a user 832to specify name and password for commonly visited FTP sites in a file so that 833you don't have to type them in each time you visit those sites. You realize 834this is a big security risk if someone else gets hold of your passwords, so 835therefore most unix programs won't read this file unless it is only readable 836by yourself (curl doesn't care though). 837 838Curl supports `.netrc` files if told to (using the `-n`/`--netrc` and 839`--netrc-optional` options). This is not restricted to just FTP, so curl can 840use it for all protocols where authentication is used. 841 842A very simple `.netrc` file could look something like: 843 844 machine curl.se login iamdaniel password mysecret 845 846## Custom Output 847 848To better allow script programmers to get to know about the progress of curl, 849the `-w`/`--write-out` option was introduced. Using this, you can specify what 850information from the previous transfer you want to extract. 851 852To display the amount of bytes downloaded together with some text and an 853ending newline: 854 855 curl -w 'We downloaded %{size_download} bytes\n' www.download.com 856 857## Kerberos FTP Transfer 858 859Curl supports kerberos4 and kerberos5/GSSAPI for FTP transfers. You need the 860kerberos package installed and used at curl build time for it to be available. 861 862First, get the krb-ticket the normal way, like with the kinit/kauth tool. 863Then use curl in way similar to: 864 865 curl --krb private ftp://krb4site.com -u username:fakepwd 866 867There's no use for a password on the `-u` switch, but a blank one will make 868curl ask for one and you already entered the real password to kinit/kauth. 869 870## TELNET 871 872The curl telnet support is basic and very easy to use. Curl passes all data 873passed to it on stdin to the remote server. Connect to a remote telnet server 874using a command line similar to: 875 876 curl telnet://remote.server.com 877 878And enter the data to pass to the server on stdin. The result will be sent to 879stdout or to the file you specify with `-o`. 880 881You might want the `-N`/`--no-buffer` option to switch off the buffered output 882for slow connections or similar. 883 884Pass options to the telnet protocol negotiation, by using the `-t` option. To 885tell the server we use a vt100 terminal, try something like: 886 887 curl -tTTYPE=vt100 telnet://remote.server.com 888 889Other interesting options for it `-t` include: 890 891 - `XDISPLOC=<X display>` Sets the X display location. 892 - `NEW_ENV=<var,val>` Sets an environment variable. 893 894NOTE: The telnet protocol does not specify any way to login with a specified 895user and password so curl can't do that automatically. To do that, you need to 896track when the login prompt is received and send the username and password 897accordingly. 898 899## Persistent Connections 900 901Specifying multiple files on a single command line will make curl transfer all 902of them, one after the other in the specified order. 903 904libcurl will attempt to use persistent connections for the transfers so that 905the second transfer to the same host can use the same connection that was 906already initiated and was left open in the previous transfer. This greatly 907decreases connection time for all but the first transfer and it makes a far 908better use of the network. 909 910Note that curl cannot use persistent connections for transfers that are used 911in subsequence curl invokes. Try to stuff as many URLs as possible on the same 912command line if they are using the same host, as that'll make the transfers 913faster. If you use an HTTP proxy for file transfers, practically all transfers 914will be persistent. 915 916## Multiple Transfers With A Single Command Line 917 918As is mentioned above, you can download multiple files with one command line 919by simply adding more URLs. If you want those to get saved to a local file 920instead of just printed to stdout, you need to add one save option for each 921URL you specify. Note that this also goes for the `-O` option (but not 922`--remote-name-all`). 923 924For example: get two files and use `-O` for the first and a custom file 925name for the second: 926 927 curl -O http://url.com/file.txt ftp://ftp.com/moo.exe -o moo.jpg 928 929You can also upload multiple files in a similar fashion: 930 931 curl -T local1 ftp://ftp.com/moo.exe -T local2 ftp://ftp.com/moo2.txt 932 933## IPv6 934 935curl will connect to a server with IPv6 when a host lookup returns an IPv6 936address and fall back to IPv4 if the connection fails. The `--ipv4` and 937`--ipv6` options can specify which address to use when both are 938available. IPv6 addresses can also be specified directly in URLs using the 939syntax: 940 941 http://[2001:1890:1112:1::20]/overview.html 942 943When this style is used, the `-g` option must be given to stop curl from 944interpreting the square brackets as special globbing characters. Link local 945and site local addresses including a scope identifier, such as `fe80::1234%1`, 946may also be used, but the scope portion must be numeric or match an existing 947network interface on Linux and the percent character must be URL escaped. The 948previous example in an SFTP URL might look like: 949 950 sftp://[fe80::1234%251]/ 951 952IPv6 addresses provided other than in URLs (e.g. to the `--proxy`, 953`--interface` or `--ftp-port` options) should not be URL encoded. 954 955## Mailing Lists 956 957For your convenience, we have several open mailing lists to discuss curl, its 958development and things relevant to this. Get all info at 959https://curl.se/mail/. 960 961Please direct curl questions, feature requests and trouble reports to one of 962these mailing lists instead of mailing any individual. 963 964Available lists include: 965 966### curl-users 967 968Users of the command line tool. How to use it, what doesn't work, new 969features, related tools, questions, news, installations, compilations, 970running, porting etc. 971 972### curl-library 973 974Developers using or developing libcurl. Bugs, extensions, improvements. 975 976### curl-announce 977 978Low-traffic. Only receives announcements of new public versions. At worst, 979that makes something like one or two mails per month, but usually only one 980mail every second month. 981 982### curl-and-php 983 984Using the curl functions in PHP. Everything curl with a PHP angle. Or PHP with 985a curl angle. 986 987### curl-and-python 988 989Python hackers using curl with or without the python binding pycurl. 990 991