ESP8266 Community Forum

- Mon Aug 08, 2016 4:13 pm #52505 Gentlemen,

Let me introduce my new file download tool.
It uses feature of HTTP protocol named a 'byte serving'. Script checks that server is able to split data and gets target file by 1024 byte chunks that is fittable for file routines.

Please take a look on the tool and point me on issues: https://github.com/grytole/iot/blob/master/nodemcu-sketches/wget.lua

Some pros:

• file size independent = can use all available memory if file system can handle it (new 1.5.4.1 nodemcu release has no file size limit, hooray!) ;
• it looks stable now = I can't crash tool now, but I've not tried hard;
• supports HTTPS = you can get scripts directly from github (but I'm pretty sure your firmware needs SSL support);
• destination file name can be changed = just a simple pleasures;
• it fast = download works muuuuch faster than default 115200 serial connection;

Some cons:

• tool can not handle all variety of targets = e.g. github by default has huge response headers at start of data, so it fills out all space in TCP packet and lefts no space for important headers (damn, github, move your junk to the end!), but everything works fine with raw links - just press 'raw' button on the file page and use "...raw.githubusercontent.com..." URLs;
• takes a lot of heap = I'm not sure but it can be up to 20k;
• can not handle redirects = if server responds with code 302 it just stops (but it is done before download action) [in near TODO state for me];
• no additional options = it can not overwrite existing file, it can not continue download of uncompleted file [in far TODO state for me];

Some screenshots:

Big and small file download example

Download to target file example
2.png (10.37 KiB) Viewed 4552 times

File list after downloads
3.png (10.04 KiB) Viewed 4552 times

- Thu Aug 11, 2016 10:55 am #52705 Cool extension, thanks for sharing! Makes upgrading scripts and stuff a lot easier.
And there's a shell in your repo with telnet.

Note that the current firmware is supposed to have the file size bug fixed

- Sun Jan 15, 2017 12:24 pm #61057 @grytole any chance of the same in Arduino C++ rather than lua?