I have to download million of file from an http/https server making a lot of GET request like:
I don't want to overload the server, I don't want it to crash because of tons of connections
Is there a way to make multiple GET request in one connection so that I download multiple files at once?
I think there's a better way that doing single connection for each file like this
Can you help me?
Code:
GET /ALL/out/19742
GET /ALL/out/19755
GET /ALL/out/19758
GET /ALL/out/19762
GET /ALL/out/19769
GET /ALL/out/19773
GET /ALL/out/19775
GET /ALL/out/19776
GET /ALL/out/19778
I don't want to overload the server, I don't want it to crash because of tons of connections
Is there a way to make multiple GET request in one connection so that I download multiple files at once?
I think there's a better way that doing single connection for each file like this
wget -O ALL/out/999927 https://xxxxxxx/ALL/out/999927
wget -O ALL/out/999927 https://xxxxxxx/ALL/out/999928
Can you help me?