| Re: Asynchronous FTP Upload [message #172061 is a reply to message #172055] |
Fri, 28 January 2011 19:48   |
Jerry Stuckle
Messages: 2598
Registered: September 2010
Karma:
|
Senior Member |
|
|
On 1/28/2011 10:56 AM, duderion wrote:
> On Jan 28, 4:29 pm, Jerry Stuckle<jstuck...@attglobal.net> wrote:
>> On 1/28/2011 10:12 AM, duderion wrote:
>>
>>> hi guys,
>>
>>> could anyone tell me how i can handle an ftp upload to several servers
>>> at once?
>>
>>> I found fb_nb_put, but i dont know how to combine 5 connections with
>>> this.
>>
>>> any help would be nice :)
>>
>>> dude
>>
>> You'll need to open 5 different streams and start each transfer. Keep
>> track of the status of each transfer in an array and loop while any of
>> them need to continue. In the loop, continue those which have not finished.
>>
>> Not sure what this is going to do though for you though, other than take
>> a lot of unnecessary CPU because you're effectively polling constantly.
>> Why don't you just upload each file individually?
>>
> Hi Jerry
> thanks for the quick and nice reply,
>
> i need to do this, because i have to trasfer videos to around 500
> hosts during one night. i have a 1gb upload line, and thats why i want
> to run those uploads simultaniously....
>
<Top posting fixed>
That doesn't mean you'll get anywhere near 1gb upload. Your limit in
this case is likely going to be disk access speed (assuming the other
hosts are replying in a timely manner, of course). And forcing the disk
to jump around to fetch data from different areas of the disk is likely
to be slower then accessing the data in a contiguous file.
The point being - even if you open 5 parallel connections, you are not
going to get 5x the speed; in fact, depending on what you're doing, you
may actually slow down the processing. And error recovery becomes much
harder.
You need to test and find out. The "sweet spot" may be anywhere from 1
to 500 parallel connections (although I highly doubt the latter :) ).
And it may vary depending on exactly which hosts you're currently
accessing and how quickly they respond.
P.S. Please don't top post. Thanks.
--
==================
Remove the "x" from my email address
Jerry Stuckle
JDS Computer Training Corp.
jstucklex(at)attglobal(dot)net
==================
|
|
|
|
Calendar
Search
Help
Members
Register
Login
Home
]