Yesterday I downloaded the v7.02 updates - using Firefox 3.6.xx and DownThemAll
The downloads ran through to about 97-98% then paused. Firefox/DTA thrashed around for as while, using 99% CPU; eventually the downloaded completed.
For example. for the Creative bundle, DTA paused at 97% - it then took over 3 minutes for the remaining 4 MB to be downloaded. For most of that time there was no data transmission, no disk activity, just CPU load.
I tried a couple of big downloads from other sites - they ran OK, no pauses, no heavy CPU load.
I think I recall something similar with previous downloads.
Downloads - odd behaviour
-
- KVRAF
- 10366 posts since 2 Sep, 2003 from Surrey, UK
-
- KVRer
- 11 posts since 27 Aug, 2010
Sounds like you're running some kind of internet security suite that snoops your HTTP traffic and withholds the last few bytes of the download while it runs the downloaded file through its antivirus scans.
Were those other large downloads you tested the same file type? (.exe?) Same Protocol? (HTTP/HTTPS)
Were those other large downloads you tested the same file type? (.exe?) Same Protocol? (HTTP/HTTPS)
-
- KVRAF
- Topic Starter
- 10366 posts since 2 Sep, 2003 from Surrey, UK
^^^^ Could be.
NIS 2012 - but I had switched it into "Silent Mode" to prevent it running any background activities and I did not it using the CPU in Task Manager - it was Firefox running at 99%. The other downland files were .zips.
NIS 2012 - but I had switched it into "Silent Mode" to prevent it running any background activities and I did not it using the CPU in Task Manager - it was Firefox running at 99%. The other downland files were .zips.
-
MeldaProduction MeldaProduction https://www.kvraudio.com/forum/memberlist.php?mode=viewprofile&u=176122 - KVRAF
- 14325 posts since 15 Mar, 2008 from Czech republic
Ojojojoj, Norton??? Run away!! I had this personally (because I got it for free 
) and it lasted 2 days here... This is a complete CPU overkill, which slows down everything and considers everything "potential threat"... Now I have AVG, and I'm fine 
. (no advertising, just experience, one needs to be careful about antiviruses, they can do more harm than the viruses 
)
) and it lasted 2 days here... This is a complete CPU overkill, which slows down everything and considers everything "potential threat"... Now I have AVG, and I'm fine . (no advertising, just experience, one needs to be careful about antiviruses, they can do more harm than the viruses )-
- KVRAF
- Topic Starter
- 10366 posts since 2 Sep, 2003 from Surrey, UK
^^^^
Maybe
But "Silent Mode" prevents it doing anything in the background. And this is not my DAW PC (which is not Interwebz-connected) - it's my general-purpose PC (which happens to run a DAW or two anyway).
Maybe
But "Silent Mode" prevents it doing anything in the background. And this is not my DAW PC (which is not Interwebz-connected) - it's my general-purpose PC (which happens to run a DAW or two anyway).
-
- KVRer
- 11 posts since 27 Aug, 2010
The way some of these products do the mentioned download stalling is that they intercept and artificially delay the API calls the downloading application send to the OS to read the incoming packets. Some downloaders don't expect that they do not get an answer from their API calls in a specified amount of time and freak out, in your case by crunching at 99% presumably.DarkStar wrote:^^^^ Could be.
NIS 2012 - but I had switched it into "Silent Mode" to prevent it running any background activities and I did not it using the CPU in Task Manager - it was Firefox running at 99%. The other downland files were .zips.
-
MeldaProduction MeldaProduction https://www.kvraudio.com/forum/memberlist.php?mode=viewprofile&u=176122
- KVRAF
- 14325 posts since 15 Mar, 2008 from Czech republic
Didn't know that! What's the purpose? I mean, most requests have like 30s time limit, if that exceeds it is considered disconnected...xplo wrote:The way some of these products do the mentioned download stalling is that they intercept and artificially delay the API calls the downloading application send to the OS to read the incoming packets. Some downloaders don't expect that they do not get an answer from their API calls in a specified amount of time and freak out, in your case by crunching at 99% presumably.DarkStar wrote:^^^^ Could be.
NIS 2012 - but I had switched it into "Silent Mode" to prevent it running any background activities and I did not it using the CPU in Task Manager - it was Firefox running at 99%. The other downland files were .zips.
-
- KVRer
- 11 posts since 27 Aug, 2010
What happens is essentially that most downloaders nowadays request a nonblocking socket from the OS to read available data from and do their own timeout handling.MeldaProduction wrote:Didn't know that! What's the purpose? I mean, most requests have like 30s time limit, if that exceeds it is considered disconnected...
Now when the security suite actually hooks into the API it will prevent the read() call on that nonblocking socket from returning anything at all until it did its background scanning.
The application however expects read() on a nonblocking socket to return immediately, even if no new data has arrived since the last call. If it doesn't, things can go badly.
I'm guessing the reason why this method is preferred by the AV companies over filtering the last packets on the network/packet-level is that they don't need to worry about TCP resends or other automatic lowlevel error correction that may kick in if they simply delay the last packets by using network filter drivers.
Now this is only the basic idea behind it, I'm sure some of these security suites have additional tricks to avoid above scenario.
Of course a more proper way would be making read() act as if the final part of the received file wasn't received yet until after the scans are done. But then they risk that the downloader application decides that the connection is dead after X secs of no new data.