download limiting not working

[EasyEddie]

I am trialling PG Offline.

The download limiting does not work sometimes.  I have it set at 300, wait 1 hr. The group I am trying to download has about 20K messages.  It works for a few hours, I get a few thousand messages. I leave it running over night, when I check in the AM its at 20K and getting the invalid page message.  So it has obviously been spending all night trying to load messages from when it was cut off by Yahoo (around 11K messages and the last message around 26K) gettingthe invalid page message for each attempt.  Its been 15 hours now since I stopped it and I still can not access Yahoo.

[Wilson Logan]

Eddie,

300 wait an hour is a guideline. It works for a lot of people but it depends ultimately on how big your messages are. If you download 300 large messages, it might tip you over the Yahoo limit.

Maybe try 200 wait an hour instead? Or club together with friends to DL your group. The Penturners group recently downloaded 42000 messages in just over a day by forming a download group of 8 individuals.

Regarding the delay in getting back onto Yahoo. This seems to vary between 2 & 26 hours. What is certain is that the longer PGO hammers away getting invalid messages, the longer you get locked out for. I'm working on a new feature that will allow you to define how many trys at getting a message PGO will allow before stopping. At the moment it just carries on to the next message.

New versions are announced on the board in the News & Updates section.

Thanks,

Wilson.

[EasyEddie]

I understand 300 is only a guideline.  The problem I was trying to report is that PGOffline does not stop querying Yahoo at 300, it keeps going for the 10K remaining messages, one at a time getting the invalid page returned for each one.

[Wilson Logan]

Eddie,

Thats what I'm saying:

"I'm working on a new feature that will allow you to define how many trys at getting a message PGO will allow before stopping. At the moment it just carries on to the next message."

The alternative is that PGO would just stop at the first missing message and you'd have to restart it manually.

The code returned by Yahoo for missing messages is 'Invalid page' so PGO doesn't know if the page is missing or if its been locked out. There are groups where the moderator has chosen to delete entire threads he doesn't like. I know of one group with 114 consecutive missing messages. So, this is the problem. After how many failed attempts should PGO throw in the towel?

Cheers,

Wilson.  

[pearltiger]

Wilson, add me to list of not understanding your answer to Eddie's post. My limits are not working for me either, so I'm missing something.
I just set the limit for 10 msgs/1hour to test and PGO is now running over 100msgs with no errors. Why did it not stop at 10 msgs?
What has this behaviour got to do with how PGO handles invalid page errors from Yahoo? I'm missing something, I guess.
Thanks,

Lynn Livingston

[Wilson Logan]

Lynn,

 Yahoo have imposed a download limit. This limit is (we think)  somewhere in the region of 2.4Mb's of data (or approx 300 messages) per hour.

Eddie's problem was that his 300 messages are probably larger than the average (maybe 2.6Mb's)  & so the Yahoo limit was triggered.   I have suggested to him that he reduce the number of messages he attempts to download in an hour from 300 to 200.

Your problem appears to be that the download limits aren't working properly for you. If you want to get 10 messages per hour then you need to set up your download limits like this:

http://www.pgoffline.com/images/set-download-10-60.jpg


The 'Enable download speed' box should be checked
The 'Repeat' radio button should be checked
The 'Download' box should have 10 in it
The 'Then wait' box should have 60 in it.

10 messages per hour is a little conservative. You could probably safely download 300 per hour but maybe you might want to start with 200 per hour.

Cheers,

Wilson.

[pearltiger]

Wilson,

It seems to be working fine this morning. I must have has something setup wrong the first few times I tried the limit.
Thanks for the help,

Lynn

[Wilson Logan]

Lynn,

No problem.

Cheers,

Wilson.