PG Offline

PG Offline => I need Help ! => Topic started by: JoeRoss on January 27, 2004, 02:57:59 AM

Title: Yahoo d/l limit
Post by: JoeRoss on January 27, 2004, 02:57:59 AM
Okay, I managed to piss my wife off by getting PGOffline installed on her computer, but darnit I need to play with this program! ;D

Anyway, here's what I found by playing with the new feature (Download speed limit).  Starting with a group containing 442 messages, I successfully retrieved 201 at 25 msg/min before I started getting "invalid page" errors. Anyone having similar problems or suggestions?
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on January 27, 2004, 09:04:15 AM
Joe,

We're all beginning to think that the limit is somehow related to time vs messages. I've had a few reports now that if people download say 200 messages & then wait a while (say an hour) and then download another 200 messages, all is hunky dory.

I will be implementing the following functionality ASAP.


'Download x messages then wait n minutes and repeat y times'

Where 'x', 'n' & 'y' are all user specified variables.  

Hopefully this should let you do unattended downloads.


Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Brett on January 27, 2004, 05:14:45 PM
I just installed yesterday and have been getting cut off by Yahoo.  I still have not figured out the limits.
* My fist time downloading, I got 842 messages before getting cut off.  This was a LAN connection, moderate speed.
* At home, on my broadband connection, I only got a few hundred messages before the invalid page.  Interesting that if you try to go to groups.yahoo.com with your browser, it will not let you in.  It must lock out your IP address.
* At home, I also have a dial-up connection.  I tried setting the msg/sec limit to 5 messages per minute, but it did not help.  I was still cut off after a few hundred messages.
* There is a nice side-benefit to the dial up connection.  After I get timed out by Yahoo, if I disconnect, and re-connect, I can download more messages.  I assume it is because I'm getting a new IP address.

I would REALLY like to know what the rules are that Yahoo has set up for cutting people off for too much downloading.  I have 11,000 messages in the group I moderate.  I find that the Yahoo archive search only searches the first few thousand - so I need a better search program (like this).
Title: Re:Yahoo d/l limit
Post by: Brett on January 28, 2004, 09:57:21 PM
One manual work-around is to use the Group Setting /Download Settings box and specifiy a smaller range of messages.  So on your first download, you set it to 1 to 150 then it will stop.  Then a while later set it to 151 to 300 and start it again, etc.  At least you can prevent it from going over the limit and getting locked out.

The other work-around that I mentioned before works well.  Use a dial up connection and when yahoo times out.  Just disconnect, dial again, and away you go.  I'm getting 320 messages at a time with this method.
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on January 30, 2004, 08:11:35 PM
Version 2.0.160 is now available. It has functionality which allows you to do 'download, wait, repeat' to avoid the Yahoo download limit.

http://www.pgoffline.com/groupmanager/pgpatch20160.exe

 The new functionality is in File--> Options--> Download. The initial download is set at (I think) 150 and the wait at 15 mins.  Testing would suggest that a download of 300 & a wait of 60 mins works well.

Cheers,

Wilson.

Title: Re:Yahoo d/l limit
Post by: prochargedmopar on January 31, 2004, 07:15:46 AM
I sure am glad I got all my groups before all this bull.  Now I just update every few days and I've never had that problem.
whew.
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on January 31, 2004, 11:06:05 AM
Todd,

I agree. I have a group (7X10minilathe) which has over 100,000 messages. Getting that 300 at a time would have been a bit annoying.

However, if you've got 20 buddies its amazing how many hands make light work.
20 guys could download 100,000 messages in just 16 hours even sticking to 300/hour.

Cheers,

Wilson.
 
Title: Re:Yahoo d/l limit
Post by: AceHarddrive on February 15, 2004, 12:27:18 AM
You said 300/60?  Is that without doing  anything else (web surfing...)?  What I mean is you set it, activate it, turn off the monitor and let it work overnight, right?

~Tim  :o

Title: Re:Yahoo d/l limit
Post by: Wilson Logan on February 15, 2004, 04:02:00 PM
Tim,

Yes, just set it up, switch off the monitor & go to bed.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: monte on March 15, 2004, 04:30:01 AM
fyi, I was downloading 300, then wait 60 min and I got over 1000 messages from a group I was downloading.  Then I went and started browsing the group online and promptly got cut off again.

Monte
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on March 16, 2004, 08:42:48 PM
Monte,

 Then Yahoo must be accumulating the total amount DL'd by any one IP. Its not happened to me but I'm in Europe & their limits seem to be much laxer here.

I guess if you want to surf Yahoo Groups after DL'ing with PGO you need to DL a bit less than 300 as 300 appears to be at the ragged edge of the limit.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Pres on March 17, 2004, 12:01:00 AM
I've just begun fiddling with PG Offline, but it's been happily plugging away for me for the last 12 hours by setting it to 300 messages and a 61 minute delay. I don't really know if the "1" is important, but I figure I'd hate to trigger a lockout if it were at something like 59 min and 57 seconds, so I gave it an extra minute.

I tweaked it on one group with 2800 messages,  and when that finished just before going to bed last night, I began a group with 19,000 messages. Got 2100 so far... :)

Oh yeah, I'm in Japan, but accessing US groups. I was getting lockouts similar to the ones reported for people in the US, so perhaps it's only Europe that gets nice lax DL limits.

Pres
Title: Re:Yahoo d/l limit
Post by: T-Bone on April 01, 2004, 08:09:30 PM
Well I am able to only d-load about 150 messages in a session.  I am in the United States and have a dial up connection.  Does the 60 minute wait interval seem like a good starting point for most of you guys?

I am aware of that I can change my IP address by redialing  but I am trying to optimize unattended downloads.

Thanks,

-T
Title: Re:Yahoo d/l limit
Post by: Pres on April 02, 2004, 02:59:44 AM
I found that in the group that I was DLing there were a fair number of deleted messages. What I think might be going on is this:

When you set PG Offline to download, say, 300 messages, it seems to keep downloading until it actually gets 300 valid messages -- meaning that any invalid/deleted message numbers don't count against the DL counter, and you wind up pounding Yahoo for that many extra times.

For example, I found that by subtracting the highest downloaded message in one "DL block" versus the highest from the previous block, there were actually more DL attempts (including nonexistent messages) than the DL limit said: with the DL limit set to 300, I had 328 and 322 DL attempts (and I was getting locked out), then with the limit reduced to 250, it was 277 and 261 (and I no longer got locked out).

For groups with lots of deleted or unavailable messages, this might be pushing Yahoo to cut us off sooner than it otherwise would? Worth a thought, anyway.

So for the record, my current settings are now 250 messages, with a 65-minute wait. I completed my 19,000 message group with these settings.

Pres
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 02, 2004, 08:21:34 PM
My thoughts are that this limit is bandwidth based, so failed download attempts don't add (significantly) to the bandwidth used.

What does definitely vary is message length. Lets say that the limit is 2.4 Mb. That means that you could get three hundred 8k messages before being kicked. What if users on your group are a bit more chatty & the average message length is 9k?  I think that you can see that number of messages can only be a guideline when it comes to setting up downloads.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: T-Bone on April 02, 2004, 10:16:36 PM
I would agree that the limit seems to be bandwidth based.  For that reason I get on average between 150-175 messages at a time.  But whats odd is that you folks can get upward of 300 messages.  I looked over my messages and they are definately on the small size with no attachments.


Anybody try the per minute download limitation?  (to emulate as if you were just clicking next on your broswer)


-T
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 03, 2004, 12:24:10 AM
Per minute download was our first solution but it looks like the limit is not only bandwidth but load based. Downloading messages constantly at exactly the same time interval is the hallmark of an automated system and I think Yahoo is set up to be sensitive to that pattern of downloading.

Put it this way, if I was them thats what I'd be doing.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Brad on April 03, 2004, 04:08:08 AM
Shure seems like they've changed their parameters.  I'm failing around 200 messages now whereas it was over 300 now.

Brad
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 03, 2004, 11:55:10 AM
Brad,

I think we have to expect that. If I were them, I'd keep lowering the limit until I started to get plenty of complaints from ordinary users, then I'd up the limit 10% as a safety margin. I guess they're still experimenting.

Your best defence is to refresh your groups as frequently as possible.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 05, 2004, 10:16:15 AM
Maybe what I need to add is a 'Share' feature.

In Download Settings (next to the Skip properties) there would be a new radiobutton group:

 'Refresh & Share'  or  'Refresh from PGO'

The first option allows you to download from Yahoo & then upload to the PGO server.
The second option allows you to get new messages only from PGO.

E.g.

Bob, Tom & Graham are all members of Hobbicast, Casting & Southbendlathe.

Bob checks the 'Refresh & Share' for Hobbicast and 'Refresh from PGO' for Casting & Southbendlathe.

Tom checks the 'Refresh & Share' for Casting and 'Refresh from PGO' for Hobbicast & Southbendlathe.

Graham checks the 'Refresh & Share' for Southbendlathe and 'Refresh from PGO' for Hobbicast & Casting.

This way each guy only downloads one group but gets the messages for all groups he's interested in.
Its all about teamwork.

Thoughts?

Wilson.
Title: Re:Yahoo d/l limit
Post by: Pres on April 05, 2004, 01:31:19 PM
That'd be cool! If you make it easy to share archives (i.e. allow us to do it within PGO) then I think you'd get a lot of people willing to share. I've currently got about 170MB of messages total from two groups that I'd be happy to share, but if I have to use a CD-R or something like in the tutorials, then it's like, who am I going to mail it to from way over here in Japan? :D

This would reduce the load on Yahoo, but then put it on PGO. Any given group would probably have limited downloads, but put them all together and that's a lot of disk space/bandwidth...will your server be OK?
Title: Re:Yahoo d/l limit
Post by: wundrbee on April 05, 2004, 01:50:51 PM
What about having it setup so that there's an option to download from the PGO server and be able to add additional servers. Eventually PGO's space would run out. By letting us add our own, we'd be able to publish the info on the PGO website and add it to PGO.

Jim, bob, and Joe are on such-and-such list Jim and Bob have there own web space, they put the server info on on PGO's website. Joe doesn't have webspace so PGO let's him upload. They each then add the server info from Jim and Bob to the Groups Properties. Then hit "refresh using all sources" or something like that.

It sounds good - but I'd be concerned that it might leave a nice loophole for unscrupulous folks to dig around in other files on your web server.

Geez, I hope I typed that to where it made sense. I just woke up and haven't made it through my first cup of coffee yet :)

Tammi
Title: Re:Yahoo d/l limit
Post by: lorraine on April 05, 2004, 02:00:21 PM
Quote from: Brad on April 03, 2004, 04:08:08 AM
Shure seems like they've changed their parameters.  I'm failing around 200 messages now whereas it was over 300 now.

I'm actually downloading around 400 messages this morning before getting blocked on a dial-up.

Lorraine
Title: Re:Yahoo d/l limit
Post by: Brad on April 05, 2004, 03:21:09 PM
Your message gave me hope that I'd solved the problem.  I had a theory that it was throttling on yahoo's end dependent on system load.  If so, we could avoid downloading on weekends.

So I reset my program to d/l 300 before pausing.  If failed at 152.

Oh well, blows my theory out of the water.

Brad (cable modem downloading at around 60 mes/min.
Title: Re:Yahoo d/l limit
Post by: Brad on April 05, 2004, 05:37:23 PM
One thing I'll mention is that when you time out, the program thinks 6 or so messages are unavailable, and will skip them when you resume downloading.  You need to use the "Find Missing Messages" option and  download them later otherwise you will have gaps of valid messages in your database.  I'd wait until I had completed the complete download before letting the program locate and download the missing messages.

Brad
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 05, 2004, 07:13:33 PM
Pres,

>Any given group would probably have limited downloads, but put them all together and that's a lot of disk space/bandwidth...will your server be OK?

I have 20GB a month. Thats good for about 2.6 million messages. Also, this feature is just for catching the latest messages, not for DL'ing whole groups, thats what the zipped archives are for.

The short answer to your question is... yes!

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 05, 2004, 07:16:04 PM
Tammi,

>What about having it setup so that there's an option to download from the PGO server and be able to add additional servers.

My original idea was to have a Napster style file sharing facility but I'm not happy about the security of such a thing, hence all traffic goes through my server so that no-one is exposed to an unknown 3rd party.

Your idea for adding servers has merit though.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: ginahoy on April 06, 2004, 06:14:14 AM
Hi Wilson and all,
I've just started downloading large blocks for the first time tonight. I started with 175 messages. For the particular group I was downloading, this turned out to be 3.48 MB (20kB/msg). I recorded this with "DU Meter" a utility that displays a horizontal-scroll bar graph of upload/download rate and also has a built-in upload/download stopwatch.

To test your theory that the Yahoo limit is bandwidth-based, others should post examples of how many bytes and messages they transfer without pausing. Or better yet, how many bytes had been transferred when they hit the limit and get kicked.

Is anyone aware of another program for monitoring download rate and volume? Unfortunately, DU Meter must be purchased. As and aside, I considered checking the pgo's database (.mdb) file before and after the download, but on second thought,  I have no idea how closely the record size compares to the number of bytes downloaded. Retransmitted bytes, IP overhead, etc, must also be considered. A download monitor seems like the only way to do this with any accuracy (hint, hint!)

David Butler
Title: Re:Yahoo d/l limit
Post by: wundrbee on April 06, 2004, 06:44:04 AM
Quote from: Wilson Logan on April 05, 2004, 07:16:04 PM

My original idea was to have a Napster style file sharing facility but I'm not happy about the security of such a thing, hence all traffic goes through my server so that no-one is exposed to an unknown 3rd party.


Wilson,
This was my concern also - It was just too early to articulate it very well!

Tammi
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 06, 2004, 10:45:22 AM
David, Tammi,

I did ask the developer about adding a download meter for the very reasons you've mentioned but because the bandwidth used isn't just the data downloaded, its simply too big a task given that the feature is a 'nice to have' & not mission critical.

I'm not saying we won't come back to this but not until we've got through our current development queue.


Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Pres on April 06, 2004, 03:26:30 PM
QuoteI have 20GB a month. Thats good for about 2.6 million messages.
Cool!

QuoteAlso, this feature is just for catching the latest messages, not for DL'ing whole groups, thats what the zipped archives are for.
Hey, there ya go... Never noticed that you could upload archives before...duh. ::) I'll look into getting clearance to upload from my group mom.
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on April 06, 2004, 11:45:58 PM
Pres,

When you're going to upload, please make sure the archive files are zipped up before you FTP them.

Cheers,

Wilson.
Title: Yahoo d/l limit Update
Post by: Brad on May 06, 2004, 01:33:16 AM
Tonight, no d/l limit seem to be in effect.  I haven't downloaded in some time, but tonight I decided to download a 91,000 message group.  I'm on a broadband connection in a motel and it just keeps banging away at about 90 to 110/minute.  I know I've already got at least 2K, so I've turned off limiting and getting as many as possible.

Brad
Title: Re:Yahoo d/l limit
Post by: Brad on May 06, 2004, 10:50:02 AM
Over 32,000 messages in about 4 hours and still running!

Brad
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on May 06, 2004, 08:58:49 PM
Brad,

Thats great news.

Make hay while the sun shines !

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: ginahoy on May 06, 2004, 09:55:19 PM
With one-way satellite, I can usually d/l a large file or image at 1.4 Mbps. However, since pgo must send a request for each message, it can only retrieve about 32 messages per minute. This is due to satellite latency as well as the limiations of using a landline for uplink.

But even still, I've been downloading a large group for the past couple of hours and haven't hit a snag yet. Thanks for the alert!

I wonder if the driver is asleep at the wheel or he's just trying to see how hard it will rain!

David
Title: Re:Yahoo d/l limit
Post by: Pres on May 07, 2004, 06:39:59 AM
I'm seeing the same thing here - I've got 10k messages so far from a group I'd been putting off downloading because it had 23k messages and I figured that'd take forever.

But not today! (:

FWIW my rate with cable (in Japan) is also in the 30-33 messages/minute range.

Pres
Title: Re:Yahoo d/l limit
Post by: ginahoy on May 07, 2004, 07:27:11 PM
Well, it appears that the party is over. I just hit limit at after 345 messages. Oh, well. It was great while it lasted. I should have left my system on all night last couple of nights!
David
Title: Re:Yahoo d/l limit
Post by: Pres on May 08, 2004, 01:06:13 AM
Yeah, I woke up this morning and found that my download had peaked out at 13,000 of 23,000 messages.

They're probably looking at their logs right now and saying, "Man, we better not do that again!"  ;)
Title: Re:Yahoo d/l limit
Post by: gcnmarcus on May 21, 2004, 10:12:33 AM
Hello,

I just found out about this site.  I normally use YahooPOPS but I will check this out and see how it works.

I just got a 999 error which may be a result of some limit.  So far I have seen people talk about number of messages sent as well as time spent as variables Yahoo might use to determine when an account should be locked up with a 999.

May I also suggest it might keep track of what intervals an account is accessed.  For example, if you make it wait 1 hour before downloading more messages, Yahoo might have a limit as to how many times it gets mail every hour.  If it retrieves mail in this fashion, then 24 times with an hour apart could possibly be a factor to block an account.

I say this cause I don't come close to 20-30 emails a day.  I also regularly delete messages.  I don't spend much time, but I do have email programs check on a regular basis.  If people chose an hour interval, perhaps there could be something added like randomly pick 1-10 minutes to jog the times it checks email so it isn't always an exact hour.  Then Yahoo would have a harder time to determine if it is automatic.  There is also the possibility they have a range set up.
Title: Re:Yahoo d/l limit
Post by: Pres on May 22, 2004, 03:52:45 AM
Just to keep things up to date, I ran into the "Error 999" DL limit after only 168 messages of a new group today. But that was after poking about on the Groups web pages earlier on, so that might have used up some of my brownie points for the day. :) It looks like they're still tweaking their settings.

I'll try setting my limit lower and see what happens.
Title: Re:Yahoo d/l limit
Post by: ginahoy on May 22, 2004, 05:05:59 AM
I'm not sure, but it seems to me that other things could cause the 999 error. I got it today on my first attempt to access my groups. And this has happened to me twice in the last couple of months.

Since my ISP assigns IP addresses dynamically, it's possible (but highly unlikely) that another PGO user had been assigned the same IP address earlier in the day and had already tripped the limit. But I have Direcway Satellite modem, and there aren't very many of those out there

So I can't help but to wonder if Yahoo may be using this same response when they have server problems, etc.

David
Title: Re:Yahoo d/l limit
Post by: ginahoy on May 22, 2004, 05:22:42 AM
Quote from: gcnmarcus on May 21, 2004, 10:12:33 AM
I just got a 999 error which may be a result of some limit.  So far I have seen people talk about number of messages sent as well as time spent as variables Yahoo might use to determine when an account should be locked up with a 999.

gcnmarcus,
There's been a lot of discussion on this issue (much of it in this thread). My personal experience suggests that the limits are based on a combination of the number of message reads and the number of bytes transferred within some time frame. And to be sure, Yahoo has tweaked the limits since they were first initiated earlier this year.

If you aren't already aware of it, there's a menu where you can customize your download speed and profile (file/options/download). But there's no facility for randomizing the wait time. Your suggestion that Yahoo servers are somehow setting limits based on the current activity profile of each individual user seems a bit far fetched.  

Most people report success with rates of 150 to 400 messages per session. This is useful for archiving an entire group. Your comments suggest that you might have been blocked after downloading just a handful of messages. Please elaborate.

David
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on May 22, 2004, 09:43:22 AM
Hi David,

>I'm not sure, but it seems to me that other things could cause the 999 error. I got it today on my first attempt to access my groups.

Yahoo bring down their system on a near daily basis for 1 to 2 hours to do some sort of maintenance. In my experience it seems to be happening around 08 - 09 GMT ( 00 - 01 PST ?).  This will lead to a 999 error without downloading any messages.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: ginahoy on May 26, 2004, 04:38:13 AM
Quote from: bruce on May 26, 2004, 03:13:00 AM
wonder how long the yahoo lock lasts...still about a day like before?
In my experience, the lock lasts a couple of hours, always less than three.

Quote
also interesting...when I would be shut out on previous versions, I could not access yahoo at all.  Nowadays, I can access yahoo manually through my browser, even though PGO reports a yahoo lock.

I don't see how the version changes could have anything to do with that. Lockout is based on your IP address. If you could access your groups via browser, you weren't locked out (that is, unless your browser is AOL, in which case the browser is assigned a different IP address from your primary connection).

FWIW, I've had a few sessions in recent days where pgo reported a time-out or another error message (I can't remember specifics), but I wasn't locked out. In the case of the time-out, it was an issue with my Internet connection. I know there's been a lot of changes to the program in recent weeks, but I have no reason to think the errors I got had anything to do with pgo.
DavidB
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on May 26, 2004, 10:00:45 AM
> also interesting...when I would be shut out on previous versions, I could not access yahoo at all.  Nowadays, I can access yahoo manually through my browser, even though PGO reports a yahoo lock.

This shouldn't happen. If you get told by PGO that you're locked out then you shouldn;t be able to access Yahoo.

Please check your Workflow option isn't still set. This feature is redundant as PGO now recognises the difference between failed messages & a lock-out situation.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: ginahoy on May 28, 2004, 04:45:28 AM
Bruce,
Please post the specific message you get when you are locked out.
Title: Re:Yahoo d/l limit
Post by: bruce on May 29, 2004, 04:45:50 AM
Whew....  its working so well, I thought I was going to run out of messages to download before I got the error again  :D

the specific errror is ....

5/28/2004 10:43:04 PM >  Error : You were locked by yahoo.


bruce
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on May 29, 2004, 10:08:57 PM
Bruce,

You're getting

>  Error : You were locked by yahoo.


and you can still surf Yahoo ?  What happens if you resume your download?  You can automatically resume after a user definable delay (a new option in Workflow).

Cheers,

Wilson.



Title: Re:Yahoo d/l limit
Post by: bruce on May 30, 2004, 03:43:59 AM
I did not have the resume option turned on.... and since I usually shut down at night.....i never messed with it.  just started fresh the next day.  ill turn it on and see what happens.  but now i will have to find another large group to dl.   grin.  its so fast ive run out of messages.

still strange that it only locks out pg offline.  when i come back the next day, pgo can get back in.  shrug.  im not complaining.
Title: Re:Yahoo d/l limit
Post by: gmayhew on June 03, 2004, 09:43:42 PM
I just thought I'd add a another data point. I'm using the workflow option, downloading 250 messages, then waiting 10 minutes. I'm also caching 30 messages at a time. I have not been locked while using this method, although I do run into other errors, every few hours.

My connection is pretty fast, 1.5Mbps, which probably helps.

Regards,
George
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on June 04, 2004, 09:12:06 AM
 Come on guys... you know we should be discussing this in the other group. I'll send you both invites.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Betrock on July 05, 2004, 09:21:11 PM
Newbie here.  Need some simple guidance.  I've read everything(well, most) in this topic, and am now completely bewildered!

My needs are small.  I own/moderate 1 little Group on Yahoo.  It is a fairly new, but fast growing group.

Background info:
-Total of 374 messages (actual count much lower, as many are deleted regularily).  For the deleted ones I got the 'Invalid Page Format'. No problem.
-The group is closely moderated by 3 Moderators.  I want to download messages say, every 2 hours, so that I have a record of them before they are deleted.  Our members are 'warned' about invalid posts, and I need a record of this.

Cable Modem
Win98SE
Locked out at #361.
Locked out of Yahoo access

Questions:
1) Roughly, how long will lock-out of Yahoo site last?

2) File: Options:
  a) Refresh Groups Tab- since I only need the one group, but need info updated often, what would be a suggested setting?

  b) Download Tab: What would be a setting that would not get me locked out by Yahoo?  Since my # of messages are small, but frequent, I need a very 'safe' estimate - not the mega-max # of messages downloadable in a millisecond.

  c) Workflow Tab: Basically same question a 2)c.

  d) Mail Tab:  minor point- since I have no use for this what so ever, is ther any way to stop the pop-up warnings about SMTP not filled in, etc?

Thank you so much for any help you might give.  My needs are so small compared to ya'll who are trying to download thousands of messages, that I almost feel guilty asking!

Thanks,
Betrock
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on July 06, 2004, 12:13:56 AM
1) Roughly, how long will lock-out of Yahoo site last?

>>>> Depends on how long you continue to hammer the site. If you stop as soon as you're locked out... about 2 hours.

2) File: Options:
 a) Refresh Groups Tab- since I only need the one group, but need info updated often, what would be a suggested setting?

>>>> Refresh on Startup. Leave other boxes unchecked. Or Refresh Periodically.. experiment with the period.

 b) Download Tab: What would be a setting that would not get me locked out by Yahoo?  Since my # of messages are small, but frequent, I need a very 'safe' estimate - not the mega-max # of messages downloadable in a millisecond.

>>>> Enable download speed limit. Repeat, download 30 then wait 60.

 c) Workflow Tab: Basically same question a 2)c.

>>>> On lockout resume after 120 min.

 d) Mail Tab:  minor point- since I have no use for this what so ever, is ther any way to stop the pop-up warnings about SMTP not filled in, etc?

>>>> Put in anything... smtp.invalid.com

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: Betrock on July 06, 2004, 03:56:12 AM
Wilson-
Thank you so much for your prompt and succinct reply.  Among everything else I didn't grasp, it never dawned on me to just enter a fake email!
Thanks again,
Betrock
Title: Re:Yahoo d/l limit
Post by: Brett on December 28, 2004, 07:28:23 AM
I don't know if yahoo changed something or the latest version fixed something, but I just joined a new group and downloaded over 17,000 messages at 250-300 messages per minute with no pauses or delays.  It just kept going!  I never got locked out.  It was going for about 1.5 hours.  Very cool!  If anyone needs the BMWe39 group I've got it.
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on December 28, 2004, 09:51:22 AM
Hi Brett,

It seems to vary. I've been kicked after 12,000 and have DL'd 80,000 the next day !?!

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: nutcracker on January 09, 2005, 09:24:59 AM
Just come across your site after doing a search on the error 999 hope you don't mind me  updating you all here?
I have many websies right through yahoo geocities in the plus and business section I live here in the UK &  have unlimited download with a added 175 mb storage space for the added updated.

This is what I got back from yahoo




Thank you for writing to Yahoo! GeoCities.

As I understand, you are inquiring about receiving a 999 error when
visiting your website.  We were able to view your page at: xxxxxxxxxxxxxxxxxxxxxxx

If the problem has not been resolved, you may want to try clearing your
cache or reloading your page.

To Reload your page:
View your page again and press the "Shift" button down on your keyboard
at the same time clicking on the Reload/Refresh button on your browser.

The Error 999 code is a result of pirated IP addresses, and the blockage
has been instituted as an Abuse safeguard.
In these instances, Yahoo!
has intentionally blocked these IP addresses. Yahoo! monitors all network activity and when they notice a significantly high amount of
activity coming from a specific IP address or a proxy, Yahoo! blocks it.
The downfall to this is that most pirated IP addresses belong to small
business or home users. When Yahoo! blocks the IP address to safeguard
against getting hit, the original owners of the IP addresses also get  ??? blocked.

Please do not hesitate to reply if you need further assistance.

Regards,

Yahoo! Customer Care  ??? :-\ :'(
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on January 09, 2005, 11:37:50 PM
Thanks for that interesting perspective.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: JRouche on February 12, 2005, 12:52:11 AM
Quote from: nutcracker on January 09, 2005, 09:24:59 AM

To Reload your page:
View your page again and press the "Shift" button down on your keyboard
at the same time clicking on the Reload/Refresh button on your browser.





I was (atually still am) locked out with a 999 code and the shift reload did not work, bummer. JRouche
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on February 14, 2005, 11:07:21 PM
What does work is re-assigning your IP address. If you're on a dial-up simply drop the connection & reconnect. It also might work on DSL.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: gavmac on February 15, 2005, 08:40:59 AM
 It also might work on DSL.


It does providing you have a dynamic address ;)

Gavin
Title: Re:Yahoo d/l limit
Post by: Carolsea on February 23, 2005, 12:27:48 AM
Hi everybody - I'm so thrilled to have found PGO so I can save my yahoogroups messages, but I'm finding the same problem with the download limit thing on yahoo.  I am on a high speed Cable connection.

I have a group with 18000+ messages that I started d/ling last night, got the first 1466 or so, then it skipped to 5006 and went to 9301.  Now I continued to get the invalid page format message, and I'm totall locked out of the messages on this group on yahoo - I can't read a message there at all, though I can go to other areas of the yahoogroup site.  When I try to open a message, it says my download limit has been reached and to try later.  

Well, I've waited different amounts of time, including 7-8 hours, and nothing has changed.  Any ideas?  Do I need to try to d/l from a dial-up connection and use the changing-ISP # trick?

I hope yahoo isn't locked up permanently, as I really need to have access to those messages!!   :-\

Help?

Thanks
Carolsea
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on February 23, 2005, 01:31:32 AM
Hi Carolsea,

You won't be locked out forever. Every invalid page counts as a hit on the Yahoo servers. Too many (200 - 300) and they lock you out. Typically 2 - 3 hours but if you've hammered their server with hundreds of requests then it could be as much as 24 hours. You can avoid this by setting the "Stop after receiving n Invalid pages" field in the Workflow tab.

http://www.pgoffline.com/images/workflow.jpg

I set mine to stop after 10 pages. That way I can manually set the start point of my download to skip past the Invalid Pages. To set the "Stop after receiving n Invalid pages" field look in File--> Options--> Workflow. To set the start point for the download double click the groupname in the groups list & choose the Group Settings tab. You can set the start point there.

Please read this post for whats going on vis-a-vis the Invalid Pages:

http://pgoffline.com/forum/index.php?board=5;action=display;threadid=296;start=msg1420#msg1420

Cheers,

Wilson.

Title: Re:Yahoo d/l limit
Post by: The Colonel on June 01, 2005, 12:12:55 PM
Greetings,

So i'm a total newb, but i've recently become enamored while reading this forum due to my outrage with yahoo groups and thier fascist download limits. As much as i'm loving everything i'm reading, i'm not sure if any of this pertains to my problem; which brings me to this post... So i've been trying to download files from the files sections of my yahoo groups and continuously get an error message due to the daily download limit being exceeded. Is this the same or even similar problem to what you guys are talking about here, and if so, what is the solution. Thanks for your time.
-TS
Title: Re:Yahoo d/l limit
Post by: ginahoy on June 01, 2005, 03:09:34 PM
TS,
A daily file download limit!?  I've never encountered that one before... but I don't do a lot of file downloading.  Perhaps others have?

Are you able to access group messages after getting the error?  This is sorta off-topic since pgo doesn't do files, but I imagine others reading this list would be interested.  Does it actually mention a daily download limit?  If possible, please copy and paste the text of the Yahoo error message.  

I think Yahoo implemented the message download limits to prevent denial of service attacks.  The error message is more obscure... nothing about download limits.  Also, the lockout lasts a few hours or less, not a day (and appears to be based on IP address, not Yahoo ID).  

The solution is to do fewer file downloads, or wait until the lockout ends. Or, if you can, change IP addresses (or use a different ISP).  That should keep you going.  PGO has some tricks to get around the message d/l limit, but these don't apply to file downloads.

David
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on June 01, 2005, 04:49:22 PM
Hi Colonel,

What David says sums its up. All I can add is that I have personally been a member of Yahoo groups with heavy file sharing and the limit imposed is on the group, not the member. Hence when the limit is reached, the whole group is locked rather than the individual member.
This means that there's very little (if anything) we can do as users to get round this limit.

What did happen was that the group owners set up multiple groups e.g.

Filesharing
Filesharing-1
Filesharing-2
Filesharing-3

etc. to share the load over many groups.

But thats up to the groups owners to manage & not us users.


Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: DaveMucha on September 04, 2005, 03:42:05 PM
Hi guys,

So.... what is the current limit people are getting on downloads ?

1,000 , ??  10,000 ??  more ? less ?


Dave
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on September 05, 2005, 03:50:45 PM
Hi Dave,

With caching on I can still get 80 - 120 thousand messages in one go.

Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: DaveMucha on September 05, 2005, 04:50:54 PM
so, all the talk about limits is in the 10's of thousands ?

Seems if someone wants to get started, they can download a zipped forum that needs to be updated, skip the first 80,000 post download and then add the most recent 6,000 posts and be up to date.


Dave
Title: Re:Yahoo d/l limit
Post by: Wilson Logan on September 05, 2005, 07:43:31 PM
Absolutely.  Its the only way to fly.

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: daryy on February 11, 2009, 04:30:41 AM
I just update every few days and I've never had that problem.Get the AC parts like AC Compressor, AC Condenser, AC Evaporator and more parts ... Lexus AC Compressor (http://www.discountacparts.com/Lexus/A-C_Compressor.html) | Mercedes AC Compressor | Mitsubishi AC Compressor ...
We offers FREE SHIPPING & One-Year Lower Price Guaranteed on Ferrari 308 Parts (http://www.carpartswarehouse.com/carmodels/CP5/Ferrari/308.html).Eagle Medallion Automotive Parts, Buy high quality after market auto body parts at wholesale price. Including Head Lamps, Tail Lights, Mirrors, Bumpers

Title: Re: Yahoo d/l limit
Post by: Wilson Logan on February 12, 2009, 05:21:38 PM
Well, until recently I was just getting about 6000 before getting locked out but about two weeks ago I tried a big download and was back to getting 20,000 - 30,000 at a go.

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: lilhlfpint on February 19, 2009, 05:21:23 PM
Ah, ha.  This is exactly the problem I'm experiencing this morning.

Thank you for the good advice!
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on February 20, 2009, 12:03:59 AM
OK, no problem. Just wait a few hours and try again. The following is advice I give new users:

The Message Caching download can be controlled from: 

File--> Options--> Download   

The maximum number of messages which can be cached is 30.

The Yahoo download limit is about 200 to 300 messages. By downloading 30 messages at a time, you can download 6,000 to 9,000 messages without being locked out by Yahoo. On occasions I have downloaded over 20,000 without problems but if you want a safe default, go with 4000 - 5000 at a time.

If you're doing an overnight/unattended download which you know to be greater than 9000 messages I suggest you set your Workflow options (File--> Options --> Workflow tab) as attached. The reasons for this are:

1) If you do get locked out simply by the sheer number of messages downloaded, setting the "on resume" option to 120 mins will retry to start your download once every 2 hours.

2) When you're doing a refresh or initial download of multiple groups & you get a group you can't read e.g because Yahoo has changed the group format or many messages are deleted, PGO tries to get the first of 30 messages. It then assumes that the message has been deleted & then tries to get the next message *in sequence* not the next 30th message. This happens until the end of the group is reached or you get locked out (after about 200 of these errors). If you set the Workflow option so that you stop after receiving 10 invalid messages you can at least avoid being locked out. In future you can set that Group to be skipped during Refreshes. 

Try checking the downloads page. Your groups may be available as archive file downloads.


Cheers,

Wilson.
Title: Re:Yahoo d/l limit
Post by: t2000kw on July 26, 2009, 01:14:17 PM
Quote from: DaveMucha on September 04, 2005, 03:42:05 PM
Hi guys,

So.... what is the current limit people are getting on downloads ?

1,000 , ??  10,000 ??  more ? less ?


Dave

I've got to about 30,000 or so before being cut off. But it seems arbitrary as to when Yahoo decides to cut off the connection. Sometimes it tales less than that.

Just got locked again by Yahoo. Now I'll change my download limit before the wait period to 199 and go from there.

I did get pretty far this last time before getting locked.

I just now set my options to allow me to d/l 25 messages at a time, up to 250 messages, then wait 1 minute and start all over again. I haven't tested this out yet but am right now on a group where I have about 15,000 more messages to d/l.
Title: Re:Yahoo d/l limit
Post by: t2000kw on July 27, 2009, 12:02:32 AM
This COULD be possible if you use a different Yahoo account to visit the group with your browser than the one you do with PGO.

Quote from: Wilson Logan on May 26, 2004, 10:00:45 AM
> also interesting...when I would be shut out on previous versions, I could not access yahoo at all.  Nowadays, I can access yahoo manually through my browser, even though PGO reports a yahoo lock.

This shouldn't happen. If you get told by PGO that you're locked out then you shouldn;t be able to access Yahoo.

Please check your Workflow option isn't still set. This feature is redundant as PGO now recognises the difference between failed messages & a lock-out situation.

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on July 29, 2009, 08:22:16 PM
True!

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: mattylad on August 27, 2009, 10:30:33 AM
reboot your router.

If your on DHCP from your ISP you get a new IP and can continue.

(Upsets the kids though - they get kicked out of their games :D)
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on August 28, 2009, 09:08:26 PM
Doesn't work for me. My address is static but if yours is dynamically allocated, it may work.

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: thamoskuk9 on September 05, 2009, 03:53:42 AM
I found that in the group that I was DLing there were a fair number of deleted messages. What I think might be going on is this:

When you set PG Offline to download, say, 300 messages, it seems to keep downloading until it actually gets 300 valid messages -- meaning that any invalid/deleted message numbers don't count against the DL counter, and you wind up pounding Yahoo for that many extra times.

For example, I found that by subtracting the highest downloaded message in one "DL block" versus the highest from the previous block, there were actually more DL attempts (including nonexistent messages) than the DL limit said: with the DL limit set to 300, I had 328 and 322 DL attempts (and I was getting locked out), then with the limit reduced to 250, it was 277 and 261 (and I no longer got locked out).

For groups with lots of deleted or unavailable messages, this might be pushing Yahoo to cut us off sooner than it otherwise would? Worth a thought, anyway.

So for the record, my current settings are now 250 messages, with a 65-minute wait. I completed my 19,000 message group with these settings.

Pres
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on September 05, 2009, 12:21:36 PM
Hi,

Yes, you're right. It is mentioned in the introductory email which I send every registered user.

2) When you're doing a refresh or initial download of multiple groups & you get a group you can't read e.g because Yahoo has changed the group format or many messages are deleted, PGO tries to get the first of 30 messages. It then assumes that the message has been deleted & then tries to get the next message *in sequence* not the next 30th message. This happens until the end of the group is reached or you get locked out (after about 200 of these errors). If you set the Workflow option so that you stop after receiving 10 invalid messages you can at least avoid being locked out. In future you can set that Group to be skipped during Refreshes. 

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: Steeley on April 06, 2019, 05:34:54 AM
FWIW, I used PG Offline to archive a group that was being closed after 15 years - 96,000+ messages using the default settings ... in one swoop! It took 8 hours, but there were no stalls or lockouts. I don't know if Yahoo changed something or I just caught their limit counter sleeping, but it is what it is. 8)
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on April 06, 2019, 10:04:55 AM
The lockout is modified by how active your group is.

So on a busy group you might get 10k before being locked out,  on a very quiet group you might get 120k.

Cheers,

Wilson.

Title: Re: Yahoo d/l limit
Post by: Steeley on April 07, 2019, 12:16:59 AM
Quote from: Wilson Logan on April 06, 2019, 10:04:55 AM
The lockout is modified by how active your group is.

So on a busy group you might get 10k before being locked out,  on a very quiet group you might get 120k.

Cheers,

Wilson.

Ah, OK..  the group wasn't particularly active (a few messages a day - down from a few hundred - over the past couple years - mostly just from a user spamming it and being abusive and obstinate - the owner inherited it from his brother who passed away and didn't want to moderate or let anyone else and so the volume fell off dramatically - eventually the owner just closed it as I suggested).

Lots of good stuff in there earlier that I was glad PGO was able to retrieve before the lights were turned off.
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on April 10, 2019, 02:11:48 PM
It happens a lot.

Yahoo tends to attract umm... mortally challenged individuals (ie old folk) so its small wonder that group founders fall off their perches and don't leave any clear line of succession.

Not assisted in any way by Yahoo.

How hard would it be to have a facility to appoint a successor?  You just list an email address and if you fail to login within a month, he gets control.

Easy, peasy, fully automatic.

 
Title: Re: Yahoo d/l limit
Post by: Steeley on April 12, 2019, 06:04:43 AM
Well, in this case the original owner's relatively youthful age masked his mortality, and he did have moderators to carry on (of which I was one), but ownership passed to his older brother who was curator of all his other personal effects as well, a benevolent, but ambivalent sorta guy.

But what ultimately led to the demise of the group was a new member that was toxic and untrainable, that I ultimately banned, which generated a loud, long and persistent angst from a small cadre that dominated the traffic. Finally I just gave moderation to "Obstinate Prime" and bowed out. Turned out none of us (including him) recognized OP's mortal limitations either, and he followed the original owner into that long quiet sleep, but not before he let the guy I banned back in and OP at least came to appreciate why I banned the guy in the first place before suddenly and permanently retiring to HIS dirt bed (the guy wasn't hostile to MY authority as OP surmised, he was hostile to anyone's authority - All non-academic knowledge comes in suppository form).
Metaphysical question: If you're given an atomic wedgie at the moment of death, are you stuck with it for eternity? In this case, I hope so.
Alas, our nuvo-superhero of the new millennium - Toxic Man - was still a member and nobody who cared had access to the eject button. Thusly unfettered he blossomed into his full potential, and the writing, as they say, was written on the outhouse wall.

Rather than get into the middle of the circular firing squad the owner eventually just put it out of everybody's misery. The only one who posted vitriolic objection to the termination notice was Toxic Man. I'm still debating with myself whether to keep his last post as the inscription on the head stone when I republish the archive or scrub the group of evidence of his existence entirely from the final record which, given Yahoo's use of embedded reply chains makes decarboxylation of the metastasizing intellectual cancer anything but a trivial task. Thread and user sorting isn't discriminating enough - using those approaches, either a lot of babies would go out with the dirty bathwater, or a lot of bathwater remains stinking up the babies.
It's 96000 messages, remember? The only good thing I suppose is that only about the last half are potentially tainted.  :-\

Anyway the archive is supposed to display the accumulated and precious subject knowledge provided by the members, not an ugly case study of how to kill a discussion group. My debate is whether the hassle involved is greater than the pleasure derived. (I'll be severely chastised no matter what way I decide and I'm becoming weary of repeatedly falling on the sword of noble intent.)

So, some groups succumb to the owner's age or the fickle finger of fate sans wisely planned succession, some to mismanagement, some to neglect, and some to poisoning. This was a noxious combination of them all - hard to decide which to put down as the primary cause of death.

Quote from: Wilson Logan on April 10, 2019, 02:11:48 PM
It happens a lot.

Yahoo tends to attract umm... mortally challenged individuals (ie old folk) so its small wonder that group founders fall off their perches and don't leave any clear line of succession.

Not assisted in any way by Yahoo.

How hard would it be to have a facility to appoint a successor?  You just list an email address and if you fail to login within a month, he gets control.

Easy, peasy, fully automatic.


Title: Re: Yahoo d/l limit
Post by: Wilson Logan on April 19, 2019, 11:20:49 AM
Actually... Yahoo is pseudo threaded.


Each message has an individual message number.  Messages are atomic.

What joins them is the subject line.

That is, in & of itself, no guarantee of continuity as if you make a reply but change the subject line, the link is lost.


Truly threaded  forums (like Facebook) have separate Post and Comment types.

Comments cannot exist without their parent Post.

Title: Re: Yahoo d/l limit
Post by: Techsys on May 22, 2019, 05:06:16 PM
This may come as a surprise for some people so I'm sharing my experience.

Last evening, I downloaded all 19 years of our group data, which was 91,336 messages with numerous attachments (excluding "winmail.dat"), 330 MB of photos, 36 MB of other files and a handful of links for a total of about 750 MB of data. No hiccups, no lockouts, no invalid anything.

Before I suppose how this could happen under the supposedly-watchful eye of Yahoo staff, there is a backstory that should be known to anyone who hasn't heard.

In a Business Insider report dated January 8, 2019, Verizon CEO, Hans Vestberg, clearly stated that AOL and Yahoo business units must survive on their own merits. It is then curious that, since this report, zero posts in Groups have been indexed whatsoever and are not included in any "Search Conversations" results. Also, no statistics for any group have been updated since January 12 but most groups currently show January 5 as the last activity which, of course, simply isn't true or even possible. Therefore, I am convinced that Yahoo is dying a slow death. This prompted great concern in our group to secure our data.

I can only imagine that I was able to download, uninterrupted, for one of the following reasons: (a) sadly, no one is watching or cares, (b) automated systems are not being maintained and are failing or have completely failed, or (c) non-residential IP addresses aren't flagged for attention.

After hearing all the scary warnings about pulling too many posts at once, I specifically spun up a Windows 10 VM on Azure, thinking I could change the assigned IP address as necessary. So I pulled 6K messages, stopped for dinner (because I wanted to watch it closely) then came back and said "to heck with it" and let her rip. When I went past 16K and then 25K, I was pleasantly surprised. Everything was done about 4 hours later.

Many, many thanks to Mr. Logan for providing this impressive utility. I will absolutely be registering.

The Business Insider report link: https://www.businessinsider.com/verizon-ceo-hans-vestberg-yahoo-aol-business-2019-1 (https://www.businessinsider.com/verizon-ceo-hans-vestberg-yahoo-aol-business-2019-1)
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on May 23, 2019, 02:52:21 PM
Hi Jim,

That is some very interesting information.

Just as a caveat to that, I have been able to get 120,000+ posts from a single group in a single session.

The limit seems to be shared across the group. So, if your group is large, you get a large allowance.

The allowance is consumed by traffic to & from the group.

If the group is not heavily trafficked, a small number of people can have access to the total allowance.

TBF that is simply my guess at what is happening but it is based on nearly 20 years experience of downloading Yahoo groups.

Cheers,

Wilson.



Title: Re: Yahoo d/l limit
Post by: casstk on October 17, 2019, 08:36:55 PM
What workflow settings are being recommended currently?
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on October 17, 2019, 10:47:11 PM
To my knowledge the download limit has been switched off.

OR

Due to such light traffic in the groups, what we're doing may not be triggering limits.

I just DL'd a full 90k group in one go.

If you're pressed for time I would even recommend an instance of PGO per group.

DL them simultaneously.

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: casstk on October 18, 2019, 01:00:31 AM
A few mods are being locked out which is why I am asking.
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on October 18, 2019, 07:43:39 AM
Might be due to traffic then.

We know that the limit is in part related to how much activity a group has.

So there's like a group & individual limit which sum.

If no one else is using the group limit allowance then you, as an individual can hammer on.

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: Shellack on November 01, 2019, 04:15:50 PM
I downloaded ver 4.0.902 and am very impressed by the ease of use and the efficiency of the program. However, I am unable to download more than 1000 messages. If I try to I get a dialog asking me to register. I thought the software was unlimited during the trial period; did I misunderstand?
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on November 01, 2019, 08:38:16 PM
Yes.

It used to have a 14 day trial but that makes little sense in the face of a service that's closing.

The objective of a trial is to see if it works for you.

Allowing users to download all the data they want for 14 days is simply asking to be stiffed.

Before the YG closure announcement my conversion rate was 50%.

After, it was 3%.

So 47% of users who would have bought just decided they didn't have to.

So now it has a trial that reflects the new situation.

HTH,

Wilson Logan (PGO creator).



Title: Re: Yahoo d/l limit
Post by: Shellack on November 02, 2019, 01:37:20 PM
Thanks for the explanation. I guessed as much but I wanted to check, especially as I could find no mention on the website or this forum and the Registration help-page refers to a 30-day evaluation period...

Also, I found out about the program from another site where one Wilson Logan says "The software has become effectively free"!  ???
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on November 02, 2019, 02:00:03 PM
Well, within the context of PGO being supplied with a pre-downloaded archive file (which it was), it is free.

You can login to Yahoo, get your groups list and load them all from archive files.

You can then read, sort & search them using PGO for the rest of eternity.

Its just the download function that's not free.

If you have a group with 10,000 members, only one person has to do the download.

Everyone else gets it for free.

That's 99.99% free :)

Cheers,

Wilson.
Title: Re: Yahoo d/l limit
Post by: Shellack on November 04, 2019, 03:53:00 PM
OK I see (I think).

I’m pleased to say I was able over the weekend to download all 38,000 messages from a group in one go. It took several hours but there were no interruptions so it does seem there is no Yahoo d/l limit any longer.

The software is undeniably the business!
Title: Re: Yahoo d/l limit
Post by: Wilson Logan on November 04, 2019, 09:09:10 PM
I think its horses for courses. 

Some people get hit, some don't.

We've just been lucky!

Cheers,

Wilson.