Hi All,
There is a new test version:
http://www.personalgroupware.com/groupmanager/PGOffline-3-0-074.exe
The line break issue appears solved but this version reports timeouts on some groups that are actually OK. Another issue is that it reports some messages as missing when they aren't. We know these are issues and are working on them.
This version will allow you to get some of your groups in the correct format (hopefully!).
Cheers,
Wilson.
Looking Good! Ran a couple of test, reloading some unformated messages and find them much more readable.
For new users:
Determine what message you need to start from if you've been playing with the test dll Wilson sent out. Then right click on the Group name, select "Group Settings", then in the port for "Start Download from message #", put in the message number you want to start from.
Wilson, is there anything else we need to know? Is there any database management issues when you reload messages? Seems to be working great here.
THANKS !!!!!
Brad
Santa Fe, NM
Hi Wilson,
Sorry but here all my groups report time out, mostly CNC related groups
Cheers
Bengt
Works for me, although I have seen one or two 'Error in secure channel support' messages?
Latest version seems much faster, noticed this with the hot fix DLL.
No joy here,
Tried with authorisation skipped and set but same results.
Getting authorisation
confirmed
Total number of messages 1480 [ number to date ]
starting from 1230 [ last message on Mar 25th ]
PGO timed out needs to restart.
which it does and then sits there.
trying it again only does the same.
All my groups, private and public do this.
John s.
I downloaded the file today and replaced the original file with the new one. Some groups updated, some didn't, even though the status indicator seemed to indicate that new messages were begin downloaded for one of the groups that didn't really update. The latest message for those groups is back in March.
Two of the groups that didn't update are Zymurgy and Amateur-Repairs.
Donald
Update,
The timeout - restarting program occurs of specific messages for me, 1977 in AmateurRadioAntenna is one. If that's happening to you, you might try going into group settings and set it so it skips the message your hanging on. (Temp fix until Wilson can resolve the problem.)
One thing I've noticed is that the faceplate of the program is improved. My scroll bars on the right side don't blank out like they were doing. Thanks Wilson.
Brad
Santa Fe, NM
That doesn't seem to be happening here. It doesn't seem to get stuck, just none of the messages in those groups show up after it goes through the process of listing what it appears to be downloading. It then goes to the next group and gets those messages.
This is strange. I won't know if there are problems for a while here, but it appears that after I added several more of my groups to the list and started to update all of the groups in PGO, the missing messages in Amateur-repairs are there this time.
Donald
Well, most groups are working fine with PGO but growgrapes is returning "invalid page format."
Hope this helps. So far, most of the other groups that are downloading are OK. Something must be different about this one.
Hi Chaps,
Bad news.. between releasing the DLL and the new version (074) Yahoo have made a format change.
Some groups that worked with the DLL now don't work with 074. The regexs remained unchanged so it has to be the format.
I checked and it is.
The same guy that did the last set of regexs is now working on a more powerful set that might be able to handle all the formats currently being run. That would be quick as only the regexs need to change. If no one set of regexs can be made we'll need a code change as well. Bugger.
Cheers,
Wilson.
Update two.
Wilson,
I realize this is a test version, therefore I assume you would want to be informed of any problems. I'm seeing another problem, but will be brief because it's time to go to work.
What I'm seeing is some text with wrong headers, or messages from one person but the header info indicates it's from someone else. I've also seen the same text from two different persons, and one is obviously wrong.
Someone else may be able to explain it better.
Hey! We're getting there!
Brad
I tried out the 074 release using whatever was on the download site twenty minutes ago and downloaded several groups justlike the good old days, formatting looks great, and I assume the other functions aren't changed. I didn't look for or notice issues with headers.
Then ran into time-out problems where PG Offline restarts itself. It may be that I just need to wait a while before trying any more.
One quick comment, though, is that I would rather PG Offline not restart itself. In the current environment of on-demand scanning this exacts a price in CPU usage that doesn't always play well with other things that may be going on. Once I know what they are I can manage the demands on the CPU if the software lets me control the timing.
Of course, someday with 64 bit quad core processors and multi-GB RAM it's all moot.
Scott
Followup - waited 4 hours and the time-out repeats on that same group - QBPOS
It may be this is one that has a different format.
Other groups have downloaded OK even after that one timed out.
Scott
Followup - in some groups there is one message that hangs up. If I change settings so that message is skipped then it continues OK until another bad one comes up.
In one case, I logged into yahoo groups and searched for the specific message that hung up, and got a 'messagerecallfailure' alert. Apparently it was a group that was not yet migrated to the new system.
Patience may take care of that.
Scott
Any news ?
On the news front...
The sticking messages are caused by Yahoo randomly serving summary pages of data. PGO requests 30 messages at a time in expanded mode. Yahoo sometimes serves a page of just Subject headings.
Its odd because the pages that get served incorrectly are random in order but reproducable i.e. messages 34, 56, 78 and 89 may give errors but they'll do that every time.
We're going to check to see that the URL we request is not malformed but I think it can;t be or we'd get none of the 30 messages and we will try to request the problem messages as one page if the URL turns out to be good.
Cheers,
Wilson.
Any progress last week? I´m getting a bit frustrated as I have so many groups to follow up.
OK, it appears the URL is good but we are getting a mix of formats within individual groups. The bad thing is that the second format that is currently causing the 'message missing' errors is actually causing the parser to crash. To get technical, the parser is written in C++ and uses a library called Boost. Within this library are all the regular expression commands. The one we use most is regex_split but this command has been deprecated (ie is no longer supported). Because it is no longer supported we can't go to Boost and ask why the HTML we have crashes the command because they'll say "duh, its no longer supported, use the new command". So we're substituting the regex_split commands for regex_token_iterator but it doesn't work just like regex_split used to and there is a bit of work involved.
I shall write a separate post on why the heck this is taking so long.
Cheers,
Wilson.
In my work we are evaluating OCR and data population tools, and the ones that we are looking at are designed to read multiple variations on a central theme.
It sounds like the program logic isn't so much an issue as it is the actual coding.
Maybe one of these software houses has a module that could be used?
Copanion, SurePrep, ProSystemFX scan, just to name three.
Just a thought ....
Scott
Wilson,
I tried all my active groups and none came in. The ones that had no new messages did correctly tell me that. All of those that had new messages would time out and program rebooted.
One of my groups is set in Yahoo, Asia and it also did not work. I can get those messages to come through as POP directly into Thuderbird.
Since I am using a non-Yahoo user name for group messages I could just save all groups into their own folders for now until PGOffline is fixed. I know Thunderbird can save them and I am sure other email programs such as OE and Windows Mail can do that also so it could be an option for us all temporarily.
Downloaded and replaced the dll Wilson put on a different post. Don't have post # to give.
I could then download all groups successfully. It looked like PGOffline was crashing after each download had completed, though.
Re-registered using C:\Windows\System32\regsvr32 MSCOMCTL.OCX from command prompt windows run as Admin.
Was also having problems compacting.
Maybe Vista was lazy or maybe PGOffline. I can now compact. I did not do anything else on the computer while it was compacting, though.
Since all downloads are already brought in I cannot tell if program is still crashing after it completes. Will have new ones to pick up tomorrow so can tell more then.
Thanks for posting that dll. It did the trick along with new test program. Not sure if dll alone would have worked. I would have tested that if I had seen the dll first.
Mary
Hi Mary,
There's an even newer DLL I want everyone to try.
I'm going to post a new message in a second with instructions.
http://www.personalgroupware.com/smf/index.php?topic=719.0
Cheers,
Wilson.