New Developer

[martin_lists]

Just tried a different group, and a multi-group download, with a weird result: the different group started downloading fine in batches of 25 messages; the second one gave me the "Object reference" error msg.  I managed to catch both in the one screenshot:

[Wilson Logan]

Hi Martin,

That's interesting...

The phantomjs does a login but doesn't identify itself. Maybe Yahoo defaults the location to USA.

Having said that, I'm in the UK and I don't have the issue you're seeing although a user in the US is seeing the same thing as you.

Ihor (the new developer) has let me know about a very useful utility called Fiddler.

Basically it intercepts the traffic between your PC & the outside world.

Looking at its output should tell us at what point PGO is getting hung up.

Have a look at the attached screenshot of Fiddler from my PGO run.

I start Fiddler then I start PGO.

In PGO, I select my group (EDMHomeBuilders) and I press Start.

I switch back to Fiddler and I can see the requests PGO makes & the responses it receives.

If you can do the same we can see where PGO gets into bother.

The Fiddler application can be downloaded here:

http://www.telerik.com/fiddler


Cheers,

Wilson.

[Basil]

Thanks for the new build. Occasionaly I have the start up hang. I sometimes have to close PG Offline with Task Manager when this occurs. OS is Win7 64 bit. When it does connect it downloads slowly for a while. I have loaded a new group and it's MASSIVE with messages back to 2003 Only up to 2011 and message count is over 40,000 already. Twice PG Offline has stopped and an error message saying Yahoo has blocked connections from my ISP. I hope I am not causing some great trauma? ;)


Is there a database size limit?

As an aside, I ran the current build without seeing the do not use Refresh button post. Nothing drastic seems to have happened. I don't fully understand the possible consequences of using Refresh in this build....

Can databases be exported as normal text files for storage on media such as DVD? What's the best way to do this please?

Many thanks to you and your Russian colleague for your perseverance.

[Patch]

Our plan is to prove the concept by replacing the HTTP requests for login & message download first & build a test release.

File is here:

www.personalgroupware.com/groupmanager/pg-offline-4-0-821.zip

Thanks for the update Wilson & Ihor.
Back to full functionality for me. Downloads did stop at about 8000 messages on 2 groups I was downloading simultaneously. Restarting the downloads worked well, continuing on from where it stopped then downloaded over 25000 messages without any problems from the larger group.

Success rate with attachments was similar to previously. Less than half the larger pictures download but other file types appear to work much more reliably.

Your efforts are really appreciated.

Can databases be exported as normal text files for storage on media such as DVD? What's the best way to do this please?

Do these threads help?
Export from PG Offline http://www.personalgroupware.com/smf/index.php?topic=991.0
Export from SQLite  http://www.personalgroupware.com/smf/index.php?topic=1000.0

[Wilson Logan]

Hi Basil,

You WILL get locked out by Yahoo if you download <a certain amount> of messages in <a certain amount of time>

Only Yahoo know what these actual limits are but you will be locked out sooner or later.

You just have to wait <a certain amount of time>  and you will get back on.

BTW yes there is a database size limit... 1.7 Tb.

Cheers,

Wilson.

[Wilson Logan]

Regarding Exporting data... it was a feature of PGO but is currently under repair.

I will ask Ihor when he looks at it to implement the long requested 'Export to RTF / CSV / WORD', etc.

Cheers,

Wilson.

[Basil]

Thanks Patch, and thanks Wilson, I will try the double selection once PG Offline has finished its chores, don't want to upset it right now, it's trundling along nicely, and Yahoo are being generous with my demands :)

[Wilson Logan]

My double selection seems to have got upset with me BUT I was able to open a second instance of PGO and download an entirely different group at the same time as I am downloading from the first PGO instance, so you could do it that way.
If simply starting a new download from within the same PGO instance fails.

Cheers,

Wilson.

[martin_lists]

I'll have a go at this - thanks.  In the meantime, I tried a different approach with my "problem group" after last posting.  I have a second, admin login to that particular group so used that with PGO and it accessed and updated the group instantly.  No idea why the one valid login should work and the other not!

Hi Martin,

That's interesting...

The phantomjs does a login but doesn't identify itself. Maybe Yahoo defaults the location to USA.

Having said that, I'm in the UK and I don't have the issue you're seeing although a user in the US is seeing the same thing as you.

Ihor (the new developer) has let me know about a very useful utility called Fiddler.

Basically it intercepts the traffic between your PC & the outside world.

Looking at its output should tell us at what point PGO is getting hung up.

Have a look at the attached screenshot of Fiddler from my PGO run.

I start Fiddler then I start PGO.

In PGO, I select my group (EDMHomeBuilders) and I press Start.

I switch back to Fiddler and I can see the requests PGO makes & the responses it receives.

If you can do the same we can see where PGO gets into bother.

The Fiddler application can be downloaded here:

http://www.telerik.com/fiddler


Cheers,

Wilson.

[Wilson Logan]

Hi Martin,

Double check the first login you used.

Also check that the Group Login is what you expect.

The Master Login and the Group Login are not necessarily the same.

Right click on the group name in the group pane on the left and choose Group Settings--> Download Settings to check the Group Logon

Cheers,

Wilson.

[martin_lists]

They were correct - the same settings would have been needed for the group that was successfully downloaded with the first login.  I changed both when I switched to the Siddeley admin login.  I've just put them both back and the program has hung again.  At least if I stick with the admin login I'm OK for that one group, which is my main concern.

Hi Martin,

Double check the first login you used.

Also check that the Group Login is what you expect.

The Master Login and the Group Login are not necessarily the same.

Right click on the group name in the group pane on the left and choose Group Settings--> Download Settings to check the Group Logon

Cheers,

Wilson.

[Wilson Logan]

Interesting...

I was downloading a different group and I stopped that & I just tried to download Siddeley and I got the 'Object Reference' error.

I stopped PGO, restarted it and now I can download Siddeley.

?

Wilson.

[martin_lists]

Odd that you're getting intermittent results with the Siddeley group too.  I terminated the last "hung" session, uninstalled PGO, reinstalled, started off again with my normal login to download both Siddeley and the tyneside_northumberland group that normally works fine ... and this time it has just sat for six hours reading "logging in" for both groups with no further action.

Since I really only need to use PGO for the Siddeley group I'll just stick with the admin login from here and fingers crossed all will be fine.

[Wilson Logan]

Weird....

[martin_lists]

Just an update - with my admin login, the Siddeley group is happily updating automatically every two hours now.  Perfect!

Martin
NZ