Page Index Toggle Pages: 1
Topic Tools
Normal Topic rebuild message index (Read 3,281 times)
Corey Chapman
YaBB Administrator
*****
Offline



Posts: 10,026
Location: Rock Hill, South Carolina

None
rebuild message index
Jan 6th, 2008 at 3:43pm
Post Tools
I clicked to rebuild the message index.  It didn't load any different pages - I was still seeing the main Admin Center page.

The browser status bar slowly moved and said waiting.  Eventually (checking in a different window), the auto-maintenance mode message dissappeared.  However, the window that I ran rebuild in is still showing loading, but no new page.

I have no evidence that it did anything, and it appears that it's still working even though the forum is back up out of maintenance mode.  I thought at one point we split this into multiple steps?
  

Back to top
IP Logged
 
Unilat
Development Team
Theme Team
****
Offline



Posts: 1,047
Location: Columbus Ohio, USA
Re: rebuild message index
Reply #1 - Mar 28th, 2008 at 1:36pm
Post Tools
The recount board totals is split into multiple steps but you are right in that the message total rebuild is not.
  
Back to top
 
IP Logged
 
deti
Legacy Dev Team
Development Team
****
Offline



Posts: 2,650
Location: Prien am Chiemsee, Germany
Re: rebuild message index
Reply #2 - May 24th, 2008 at 7:45pm
Post Tools
I looked at the sub RebuildMessageIndex in Admin.pl and I think this is not a bug.

As the code has to run through ALL threads (!!!) this rebuild will take a long time in big forums. I think that the problem must have been a server-browser problem. The code took a very long time so that the conection was lost somewhere. You did not get the output any more.
The process was terminated, otherwise the mantainance mode could not been off at the end.

Due to the structure of the actual YaBB-Messages-files it is not possible to split the process like in recount board totals.
  

Was immer Du tun kannst
oder erträumst tun zu können,
beginne es.
Kühnheit besitzt Genie,
Macht und magische Kraft.
Beginne es jetzt.
Whatever you can do
or dream you can,
begin it.
Boldness has genius,
power and magic in it.
Begin it now.
J. W. Goethe
Back to top
WWW  
IP Logged
 
Daniel Tolouei
Past Team Members
Offline



Posts: 129
Location: Brazil
Re: rebuild message index
Reply #3 - May 25th, 2008 at 1:59am
Post Tools
I have this problem too..

the browser timeout.. but perl still working and rebuilding...

The only problem is the browser timeout, but the routine is executed fine, because perl process dont stop when http server timeout to client browser ...

Maybe the solution is advice the admin if this problem occur, dont try to click again in this routine, but wait to process terminate. Or its a good ideia when the routine starts, create a file to lock this routine if user click again to execute this routine without wait to stop the first istance...

  

YaBB - The Best!
Back to top
 
IP Logged
 
deti
Legacy Dev Team
Development Team
****
Offline



Posts: 2,650
Location: Prien am Chiemsee, Germany
Re: rebuild message index
Reply #4 - May 25th, 2008 at 10:02am
Post Tools
Daniel Tolouei wrote on May 25th, 2008 at 1:59am:
I have this problem too..

...

Maybe the solution is advice the admin if this problem occur, dont try to click again in this routine, but wait to process terminate. Or its a good ideia when the routine starts, create a file to lock this routine if user click again to execute this routine without wait to stop the first istance...

@ tolouei
Could you please do a test for me:
Click on Rebuild Message Index and just after this on Return to Admin Center on top of page.
Look at the maintenance info. Is it there? Click on Return to Admin Center all 5 seconds. Until the maintenance info desapears.

Then report me:
Did the maintenance info be at place after first cklick on Return to Admin Center?
Did the maintenance info desapear after some time?
How often did you click on the Return to Admin Center link?

I am thinking about an JavaScript alert before starting Rebuild Message Index to advice the admin to do what you have done and proceed with other modifications only after the maintenance info desapeard. An advice like this:

"If you do not get an answer of the 'Rebuild Message Index' maintenance routine in a reasonable time, then click on 'Return to Admin Center' on the top of this page and look for the yellow maintenance info on left side. Click on this link every 10-30 Seconds until the maintenance info desapears before you proceed doing something in the admin center. It can take a long time (several minutes) until all threads has run through the rebuild code!"
« Last Edit: May 25th, 2008 at 10:06am by deti »  

Was immer Du tun kannst
oder erträumst tun zu können,
beginne es.
Kühnheit besitzt Genie,
Macht und magische Kraft.
Beginne es jetzt.
Whatever you can do
or dream you can,
begin it.
Boldness has genius,
power and magic in it.
Begin it now.
J. W. Goethe
Back to top
WWW  
IP Logged
 
deti
Legacy Dev Team
Development Team
****
Offline



Posts: 2,650
Location: Prien am Chiemsee, Germany
Re: rebuild message index
Reply #5 - Jun 22nd, 2008 at 2:56pm
Post Tools
I did find a way to rebuild the message index also with xx-large forums. Now the rebuilding is devided in steps of 30 seconds before going back to browser, than the browser calls the script automaticly again and the rebuilding continues. (Like converting xx-large forums.)

Tested several times with moyamoya's (DJ) forum:
35
Boards
42.886
Threads
595.992
Messages

Time to rebuilt the message index: 57 minutes!

Many thanks to moyamoya, who give me access to his huge forum!!!

--------------------------------

Doing this work I created a new subroutine in Attachments.pl to remove attachments that is now used by other scripts too: Attachments.pl, RemoveOldTopics.pl and RemoveTopics.pl

--------------------------------

Further more I noticed the following:

Removing old Threads on xx-large forums we also run into browser or server timeout. The problems that can happen are:
- Threads look like they are deleted but their attachments are not.
- Some files are deleted and on server timeout the rest of the boardfile is lost. Then all lost Threads off this file are still on the server but there is no info about their existens. Running "rebuild the message index" does put this unknown Threads into bin-board. If you have one, if not they will be removed forever.

So if you had the problem of server time out while removing old threads allready, than run "Rebuild Message Index" again and after that the new "Remove Old Threads" of this fix followed by "Remove Attachments older than..." in the "Attachment Functions".

Also tested with moyamoya's forum!
Many thanks again to moyamoya, who give me access to his huge forum!!!

------------------------------

More fixes:
- When maintenance was set to 'on' manualy and then a routine with automaintenance('off') at the end was called, the maintenance-alert was not displayed. Only again after next click on some link.
- Various date/time and code emprovements.
- Code deletet that causes browser/server run into timeout with xx-large forums.
- Code reduction due to a subroutine in other script that is used instead.
- Language additons for display of loops while executing some of the 'Maintenance Controls' with xx-large forums.
- Speech correction.
- Maintenance is now 'on' while recounting memberships.
- Code/speed emprovments in Board recount.
- Comented out or deleted some subroutines that are obviously unsused.
- Code/speed emprovments in Rebuild Member History.
- Rebuild Member History did not do what it should due to wrong filehandle: open TOPICREST - print TOPIC-  close TOPICREST
- Code/speed emprovments in Rebuild Member List.
- Maintenance is now 'on' while Delete Multi Members is running
- deleted unused code.
- general code emprovments.
- Remove Old Attachments works now also with xx-large forums.
- Remove Big Attachments works now also with xx-large forums.
- Shorten code of Delete Attachments.
- Rebuild Attachments works now also with xx-large forums.
- New subroutine to delete attachments used by some other scripts.

------------------------------

All in all new:
- AdminIndex.pl, YaBB.pl
- Subs.pl, System.pl, RemoveTopics.pl
- Admin.lng, FA.lng
- Admin.pl, AdminEdit.pl, Attachments.pl, NewSettings.pl, RemoveOldTopics.pl, Settings_Maintenance.pl

in CVS
« Last Edit: Jun 22nd, 2008 at 4:44pm by deti »  

Was immer Du tun kannst
oder erträumst tun zu können,
beginne es.
Kühnheit besitzt Genie,
Macht und magische Kraft.
Beginne es jetzt.
Whatever you can do
or dream you can,
begin it.
Boldness has genius,
power and magic in it.
Begin it now.
J. W. Goethe
Back to top
WWW  
IP Logged
 
tompocz
Junior Member
**
Offline



Posts: 82
Location: Adelaide South Australia

None
Re: rebuild message index
Reply #6 - Jun 29th, 2008 at 10:06am
Post Tools
great to see bug fixes occuring.
However, do these fixes apply to YaBB 2.2.2 ?
I just upgraded to 2.2.2 and have noticed such anomalies.
Would be interested to know the above so as to use CVS and update my 2.2.2
Await your reply in anticipation
Ta
Tom
  
Back to top
WWW  
IP Logged
 
deti
Legacy Dev Team
Development Team
****
Offline



Posts: 2,650
Location: Prien am Chiemsee, Germany
Re: rebuild message index
Reply #7 - Jun 29th, 2008 at 2:25pm
Post Tools
Yes, they apply to 2.2.2

CVS you find here http://yabb.cvs.sourceforge.net/yabb/YaBB2/.

Have in mind that CVS is allways experimental! Some fixed problems may have produced others Wink
« Last Edit: Jun 29th, 2008 at 2:29pm by deti »  

Was immer Du tun kannst
oder erträumst tun zu können,
beginne es.
Kühnheit besitzt Genie,
Macht und magische Kraft.
Beginne es jetzt.
Whatever you can do
or dream you can,
begin it.
Boldness has genius,
power and magic in it.
Begin it now.
J. W. Goethe
Back to top
WWW  
IP Logged
 
Page Index Toggle Pages: 1
Topic Tools
 
  « Board Index ‹ Board  ^Top