Page Index Toggle Pages: [1] 2 3 4
Topic Tools
Very Hot Topic (More than 25 Replies) Post convert/upgrade (Read 1,040 times)
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #52 - Jun 5th, 2014 at 8:48pm
Post Tools
Luckily, YaBB is extremely portable - I do a lot of testing and configuring on my home server and I can ftp an entire forum onto a host server and just edit Paths.pm to get it running in its new home.  Wink
  

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
RonS2
Senior Member
Beta Testers
****
Offline



Posts: 519

YaBB 2.5.2
Re: Post convert/upgrade
Reply #51 - Jun 5th, 2014 at 8:29pm
Post Tools
Thanks D
  
Back to top
 
IP Logged
 
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #50 - Jun 5th, 2014 at 7:29pm
Post Tools
The one thing about the converter I've noticed - it doesn't work well when you've modified the templates first.  Roll Eyes

So if you want to clean up an existing 2.6.0 forum because you simply copied your old data over to it, back it up, run the converter as though you were upgrading an old forum to a brand new 2.6.0 install, then put your mods and template changes back in from your backup. (I did put in a check to make sure it would find and move Settings.pm if it was there.)

I figure that only forums that either had previous problems or have been upgraded multiple times with users that never logged in after one of the upgrades, will have a serious orphaned file problem. (I know that's true of YaBBForum here.)

YaBBForum took about 45 minutes for the converter to run on my home server.

« Last Edit: Jun 5th, 2014 at 7:32pm by Dandello »  

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
RonS2
Senior Member
Beta Testers
****
Offline



Posts: 519

YaBB 2.5.2
Re: Post convert/upgrade
Reply #49 - Jun 5th, 2014 at 6:54pm
Post Tools
My forum has been around awhile, since YaBB 1.? and I know there are orphan files so this is a great addition.

This might make a nice mod to clean things up.

Thanks D
« Last Edit: Jun 5th, 2014 at 6:55pm by RonS2 »  
Back to top
 
IP Logged
 
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #48 - Jun 5th, 2014 at 6:10pm
Post Tools
Convert2x.pl in the newest SVN.

It requires the old forum be on the same server account (so YaBB can access it) or the old Members, Messages, Boards, Variables be copied into the Convert directory in the new copy of YaBB.

The converter compiles and reads the lists of valid message IDs, valid Board IDs and valid User IDs and copies them (and their associated files )  to their new homes.

So again, if your old Forum is busted, running the converter won't fix it. But if your old forum is working fine or stopped working because of an upgrade to Perl (possible on old forums), this will move the files for you while keeping the originals intact.

We went to this system because at some point in the near future, YaBB is going to need to run all the message and user files through a UTF-8 converter and it will be best to do while upgrading.

  

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
RonS2
Senior Member
Beta Testers
****
Offline



Posts: 519

YaBB 2.5.2
Re: Post convert/upgrade
Reply #47 - Jun 5th, 2014 at 4:58pm
Post Tools
Great news, will this feature be added to 2.6?
  
Back to top
 
IP Logged
 
Xonder
Senior Member
Beta Testers
****
Offline



Posts: 717
Location: @ustria

YaBB 2.6.0
Re: Post convert/upgrade
Reply #46 - Jun 4th, 2014 at 2:34am
Post Tools
Hello

aaron360 wrote on Jun 4th, 2014 at 2:07am:
Tried it aaaaaaaaaaaaaandd IT WORKED!

Thanks a lot Dandello!  Cheesy Cheesy Cheesy Cheesy

Smiley Smiley Smiley
  

Back to top
WWW  
IP Logged
 
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #45 - Jun 4th, 2014 at 2:10am
Post Tools
Well, YaBBForum has over 110,000 files in both the Members and Messages directories (Figure at minimum 2 files [a vars and a msg] for every member and 2 files [txt and ctb] for every thread.) So if you're at 19% and things are ticking over correctly, you should (keeping fingers crossed) be okay.

Edited:
One of the things the converter does is goes down the members list and only transfers the files that have a valid user.vars file associated with them. So no orphaned files there. For messages it creates a list of Boards and Subboards, gets the thread IDs from the Board and only transfers the files associated with those IDs. What I've noticed is that Forums that have been repeatedly upgraded sometimes have leftover deprecated files from previous versions.
« Last Edit: Jun 4th, 2014 at 2:16am by Dandello »  

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
aaron360
YaBB Newcomer
*
Offline



Posts: 34

None
Re: Post convert/upgrade
Reply #44 - Jun 4th, 2014 at 2:07am
Post Tools
Tried it aaaaaaaaaaaaaandd IT WORKED!

Thanks a lot Dandello!  Cheesy Cheesy Cheesy Cheesy

one thing i noticed is that the new site's messages and members folder reports less space taken.
  
Back to top
 
IP Logged
 
aaron360
YaBB Newcomer
*
Offline



Posts: 34

None
Re: Post convert/upgrade
Reply #43 - Jun 4th, 2014 at 1:10am
Post Tools
my fingers are crossed now, doing a convert and it is at 19% for the 18,000 members  Cheesy


with this, i assume that the new site will surely have no orphaned files, looking forward on the messages folder getting cleaned up  Smiley

now I just need to cleanup these 18,000 members....
  
Back to top
 
IP Logged
 
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #42 - Jun 3rd, 2014 at 7:27pm
Post Tools
Just got a successful (Keeping fingers crossed) test in moving lots of files using the 2x converter.

There's one potential spot right at the beginning when it's preparing the Member and Messages folders where there's a possibility of a timeout (It's also transferring some potentially large files in that section as well.)

BTW, even YaBBForum here doesn't have enough boards to trigger the timed refresh in that section.  Huh So that has not been thoroughly tested yet.
  

Convert2x_beta002.zip ( 12 KB | 2 Downloads )

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #41 - Jun 3rd, 2014 at 6:59pm
Post Tools
Cleaning out the Recycle bin should have removed all the extra files from ./Messages. (ctb and mail).

But nearly all of those will be tiny (just a few kb.)
  

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
aaron360
YaBB Newcomer
*
Offline



Posts: 34

None
Re: Post convert/upgrade
Reply #40 - Jun 3rd, 2014 at 5:49pm
Post Tools
Dandello wrote on Jun 3rd, 2014 at 2:04pm:
make sure there are no orphaned .ctb and .mail files


Hi Dandello, just wondering, how would I know if a .ctb / .mail file is orphaned? it does not exist in an index file? considering the amount of data i have, do we have an existing script that could do that for us?

Thanks!
  
Back to top
 
IP Logged
 
Dandello
YaBB Administrator
YaBB Next Team
Operations Team
Beta Testers
Support Team
*****
Offline



Posts: 2,200
Location: Earth

YaBB 2.6.0
Re: Post convert/upgrade
Reply #39 - Jun 3rd, 2014 at 2:04pm
Post Tools
Look in the messages folder and make sure there are no orphaned .ctb and .mail files

Also, ask your hosting support about how the cPanel filemanager reports space used.

I'm still working on the converter - it takes at least an hour to run a test so it's slow going.
  

If you only have one solution to a problem you're not trying hard enough!
Back to top
WWW  
IP Logged
 
aaron360
YaBB Newcomer
*
Offline



Posts: 34

None
Re: Post convert/upgrade
Reply #38 - Jun 3rd, 2014 at 7:28am
Post Tools
Noticed something when we deleted items in trash (consists of 1/2 of the total data before), the file manager in cpanel still shows the same size as if no thread was deleted. (still stuck at 4.21MB) is it just with the file manager or are there still files in this messages folder that should be deleted?  Huh
« Last Edit: Jun 3rd, 2014 at 7:54am by aaron360 »  
Back to top
 
IP Logged
 
Page Index Toggle Pages: [1] 2 3 4
Topic Tools
 
  « Board Index ‹ Board  ^Top