By Rik Brown on Tuesday, 22 April 2014
Posted in General Issues
Replies 18
Likes 0
Views 1.8K
Votes 0
1) I'm running the vBulletin migrator right now. After the categories have been created, it says that we have 380,538 total posts. However, on our vBulletin system, we have 792.000+ posts. Should I be concerned?

2) If the migrator aborts during this process, do I just start if over or will that create dupe posts?

3) If I do need to restart, which tables do I need to truncate to remove all posts?

4) Is there a php file that one can run from directly from the server (i.e. ssh) to do the entire migration process [In case we need to restart it]?

Thanks. -- Rik
Hi Rik,

I am really sorry for the delay of this reply. But good news is, I managed to complete the migration ( based on your db ) in within 3 hours and migrated about 790++k records. ( with 126++k thread migrated. )

Attached is the updated script for EasyDiscuss VB migrator. Please download these files and copy 'default_vbulletin_1.php' into folder 'JOOMLA/administrator/components/com_easydiscuss/views/migrators/tmpl/', copy 'view.ajax.php' into folder 'JOOMLA/administrator/components/com_easydiscuss/views/migrators/'.

Now you will need to execute below sql so that you can re-run the VB migration.


delete from `jos_discuss_migrators` where `component` = 'vBulletin' and `type` = 'post';

truncate table `jos_discuss_posts`;


Remember to replace jos_ to your Joomla table prefix.
Also, I advise you to do a full backup of your site incase something expected happen so that you still can revert back your site to it original state

Hope this help
Sam
·
Wednesday, 21 May 2014 18:21
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Rik,

I am sorry for the delay of this reply.

1) I'm running the vBulletin migrator right now. After the categories have been created, it says that we have 380,538 total posts. However, on our vBulletin system, we have 792.000+ posts. Should I be concerned?


Can you tell me where you are seeing this number? From the migrator ( after you finished the migration process ) or you run a sql count statement from db? if you are seeing this number from the migrator, then it is reporting the number of thread count and not the total number of posts. Can i assume your 792,000 posts are including the thread and its replies? Please advise.

2) If the migrator aborts during this process, do I just start if over or will that create dupe posts?


If you re-run the migrator, all the migrated items will not be migrated again

3) If I do need to restart, which tables do I need to truncate to remove all posts?


If you need to re-run the migration process again, then you will need to clear these tables from your db.

jos_discuss_category
jos_discuss_posts
jos_discuss_migrators

4) Is there a php file that one can run from directly from the server (i.e. ssh) to do the entire migration process [In case we need to restart it]?


I am sorry but currently the migrator run multiple ajax requests to perform the migration to prevent connection / execution timeout issue. So running directly the php is not possible at the moment

Hope this help and have a nice day
Sam
·
Tuesday, 22 April 2014 16:54
·
0 Likes
·
0 Votes
·
0 Comments
·
Sam:

Thank you for your reply.

Can you tell me where you are seeing this number? From the migrator ( after you finished the migration process ) or you run a sql count statement from db? if you are seeing this number from the migrator, then it is reporting the number of thread count and not the total number of posts. Can i assume your 792,000 posts are including the thread and its replies? Please advise.

Right after the migrator creates the categories, it shows:

Category migration completed
Total posts found: 380735

If I query the database as follows:

select count(*) from vb4_post;
select count(*) from vb4_thread;

... I get the following numbers:

vb4_post = 791,982
vb4_thread = 126,264

So there appears to be a problem. How to proceed?

Thanks. -- Rik
·
Tuesday, 22 April 2014 17:16
·
0 Likes
·
0 Votes
·
0 Comments
·
Any ideas on this or should I give up attempting the vBulletin migration?
·
Thursday, 24 April 2014 01:29
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello Rik,

I am very sorry for the delay of this reply.

Can you pass me your Joomla backend admin access and your ftp account so that I can investigate your issue further?
Please advise.
Sam
·
Thursday, 24 April 2014 18:19
·
0 Likes
·
0 Votes
·
0 Comments
·
Sam:

Will do.

Thanks. -- Rik
·
Friday, 25 April 2014 09:20
·
0 Likes
·
0 Votes
·
0 Comments
·
Any further word on this?

Thanks. -- Rik
·
Monday, 28 April 2014 04:03
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Rik,

I am very sorry for the delay of this reply.

Regarding your issue, it seems like your previous migration did not complete
I am re-running the migration and now the migrator is migrating the other 360133 posts.

Will update you again once the migration completed

Hope this help and have a nice day
Sam
·
Monday, 28 April 2014 14:05
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Rik,

I am sorry for the late reply.

I am sorry but today during the migration process, our internet connection got interrupted and causing the process halted I only managed to migrate hundred of posts Can you please try to run again the migration and see if all working correctly? The migration process might take some time so you might want to leave yur PC on until the process has completed

Please advise.

Hope this help and have a nice day
Sam
·
Monday, 28 April 2014 16:46
·
0 Likes
·
0 Votes
·
0 Comments
·
Sam:

I'm still running the migration (several weeks now). Right now, jos_discuss_posts shows 383,541 lines.

1) I'm still worried, as mentioned in my first post of this discussion, whether or not all 792.000+ vBulletin posts will be migrated. Should I worry?
2) I'm finding that many of the EasyDiscuss discussions/threads being created are broken into separate discussions with the same name and not all merged into a single discussion/thread. I hope that at the end of the migration that such threads in each category will be merged? Or is that a problem?

Thanks. -- Rik

PS: I purchased EasyDiscuss on April 21, 2014, so we are running out of time on our 30-day trial period.
·
Wednesday, 07 May 2014 08:45
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello Rik,

I am sorry for the delay of this reply.

I'm still running the migration (several weeks now).


Em strange, the migration shouldn't take this long

1) I'm still worried, as mentioned in my first post of this discussion, whether or not all 792.000+ vBulletin posts will be migrated. Should I worry?


If i recall correctly, the VB migrator only detected about 380,000 entries ( not including the replies ) to be migrated as topic. May i know this 792,000 is a sum of topic + replies?


2) I'm finding that many of the EasyDiscuss discussions/threads being created are broken into separate discussions with the same name and not all merged into a single discussion/thread. I hope that at the end of the migration that such threads in each category will be merged? Or is that a problem?


Can you paste me the links of the original thread from your VB and also the links from the migrated item in your EasyDiscuss so that I can compare how the data should display?

Please advise.
Sam
·
Wednesday, 07 May 2014 19:59
·
0 Likes
·
0 Votes
·
0 Comments
·
If i recall correctly, the VB migrator only detected about 380,000 entries ( not including the replies ) to be migrated as topic. May i know this 792,000 is a sum of topic + replies?


The vBulletin table numbers are:

vb4_post = 791,982
vb4_thread = 126,264

As of this moment, our EasyDiscuss numbers are:

jos_discuss_posts - 443,614
jos_discuss_migrators - 444,047

Can you paste me the links of the original thread from your VB and also the links from the migrated item in your EasyDiscuss so that I can compare how the data should display?


Our EasyDiscuss forums are not online (public) yet. But if you use the login credentials provided in this message, you can look at any forum and see that threads/discussions with the same title are broken into separate threads/discussions in most every forum.

Am I wasting time by continuing with the migration? Will those divided threads/discussions be reunited or merged at the end of the migration process?

Thanks, -- Rik
·
Friday, 09 May 2014 12:26
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Rik,

I am sorry for the delay of this reply.

Is the migration still running? If yes, then maybe you can stop the migration process for now. This is not suppose to happen. It just too long for the migration to complete Do you think if you can export your vb db tables and send me the dump file? if the file is too huge, then maybe you can put the file somewhere in your server and I will ftp to your site to retrieve.

Currently when I run the below sql to check the topic imported into ED, the figure is '69716' topics and post is '375941'.

I will try to run the migration from my local if you provide me your db tables and I will check where is going wrong during the migration.

I am truly sorry for any inconvenience that may have caused to you and thank you for your patience and your understanding

Do not worry about the trial period. Due to this migration issue, if there is a need, I can extend the trial period for you

Hope this help and have a nice day
Sam
·
Friday, 09 May 2014 16:56
·
0 Likes
·
0 Votes
·
0 Comments
·
Sam:

Thank you for your reply.

Do you think if you can export your vb db tables and send me the dump file? if the file is too huge, then maybe you can put the file somewhere in your server and I will ftp to your site to retrieve.


I'll leave the FTP login details and dump file name in the "Site Details" part of this message.

Thanks. -- Rik
·
Tuesday, 13 May 2014 09:39
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello Rik,

Thanks for the DB sql dump file. I've downloaded the file. Please allow me to take 1 to 2 working days to work the migration
Have a nice day and wish you a wonderful weekend
Sam
·
Friday, 16 May 2014 19:26
·
0 Likes
·
0 Votes
·
0 Comments
·
Sam:

It has been about 4 days now. Any word on this?

Thanks -- Rik
·
Wednesday, 21 May 2014 01:19
·
0 Likes
·
0 Votes
·
0 Comments
·
Sam:

Yes, that worked! Thanks. -- Rik
·
Thursday, 22 May 2014 12:22
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Rik,

You are welcome. Glad to hear your issue now resolved
Have a nice day!
Sam
·
Thursday, 22 May 2014 15:53
·
0 Likes
·
0 Votes
·
0 Comments
·
View Full Post