[Urgent] Internal Server Error After Upgrade + Lots of DB Queries
By Shahryar Barani on Wednesday, 29 July 2015
Posted in Technical Issues
Replies 20
Likes 0
Views 1.8K
Votes 0
Dear Sir/Madam,

About one years ago we migrate from JComments to Komento and all things went smoot. About last months ago we got a ticker from our host server that your usuage is so high ( We used about 20GB of RAM and lots of CPU from a great quad core CPU ).

We debug many sections of website and optimized lots of them, also planned to upgrade Komento from 1.8.3 to the latest version because of better options in modules and also komento 1.8.3 used lots of queries.

For example in this page:

http://www.shahrsakhtafzar.com/fa/review/memory/4534-g-skill-ripjawsx-f3-2400c11d-16gxm-full-review

Without komento, It used 82 queries but with komento it increased to 390 queries with lots of memories that consume our money and server resources. Obviously about ~300 more queries is not something optimized and consume lots of server resources in term of db.

So, Last night we upgrade to the latest version to hope these problem will be solved but unfortunately we got high server load + Lots of Internal Server Error. We thought it should be the not updated database problem so we used your "Update database (Populate Depth)" but on ~200 comments from all of our 2180 articles we get "Error" and it doesn't update anymore.

We tried lots of time but it get the error again.

We really don't know what cause the problem, I read your policies and update our site details + describe all of our problems in details ( Hopefully I did ! ).

Also, need to mention we're a live website with lots of visitors every day, I disabled Komento this noon and Internal Server Error is solved but we cannot stay without comment system.

If It needed to reinstall all the component and modules and plugins for a fresh install to the latest versions, Please kindly do it for us ( But Comments should not be deleted ).

Our problems is Internal Server Error ( 500 ) at first and It's so urgent and after that lots of DB queries.

Thanks In Advance,
Shahryar
Hey Shahryar,

I am sorry that delay of this reply,

May i know when you submit a comment on your Joomla article also hitting 500 internal server error? Or only hit this error when you trying to "Update database" from Komento configuration page?

When I enable Komento component from backend, but it didn't show the Komento form in this article -> http://www.shahrsakhtafzar.com/fa/review/memory/4534-g-skill-ripjawsx-f3-2400c11d-16gxm-full-review

Looking forward of your response.
Arlex Wong
·
Wednesday, 29 July 2015 23:37
·
0 Likes
·
0 Votes
·
0 Comments
·
Hey Arlex,

Your welcome.

When I saw you didn't reply I personally tried to do Update DataBase again and after lots of efforts I could and after that didn't see any 500 Internal Server Error due to Komento. So I enabled all of them and was testing the working.

But wait a minute!! What happened?! I cannot login to our website backend right now? Did you changed my password?! Please set it back to the password I mentioned in additional information first.

Also, The komento right now is disabled. Please check it ASAP...

Thanks.
Shahryar Barani
·
Thursday, 30 July 2015 00:42
·
0 Likes
·
0 Votes
·
0 Comments
·
Also, There is one question, How did you access our backend? After I could update the database to ensure testing before reporting to you, I changed my password to something else than I put in Site Details Section, But now my password is changed and you accessed my backend?

Do you install any exploit to get Database access? :-O
Shahryar Barani
·
Thursday, 30 July 2015 00:45
·
0 Likes
·
0 Votes
·
0 Comments
·
my friend in website reset my password to that I've told you in the additional information.

But really, It's nice to know how did you access my backend? Also the problem that Komento didn't show up was your colleges who also changed my password, disabled all the komento from "Extension Manager" + Don't know really what happened after your colleges editing but it seems there is some permission conflict! You're right it doesn't show komento commento for public even I set to show in ACL.

Please check this item seriously in your internal team and kindly let me know what happened.

After that we can discuss about DB Queries my friend.


King Regards,
Shahryar
Shahryar Barani
·
Thursday, 30 July 2015 01:31
·
0 Likes
·
0 Votes
·
0 Comments
·
Update: Don't know really what happened after your colleges editing but it seems there is some permission conflict! You're right it doesn't show komento commento for public even I set to show in ACL.

It's funny that in some articles, It shows and it some it doesn't show.
Shahryar Barani
·
Thursday, 30 July 2015 01:49
·
0 Likes
·
0 Votes
·
0 Comments
·
Example:

It shows here:

http://www.shahrsakhtafzar.com/fa/articles-guides/os/5153-windows-8-windows-10

But it doesn't show here

http://www.shahrsakhtafzar.com/fa/news/console-game/5178-2k-games-mafia-3

NO manually disable is used.

Also, Internal Server Error is Back ...
Shahryar Barani
·
Thursday, 30 July 2015 01:52
·
0 Likes
·
0 Votes
·
0 Comments
·
Hey Shahryar,

Hmm, I didn't reset with your password and edit your komento settings.

I just follow what login credentials you provide to us, it login successfully just now. But now I have to use your second password to login.

by the way, I have checked this 2 article link, it seems like both also shown Komento.
http://www.shahrsakhtafzar.com/fa/articles-guides/os/5153-windows-8-windows-10
http://www.shahrsakhtafzar.com/fa/news/console-game/5178-2k-games-mafia-3

may i know how to replicate this internal server error?
Arlex Wong
·
Thursday, 30 July 2015 02:03
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Arlex,

If YOU say, I trust you regarding password ...

Regarding, 500 Internal Server Error, It's not something you can see immediately, You just need to login, browse or going to publish and upload some content. You eventually get this error.

Needless to say, Whenever I enable Komento, this error appear. I didn't have this problem before upgrade.

Also, for seeing query you need to enable joomla debug system and load this content:

http://www.shahrsakhtafzar.com/fa/review/memory/4534-g-skill-ripjawsx-f3-2400c11d-16gxm-full-review

You can see it uses 390 DB queries to load komento. Whenever komento is disable it loads just about ~85 queries, that's lots of load on DB, you know ...

Please check it ASAP, because We love komento but if we cannot overcome internal server error we've to migrate again to JComments
Shahryar Barani
·
Thursday, 30 July 2015 16:55
·
0 Likes
·
0 Votes
·
0 Comments
·
What's up guys?
Shahryar Barani
·
Thursday, 30 July 2015 19:52
·
0 Likes
·
0 Votes
·
0 Comments
·
Is there anybody there?
Shahryar Barani
·
Friday, 31 July 2015 03:27
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Shahryar Barani,

We are currently still checking on your issue. We will update you as soon as possible once we've figured out what causing the internal error issue.

Thank you for your kind patience and understanding.
Sam
·
Friday, 31 July 2015 12:21
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Shahryar Barani,

Regarding your 500 internal error, I cant seem to be able to replicate this issue. I can browse your site and when I attempt to submit a comment, everything work just fine. Can you tell me what is the steps to replicate this issue?

As for the number of queries executed in your page, try to reduce the features from Komento, e.g. number of comments to be displayed, features like likes, reporting and etc. Imagine the system has to count the likes count, report counts for each comments in the page. Anyway, I've configured your Komento to display 10 comments per load and also disable the ranking status bar option. The number of queries are now reduced to 250. This is just a temporary solution as we will need to review all the queries statement in komento and we will see how we can optimise the queries performance

By the way, the ftp account that you've provided failed to authenticate me
Please advise.

Hope this help and have a nice day!
Sam
·
Friday, 31 July 2015 13:57
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Sam,

the 500 Internal Server Error doesn't usually occur when you submit comments, but when you enable komento, You'll get this error in many places, from simple browsing to submit content. This error is not something that you always get, you sometimes will get but our reports from users show about 200 errors per day at least.

About, Queries, It's a lots of time Komento has this issue. 80 queries to 250, It's a lots of distance. Imagine every content in our website has comments and lots of them have huge comments and everyday these numbers will be higher and higher. Actually loads on DB Server and MySQL will be higher and higher. Any plan for this problem in near future?

Thanks,
Shahryar
Shahryar Barani
·
Friday, 31 July 2015 19:01
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Shahryar,

Any plan for this problem in near future?


I've reported this issue to the teams and yes, we will be reviewing the sql statement in komento and hopefully we will be releasing the fix very soon. Currently all our hands are focusing on EasySocial 1. 4

the 500 Internal Server Error doesn't usually occur when you submit comments, but when you enable komento, You'll get this error in many places, from simple browsing to submit content. This error is not something that you always get, you sometimes will get but our reports from users show about 200 errors per day at least.


Do you have any error logs for these 500 internal errors? When i was testing on your site, the Komento was enabled. I did browse your site and submit the comment. By the way, when you say submit content, may i know what kind of content?

Please advise.
Sam
·
Friday, 31 July 2015 19:23
·
0 Likes
·
0 Votes
·
0 Comments
·
The problem is random, occured around the host. check forums too:

http://www.shahrsakhtafzar.com/forum/forum.php

Register and Login and see can you get this error?

If you're searching to detect a specific page to get that error , You're completely wrong because when komento is enable we will get this problem all around the websites.

I think there will be some problem on server. maybe high load on Database?
Shahryar Barani
·
Saturday, 01 August 2015 04:04
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Shahryar,

I am sorry for the delay of this reply as today is a weekend for us here

http://www.shahrsakhtafzar.com/forum/forum.php
Register and Login and see can you get this error?


I am able to register at your forum and successfully logged into your forum site. Please see:
http://screencast.com/t/ioocspr4
http://screencast.com/t/rBYXKmVp

Anyway, do you mean in your forum, you also having 500 internal error? If yes, then I'm confused as you've installed komento on your domain http://www.shahrsakhtafzar.com/fa and your forum site is at http://www.shahrsakhtafzar.com/forum . From what I've understand, the 'fa' is a subfolder in your site which you've installed another Joomla instance and your Komento was installed at this sub folder.

Anyway, to isolate your issue from Komento, try to disable Komento from your http://www.shahrsakhtafzar.com/fa/ for one or two days and then see if anyone still encounter the 500 internal errors or not.

Also, can you check if there is any error logged in your apache server log files? Maybe from there we can see what is the actual error that causing the internal errors.

Please advise.

Hope this help and have a nice day!
Sam
·
Saturday, 01 August 2015 11:32
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Sam,

Our forum url is: /forum
main website: /fa

root ( public_html) is nothing just a joomla installation for our old website URLs.

Apache error log is not helpful, It just shows It got 500 internal server error on a webpage. But nothing is special in those pages and It's random completely.

Is there any temporary option to migrate to it from komento for somedays to ensure It's from komento? Can we migrate to JComments and go back again easily?
Shahryar Barani
·
Sunday, 02 August 2015 01:58
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello Shahryar,

I'm afraid the queries is came from this option: http://screencast.com/t/JGKqxZD8bCLf . You can find this in Komento>Integration>Layout>Comment Item. This is for the new comment notification. It will kicks in every 30 seconds to get the latest comment made in that post if available. You might want to turn off this option and monitor the behavior. As for the migrating to JComment, we not sure if JComment does support importing komento comment.
Nik Faris
·
Monday, 03 August 2015 13:16
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello Nik,

It decreased about 10 queries per page.

Look my friend, It's obvious that If we disable any feature, this will decrease some queries but we love komento because of its modern great features! even without live notifications, it uses ~140 queries! It needs lotsssssss of optimizations ...

We should wait till your next version.
Shahryar Barani
·
Tuesday, 04 August 2015 13:58
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Shahryar,

I am sorry for the delay of this reply.

Thank you for your kind input and concern. I am sure your concern and thoughts is all for the greater good of komento and we are really appreciated it. I will surely put this suggestion into our codebase and hopefully the optimization can be done in the next release of komento, if not it will be next future release of komento 2.1 . Thank you for your kind understanding.
Ezrul Fazwan
·
Wednesday, 05 August 2015 16:36
·
0 Likes
·
0 Votes
·
0 Comments
·
View Full Post