Hey Haki saki,

I am really sorry for the delay of this reply,

May i know what do you mean for the "maxing out my allowed script executions on my site"? Is it when you access on of the page then it always load the page until time up?

If that is the thing, is it possible provide us more information for that so we can try reproduce on this issue and see what is the issue causing this?

My hosting company has quotas on script executions per month (accessing a database, loading a page, etc..)
My current quota is 600,000 executions per month. ES is not the only module that is using resources, so does our directory, regular html pages, joomla admin page, spiders/bots, etc..but I wanted to know if you have any suggestions on what is a good host or server set up for you or other customers to plan for future growth..make sense?

Hey Haki,

To be honestly, I am not really familiar with the script execution limit from hosting server, but what I know is most of our customer also using Siteground hosting server and so far they didn't complain about maxing out their allowed script executions on their site.

It would be best if you can consult with Siteground support and see what is their better plan for this.

You can access Siteground site here -> https://www.siteground.com/joomla-hosting.htm?afcode=55eebc3705a5597edbfa8efbc780d32f

thanks..they aren't very helpful.

Thanks for getting back to me and I am sorry that couldn't help much you here.

This is what I'm getting from Siteground re: Inodes & Script Executions:

Regarding the inode usage, I have found that the following two directories contain the most inodes:

12,339 Inodes - public_html/media/com_easysocial/config
221,351 Inodes - public_html/media/com_easysocial/photos

I don't know if the is scale-able meaning if my user count increases so do the inodes created by ES?

Another comment from SiteGround Support:

"You should check why the easysocial module is adding hundred of thousands of photos to your account using all of its resources along the way. You may try contacting their developers or support forum for this issue."

Hey Haki,

I am sorry for the delay of this reply,

The reason why the result show this folder (public_html/media/com_easysocial/photos) use a lot of resources, because when your site user upload a image in your site, the image will stored in this folder.

Did you consult with Siteground hosting regarding your current issue "maxing out my allowed script executions"? Is that everything can prevent? Or is there any customer hitting this before when using Easysocial?

Because so far our customer didn't complain about this before.

They are saying it's an ES issue and it really doesn't matter what hosting plan I upgrade to with them because ES is using too many resources for any of their plans

So I'm stuck guys, I'm at a point where I can't use my website. Somethings wrong here, I don't know if it's how ES is setup but somethings wrong. Help!

Update from SiteGround:

"Your Disk Space Usage and Inode Usage are almost maxed out. It appears that the folder /home/hakisaki/public_html/media/com_easysocial/photos
takes most of this space. It appears that the extension com_easysocial you have installed has created these files. I suggest you to review the extension's settings and what files have been generated. It is possible that the problem is related to the code of the extension itself."

Hey Haki,

I am really sorry for the delay of this reply,

"Your Disk Space Usage and Inode Usage are almost maxed out. It appears that the folder /home/hakisaki/public_html/media/com_easysocial/photos
takes most of this space.

Hm, I actually already explained at above why this folder will took the most of the space is because when your site user upload their photo, these photo will stored in this folder. Unless you block your site user do not have permission to upload photo in their profile.

It okay, I've consult with our senior regarding this during weekend, perhaps you can try this inmotion hosting and consult with inmotion hosting regarding this matter and see how it goes? http://stackideas.com/inmotion-webhosting , I remember I have share this link from another post thread in our forums.

Thanks for the response. So a couple of things, I have about 100 users. I would say 85% of those users haven't uploaded any images other than maybe a new avatar/cover. The 15% that have uploaded images is pretty minimal.

OK, that said, I have seen others on this forum who claim they have thousands of users. So, if I aspire to have 5000 users this year and (in my case) 100 users = 18 GB of photo space needed, I am going to need a server w/ close to a terabyte of storage?

Siteground is claiming that ES is making hundreds of thousands of images (which can't be the case) but something seems off here.

UPDATE: ok, so after looking further in to why my ES media file is so big, it looks like ES is somehow duplicating everything many times over. (there are entire folders of hundreds, maybe thousands of the same images inside other folders. Please refer to /public_html/media/com_easysocial/photos/396/636/ Folder "636" seems to have every subfolder and image that is also in the root of /public_html/media/com_easysocial/photos/

This is also the case for:
/public_html/media/com_easysocial/photos/397
/public_html/media/com_easysocial/photos/398
/public_html/media/com_easysocial/photos/399
/public_html/media/com_easysocial/photos/400
/public_html/media/com_easysocial/photos/401
/public_html/media/com_easysocial/photos/402
/public_html/media/com_easysocial/photos/403
/public_html/media/com_easysocial/photos/404
/public_html/media/com_easysocial/photos/407
/public_html/media/com_easysocial/photos/408

So, the best I can tell so far is that there are 11 duplicate folders containing about 15G worth of images

Can you explain this?

hey Haki,

I am sorry for the delay of this reply,

That was not duplicated folder is because when the user upload as what I shown you in my following attached screenshot :

#1. Logged in and trying to upload 2 photo at the same time in the photo stream.
#2. System will auto generated a new album id for this -> 441

// site.com/media/com_easysocial/photos/albumID/photoID/photoName <- path format

http://www.hakisaki.com/media/com_easysocial/photos/441/682/sea-foam-summer-surf-88009-1920x1080_large.jpg

http://www.hakisaki.com/media/com_easysocial/photos/441/681/cube-drop-water-drops-65611-1920x1080_large.jpg

#3. System also auto generated each photo id into folder name
#4. After that it will auto re-size the original photo to 6 type of photo size

You can refer on my attached screenshot below.

Hope this will more easy to understand.

I dont think we are talking about the same thing. I understand that every image upload gets resized 6 times. The folder "441" you make reference to is about 2mb But if you look at the attached screen shot (please look in the folders I referenced above) you will see that every ES folder and images (+ all 6 resized images) in my entire site are replicated in the folder named "399". folder "399" is 2gb alone (because they contain every ES image that exist on my website). There are 11 folders (see previous message) that have the same issue and are about 2gb

Hey Haki,

I am sorry for the confusing in earlier, that was really strange, you can see just now I added 2 photo in your Easysocial site, it stored correctly and it didn't duplicate that folder.

Can you temporary do a backup for this folder JoomlaFolder/media/com_easysocial/photos/ first ?

Then we try to remove those duplicated folder and figure out how to replicate this issue.

This has crippled my server and site unfortunately. I can't back anything up. I deleted all the files that I mentioned in earlier posts which has cleared up about 15g of space. The backup (akeeba) still gets hung up on /photos/421 . That folder seems to have everything copied in there too but I kept it on the server if you want to look at it to figure out this mess

Hey haki,

I am sorry for the delay of this reply,

Perhaps you can revert to your backup which you already removed those duplicated folder backup, so that we can see which day still hitting this and investigate this issue again.

Because this is hard to track back why this happening and this issue do not have any user encounter before

Keep us update once you revert back your backup (removed all the duplicated folder), I would like to capture all the folder file and created date time, I would like to see which day created these duplicated folder in your site.

What I noticed last few day is these duplicated folder was created at March 3.

I dont have the space on my hosted server to revert back to all those files unfortunately.

Although deleting all those images has significantly reduced my hard drive and inode usage my "allowed number of script executions" is still maxed out always. No shared hosting plan can support the number of script executions that my site seems to have.

Yesterday I had 2 people log in (including myself) and 20 visitors (no ES usage) and my plan is maxed out. They are recommending a dedicated server for 20 visitors and 2 ES logins per day..that seems outrageous.

I can only suspect the same reason ES copied all those duplicate images is the same reason why ES script executions are so high.

I basically need to turn off ES if I want to use my website..

To give you an idea of what I'm dealing with, I logged in once today and posted 1 url to 1 group and this is what happens, about 20 POST calls for that one action...

I also believe the main cause is the com_easysocial module. It seems it is making a lot of requests hits in a short amount of time, for example:
Code:
76.246.1.13 - - [09/Mar/2016:16:21:44 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562093157 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:04 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562113536 HTTP/1.0" 200 35 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:04 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562113625 HTTP/1.0" 200 377 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:07 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562116563 HTTP/1.0" 200 80 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:21 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562131076 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:23 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562133067 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:28 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562137297 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:30 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562139769 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:31 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562140214 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:32 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562142055 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:33 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562143090 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:34 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562144025 HTTP/1.0" 200 377 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:34 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562144131 HTTP/1.0" 200 35 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:35 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562144136 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:37 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562146964 HTTP/1.0" 200 80 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:38 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562147295 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:22:44 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562153592 HTTP/1.0" 200 33 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:23:05 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562174406 HTTP/1.0" 200 377 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:23:05 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562174508 HTTP/1.0" 200 35 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"
76.246.1.13 - - [09/Mar/2016:16:23:08 -0600] "POST /profiles/?option=com_easysocial&Itemid=1064&_ts=1457562177347 HTTP/1.0" 200 80 "http://hakisaki.com/profiles/groups/item/22-space-qa" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"

Hey haki,

I am sorry for the delay of this reply,

I've checked you provided us that info at above, actually that was Easysocial make a ajax request call to your server to get back the data then popular these new notification/stream/comment in your page
For example :
1. Check is it got new comment
2. Check is it got new stream
3. Check is it got new system notification
4. Check is it got new friends notification
5. Check is it got new broadcast notice from admin
6. Check is it got new conversations notification

By the way, I've checked in your notification page, it seems like you have set all of them polling interval time 30 second together, I already help you extend different notification polling interval time, you can check again is it not getting a lot of ajax request at the same time?

ok, so with all notifications on, a single action by a user creates about 20 script executions? These are good metrics to know as people who are using shared servers have certain hourly script execution quotas. I assume most ES actions are going to have the same impact on a server (uploading photo, messaging, liking items, etc). so for instance, I had one user log on the other day, spent about 30 mins on the site and used about 1/2 my quota up for the day. That said, unless someone has other information or another way to configure ES, I do not think the ES extension is appropriate for a shared hosting environment. Agree?

hey haki,

I am sorry for the delay of this reply and missed up share with you I've applied some fix in your site, because I troubleshoot on your site yesterday night, I found out the reason why it execute so many multiple same script at the same time is because some where keep trigger that script execution, by right when you view on Easysocial dashboard/group/event/profile/single Stream page, the system only execute these few script on the page as I mentioned at above.

Perhaps you can re-check again after you login then go to one of the group page, before you go to your group page, you have to check your current time and check how many script it execution.

In other words, if the Easysocial page show the stream, it will execute these script I mentioned at above.

To be honestly, I am not really sure how hosting calculate the script execution quota, is it 1 ajax request from the site then they will count to 1?

I would recommended to standalone hosting environment is better than shared hosting, based on what you shared with us if using shared hosting environment, they will have maximum script execution per month on the server.

I believe Facebook script execution is more than Easysocial because they have build-in live chat system for example, you can imagine if I pm to different 10 of my social friends, it should be send out 10 ajax request call to the server.

Can you tell me what changes you have made to ES on my site as now it is telling me it is in development mode and I didn't change that...

Hi there Haki Saki,

The settings to change from Developer mode to Production mode is in EasyBlog>Settings>General and in the System Settings section, go to the System Environment option and choose from Development to Production.

I've done the setting for you

Thanks but my issue is this...Arlex said he made changes to my settings to reduce script executions and I asked what he changed so I can keep track of what's going on. So I wasn't asking you to turn it on to Production necessarily but to explain the changes..so I guess I want to make sure you guys are coordinating your support because you just turned on what Arlex just turned off...

Ah, I see. I'm sorry for the misunderstanding from my side. I've turned back the settings to Development mode. If there's any further issue, let us know.

again, I dont know what the right setting should be, I just questioned what changes Arlex said he made and for him to tell me what changes he made...can you please check with him and anyone else there to make sure everything is set correct on my site and what changes have been made?

Hey haki,

I am sorry for the delay of this reply,

I've applied some fix in your site a few js files, so have to temporary change that environment mode to use development is because the latest fix js files is not get compile yet.

By the way, I have manually do the re-compile in your site again, and changed back to use production environment mode.

What I did previously is applied some fix in your site and modified the notification polling interval time from your backend http://yoursite.com/administrator/index.php?option=com_easysocial&view=settings&layout=form&page=notifications

Guys, the mass copying of photos problem is back again. I uploaded 4 images yesterday to a Group (about 2mb of data) and my HD usage jumped about 7gb. I'm trying to pinpoint which folders again but something is very wrong and this is taking up way too much of my time.

Here's an example (probably) whats going on. You guys uploaded new avatar and cover images to one of my Groups and now there is 38 copies in that Group

I have attached a txt file that shows the folders in /media/com_easysocial/photos with their sizes.
Just looking at all the directories that are exactly the same size or are gigantic was a red flag..I dont have the time to go through every directory but here are some examples:

Folder (422) - 314mb: Duplicates all photos in website
Folder (447) - 3.7gb: Duplicates all photos in website
Folders 51,52,53,54,55 - duplicates of each other

I'm sure there are many more...

Hey Haki,

I am really sorry for the delay of this reply, I've checked from your /media/com_easysocial/photos folder , it seems like you already deleted those duplicate photo.

Is it possible provide us with your Siteground server access and may i know how to you check the folder size?

Because I would like to replicate this issue in your site, since you have mentioned uploaded 4 photos yesterday to a Group then your server HD usage jumped about 7g.

Also may i know which group you upload image to? Can I have the permission to upload some image into that group?

Looking forward of your response.

Here's an example (probably) whats going on. You guys uploaded new avatar and cover images to one of my Groups and now there is 38 copies in that Group

Regarding this, I already answered on your another thread.

I didn't delete anything, so someone on your side must have. They were gone this morning so whoever logged onto my site last night deleted them.

Can we figure out some way to make sure everyone who is working on this is in the loop? I asked a couple questions ago for a list of changes made to my site and the response was a "few js files". Meanwhile I have to manually go in to all my 20+ Profiles and change back the App settings as those all seemed to be changed and my settings>general>emails>Email Transporter Behaviour was turned off so none of my members were getting email alerts.

As far as the text file I attached with directory sizes, that was provided by Siteground Tech Support

Hey haki,

I didn't delete anything, so someone on your side must have. They were gone this morning so whoever logged onto my site last night deleted them.

Can we figure out some way to make sure everyone who is working on this is in the loop? I asked a couple questions ago for a list of changes made to my site and the response was a "few js files". Meanwhile I have to manually go in to all my 20+ Profiles and change back the App settings as those all seemed to be changed and my settings>general>emails>Email Transporter Behaviour was turned off so none of my members were getting email alerts.

May i know when you turn on this "send email on page load" setting?
Is it before you getting your HD usage jumped about 7gb or after this happen?

By the way, you can actually turn off this if you already setup cronjob in your siteground server, if you haven't setup this, I can help you configure with this.

However, I tried to access in your siteground server, but I hitting this "Your information is outdated.", can you help?
https://ua.siteground.com

Because I would like to see is it possible check that folder site through the phpmyadmin, if that is possible I will upload some image and see what is the result from the folder size.

-The "send email on page load" you are referring to was turned on AFTER all these folder/photo duplication issues

-Yes I'm familiar w/ cron jobs (refer to my ticket "Alerting a User By Email" in Aug '15) This issue went round and round for a month without resolution. That is why I decided against it.

-My server credentials haven't changed. I'm not sure whats going on there.

*** This thread is going on forever with only some questions being answered but new questions still being asked. I will let you know when I have additional problems under a new ticket

Hey Haki,

I am really sorry for the delay of this reply,

I read that previous thread, it seems like you didn't response back to us regarding that FTP details.

By the way, I already help you setup cronjob in your site server, you can refer on my first screenshot below. So you no need to user "send email on page load" and improve your site performance as well.

Can you give it a check is it will auto send out those pending email from your site?

Regarding with your main issue :
-----------------------------------------------
May i know which group you trying to upload these photo in your site? If this happen again, perhaps you can provide us more details regarding the step, it would help us to replicate this issue.

Because I tried to create a new group and tried to upload multiple photo at different time, it seems it didn't happen for duplicate the folder from JoomlaFolder/media/com_easysocial/photos yet.

And I also checked from your database, it stored correctly data when upload the photo.

But one thing I do not know how Siteground check from the folder size directly like you sent me that zip file last time, because after I uploaded these photo in your site, I also open each photo folder from your file manager, I can't ensure that how much data usage it used after I uploaded these photo.

*** This thread is going on forever with only some questions being answered but new questions still being asked. I will let you know when I have additional problems under a new ticket

Sure, if you have any other different question, it would be best start a new thread so that we can manage it easier.