By HMED on Monday, 02 November 2015
Replies 35
Likes 0
Views 1K
Votes 0
Hi every one,

i believe this topic will interest every community manager here,

With ES profiles we can collect a huge numer of data of our members (locations, jobs, used softwares, interest, etc.), a great feature to know who are our members and what are theit interests. The problem is that data here are not processed.

if we take the example of a website where members have each one a field called "software" with some entries like (Photoshop, After effects, Mspaint, etc.), today we are not able to get stats about those data, some thing lile : For Software custom field : 30% photoshop, 20% after effects, etc.

the unique field where data as collected and shown in stats is location (coutries).

i was wondering if that can be possible to do on ES, as futur feature or cutom dev.
and if any other members here are using / need data stats.

(this can be proposed as paid app/extension for example)
+1
But it will be difficult to have correct stats if there are spelling mistakes or in the entered field and some may have capital letters others not.
Photoshop vs phtoshop vs photoshop and so on...

At the moment I guess these statistics can only be gathered on the autocomplete custom fields.
Entering all possible values in the autocomplete custom fields can be a nightmare when hundreds of them need to be stored...

But I agree these statistics can be very helpful
·
Monday, 02 November 2015 19:49
·
0 Likes
·
0 Votes
·
0 Comments
·
Thank you Supporter,

i like how jreviews handle custom fields, every data add in those fields are registred and can be used after, for example they can be shown in a joomla module to filter listings.

I belive that the heart of the subject is the possibility to show the data entered by users per custom fiend, we can do stats then with that (manual in excel or automatic with graphs like easydiscuss), in the case when some member do spelling mistakes we will see them and just edit to resolve the problem.

We can imagine with the same example of "software" custom field when we click on that field we get a list of data entered by users with the number (ex. After effect (18)) and a hyper link to check those members .

i read recently the great book "Buzzing communites" and it explain how much data are important for managers to determine members interests and developpe the community in the right way.
·
Monday, 02 November 2015 22:32
·
0 Likes
·
0 Votes
·
0 Comments
·
Thanks for the heads up on this Jan. Our hands are pretty full right now and I am afraid we might not have the resources to add these customizations for you right now.
·
Tuesday, 03 November 2015 00:38
·
0 Likes
·
0 Votes
·
0 Comments
·
Thanks Mark, no problem we know you are already working on next ED 4, ES 2 and EB 5.1. more then full job

We are looking to get your point of view, what do you think about DATA and what is the place of DATA in ES ?
·
Tuesday, 03 November 2015 00:48
·
0 Likes
·
0 Votes
·
0 Comments
·
Well, I think it's a great idea but it's not our priority right now
·
Tuesday, 03 November 2015 00:52
·
0 Likes
·
0 Votes
·
0 Comments
·
Here are some ideas, if you can build a MySQL query (or use a wizard, the first two will very likely help you on their forum, the third option will likely need $ for customized version but that depends on what you want to achieve).


  1. Use an animated counter to showcase site status for current/prospective users.

  2. Nordmograph has such a module. You have three options for entering the data: fixed value, use the "wizard" to make your query, enter a MySQL query. So think of a module showing "xxx Teachers, yyy Students, ppp Courses" or "xxx Groups, yyy Events, ppp members". If you use NoNumber's AMM Pro you could assign modules according to PHP scripts and thereby change the module dynamically to show different status based on context based on user, user group, etc.

  3. Create a dynamic table from a query (i.e., from ES profile data) and then display that really nicely using a stylized display or graph using Tabulizer.

  4. Combine ES data with particular actual user statistics Joomlathat "Content Statistics" extension for ES data for site visitors if it's valuable for you to capture and show events and analysis over time.

  5. Use external products like Mixpanel (PayPlans ReadyBytes uses them) for Google, these allow you to tack-on "tokens" to tracking user flow through your site and if you mapped ES profile type "understanding" of your users via those tokens you could do some other very interesting things, but likely over the scope of many ES users.

·
Tuesday, 10 November 2015 04:31
·
0 Likes
·
0 Votes
·
0 Comments
·
Thank you Elleen, very helpfull.

i received last day a newsletter from Nordmograph about their new data extension,
i dont know Tabulizer before, looks great too.

i am not sure what solution can help us to interact with ES data, we will need for example to know how many members we have who are using photoshop (filled in software custom field), its possible to do it with the first two extensiosn ?
·
Tuesday, 10 November 2015 04:50
·
0 Likes
·
0 Votes
·
0 Comments
·
Thanks for sharing this Jan Perhaps we should start thinking about collecting these data under some sort of demographics section at the back end of EasySocial. Let's see what we can build in the future for this
·
Tuesday, 10 November 2015 15:44
·
0 Likes
·
0 Votes
·
0 Comments
·
Thank you Mark, i will test some of those tools and build some data charts,
i will need perhaps need your help to extract data from the DB (tables structures)
·
Tuesday, 10 November 2015 17:13
·
0 Likes
·
0 Votes
·
0 Comments
·
I am testing vChart extension,
can you tell me please where i can find the custom fields and how they are linked to users ?

i can send you the extension Mark if you have some seconds to test it
·
Tuesday, 10 November 2015 18:55
·
0 Likes
·
0 Votes
·
0 Comments
·
What we must write in sql query to extract custom fields data for example ?
·
Tuesday, 10 November 2015 20:02
·
0 Likes
·
0 Votes
·
0 Comments
·
Take a look at the table #__social_fields_data , #__social_fields , #__social_profiles , #__social_profiles_map but you need to write a more complex query (joining of multiple tables) to really get the result that you want.
·
Tuesday, 10 November 2015 20:15
·
0 Likes
·
0 Votes
·
0 Comments
·
Mark wrote:

Take a look at the table #__social_fields_data , #__social_fields , #__social_profiles , #__social_profiles_map but you need to write a more complex query (joining of multiple tables) to really get the result that you want.


I am wondering i can add here the login details
·
Tuesday, 10 November 2015 20:26
·
0 Likes
·
0 Votes
·
0 Comments
·
I contacted JoomlaThat and they tell me that they can create an ES plugin to extract data for 400$ !!
·
Tuesday, 10 November 2015 20:28
·
0 Likes
·
0 Votes
·
0 Comments
·
Or, if we could find 10 ES users who find value in ES based data then as a group we could say we all want to by ContentStatistics if it supported ES as you support EB (EB plugin is included). Funding the effort this way with likelihood that it remain part of ContentStatistics package eases the maintenance headache and financial burden.

I'd be one of the ten
·
Tuesday, 10 November 2015 22:55
·
0 Likes
·
0 Votes
·
0 Comments
·
Thank you Elleen, we are 2 then
i believe many communities managers here will be interested in such features!

Right now i am tryng some sql queries with on of the vchart guys, i hope i can extract some thing usefull
i'll keep you informed
·
Wednesday, 11 November 2015 00:11
·
0 Likes
·
0 Votes
·
0 Comments
·
@Elleen what do you think about Tabulizer ?
Can't do any thing with vChart, i will try another solution .. it wasnt a good idea tis purchase !
·
Wednesday, 11 November 2015 01:18
·
0 Likes
·
0 Votes
·
0 Comments
·
@Jan! one of the reasons I piped up in this post is that I have "data, data, data" on my mind and realize it's value but haven't actually been able to devote any more time to it than background research (maybe in a few weeks). I know Tabulizer was better accepted by users than vChart, and that Tabulizer has a comparatively sophisticated way to define data sources and build from any set of databases/tables. You can take a look at their help file. As I said, I may join you at this in a few weeks
·
Wednesday, 11 November 2015 01:32
·
0 Likes
·
0 Votes
·
0 Comments
·
Thanks Elleen i just purchased Tabulizer, i am tryng it, seems need a minimum skill in sql query too !
you will be welcome, if you will need to test those extensions just tell me
·
Wednesday, 11 November 2015 01:45
·
0 Likes
·
0 Votes
·
0 Comments
·
Thanks for sharing this
·
Thursday, 12 November 2015 00:50
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello guys, i need your help or paracetamol

we have a custom field where our members can check their interests in our website (learn, network, business, etc.),

in the data column table we found the data as : "["network","learn","careers","business","other"]

To extract those data and count them we use this query :
select COUNT(DISTINCT data),raw from #__social_fields_data where `field_id`='175' GROUP BY data;

we get a table as mentionned in the attached screenshot, the problem is that the choices are grouped by entire line and not by single interest

what can be the way (query or other) to get the number of interests one by one (network, business, etc.) ?

hope i am not alone to look into this kind of data and stats !!?
·
Friday, 13 November 2015 07:20
·
0 Likes
·
0 Votes
·
0 Comments
·
See this SQL fiddle for some ideas creating an auxiliary table, filled with sequential numbers from 1 to at least the expected number of distinct words (5 in your case)? Also, could you put the mysql result into a string and use PHP to count frequency of key words in string per line?
·
Friday, 13 November 2015 08:44
·
0 Likes
·
0 Votes
·
0 Comments
·
Jan,

Raw data are stored in a json string so that it can be searched easily and we can also manipulate the result without running complex queries. You should take a look at the "raw" column instead.
·
Friday, 13 November 2015 12:32
·
0 Likes
·
0 Votes
·
0 Comments
·
Mark, please remind me if ES 1.4.4 does have ACL for apps now? Meaning, can we make an app only visible to a certain Joomla Group? Sorry, I forgot to look at the that feature but if Apps can have ACL then I think an App that is designed for admin can be created to show analytics like this.

Thanks,

Jackson
·
Friday, 13 November 2015 13:36
·
0 Likes
·
0 Votes
·
0 Comments
·
Eileen O'Donnell wrote:

See this SQL fiddle for some ideas creating an auxiliary table, filled with sequential numbers from 1 to at least the expected number of distinct words (5 in your case)? Also, could you put the mysql result into a string and use PHP to count frequency of key words in string per line?


i didn't understand all but i really appreciate your help @Eileen

@Mark i can't build this kind of php mini tools but Thanks you

@LAX infosys seems like you want to create an app for ES data stats ?
·
Friday, 13 November 2015 16:02
·
0 Likes
·
0 Votes
·
0 Comments
·
@Jackson, there is still no ACL for apps yet at this point of time. I will try to push this in the next major release
·
Friday, 13 November 2015 16:53
·
0 Likes
·
0 Votes
·
0 Comments
·
@jan! just trying to help move it forward, but thankfully @Mark filled-in the gap with his post! Wish I could work on this but I'm behind in other things.

Hey, if/when you get some queries working please post 'em here. Also, you might like to take a look at an interesting dashboard tool called Cyfe which as a free version. I'm looking to use this, maybe useful for you or prompt ideas for others. I'd been reviewing dashboards for another project (tracking iot) and then thought it could be used for social data.

It could be interesting for you (or any ES site) to create a dashboard and wrap it in an iframe to show to a network "status" (could do this programmatically for users but that's entails $$$ as white label user). There are at least 3 ways you could share data and display with this tool:


  1. Pull data from a CSV file (from server or create dynamically via php) with a custom widget
  2. Create a custom MySQL query and use that to build a dashboard widget
  3. Use their Push API to send data whenever an ES event occurs that you want to track/display.


It also is interesting to take a look at types of social media dashboards you can create (here's just one example). It's useful to take a look because it gives you a sense for what data other social networks make available, which, in turn, mirrors what those using data have been asking for. Of course you don't always want to follow the herd, because they may have a good idea, but innovation comes sometimes thinking out-of-the-box like SI does every day
·
Friday, 13 November 2015 23:01
·
0 Likes
·
0 Votes
·
0 Comments
·
Thank you @Eileen, right now i am testing Odometer extension from Nordmograph
i bought all data stats extensions
·
Friday, 13 November 2015 23:25
·
0 Likes
·
0 Votes
·
0 Comments
·
jan! wrote:
@LAX infosys seems like you want to create an app for ES data stats ?


Yes, I guess ES Apps was designed so anyone can create tools, but tools like user analytics in nature were not supposed to be available for end users. Hence, I am asking if Apps can have ACL. Unfortunately, Mark said there is none for now but hoping it will be added soon.

Creating an app for ES was surprisingly easy once you know how the javascript library works. Hope someone will create a brief documentation on it. I was able to create a simple app that queries a different SQL server and pull data based on user data. At the end it was simple and fun to make but like I said it would be nice to have documentation on the javascript libraries since I got stuck on it until support or Mark helped me on it.

I wanted to create an App that would enable certain group of users to be able to filter demographic data like Male, 25 years old, living in Los Angeles, married and the result can be exported to Excel/CSV or connect with AcyMailing API so I can send newsletter.

Thanks,
Jackson
·
Saturday, 14 November 2015 05:57
·
0 Likes
·
0 Votes
·
0 Comments
·
in many industries we have a huge amounts of data (big data), the challenge in the futur is to capitalize on.
I believe Mark and Stackideas team will do their best to enhance data stats in the extensions.

I am wondering why not consulting a data scientist !
·
Sunday, 15 November 2015 06:32
·
0 Likes
·
0 Votes
·
0 Comments
·
Thanks for the input on this Jan.
·
Thursday, 26 November 2015 17:45
·
0 Likes
·
0 Votes
·
0 Comments
·
Here are some ideas, if you can build a MySQL query (or use a wizard, the first two will very likely help you on their forum, the third option will likely need $ for customized version but that depends on what you want to achieve).


  1. Use an animated counter to showcase site status for current/prospective users.

  2. Nordmograph has such a module. You have three options for entering the data: fixed value, use the "wizard" to make your query, enter a MySQL query. So think of a module showing "xxx Teachers, yyy Students, ppp Courses" or "xxx Groups, yyy Events, ppp members". If you use NoNumber's AMM Pro you could assign modules according to PHP scripts and thereby change the module dynamically to show different status based on context based on user, user group, etc.

  3. Create a dynamic table from a query (i.e., from ES profile data) and then display that really nicely using a stylized display or graph using Tabulizer.

  4. Combine ES data with particular actual user statistics Joomlathat "Content Statistics" extension for ES data for site visitors if it's valuable for you to capture and show events and analysis over time.

  5. Use external products like Mixpanel (PayPlans ReadyBytes uses them) for Google, these allow you to tack-on "tokens" to tracking user flow through your site and if you mapped ES profile type "understanding" of your users via those tokens you could do some other very interesting things, but likely over the scope of many ES users.



Hello Eileen, i need some advices on the tools you mentionned, can we contact ?
·
Friday, 09 August 2019 16:50
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello Guys, any news here about data ?
·
Friday, 09 August 2019 16:51
·
0 Likes
·
0 Votes
·
0 Comments
·
yes, to analyse our members we need some possibility to make the member flows visual in ES.

same problem at the new stream advertisement feature. we need click stats and impressions stats. because my ad-clients want to know how the performance from there adverts.
·
Friday, 09 August 2019 21:25
·
0 Likes
·
0 Votes
·
0 Comments
·
yes, to analyse our members we need some possibility to make the member flows visual in ES.

same problem at the new stream advertisement feature. we need click stats and impressions stats. because my ad-clients want to know how the performance from there adverts.
I'm agree with you n00bster
It would be especially interesting if users could create advertisements on the frontend.

Philippe
·
Friday, 31 January 2020 01:47
·
0 Likes
·
0 Votes
·
0 Comments
·
View Full Post