ES 2.2.2 / 2.2.3 GDPR Download Zip Button Missing
By Yann Anderson on Wednesday, 18 July 2018
Posted in Technical Issues
Likes 0
Views 585
Votes 0
Hello Friends,

I tryed to test the GDPR function: when I go to my account http://www.yannanderson.com/en/friends/profile/edit then I click to "download your information" (see attached picture 1.jpg) I can see a page with this text:

We are currently still gathering data from your account and all other related activities. As soon as the download is ready, you will see a download button below to download the archive.

But I see any button for download the .zip file that contain my information, is it normal ?

Best Regards,

Yann Anderson
Hey there,

I am really sorry for the delay of this reply as it is a weekend for us here.

It seems like you hitting this following memory limit issue :



Fatal error: Allowed memory size of 1073741824 bytes exhausted (tried to allocate 59856264 bytes) in xxxx/libraries/joomla/filesystem/file.php on line 357


The reason why it need use this much memory is because now it trying to archive all the data into 1 zip file but your account uploaded quite much audio and 1 audio more than 1 hour.

If I am not wrong, you have 60 audio and each of the audio file size is around 60 ~ 70MB.

60 videos x 60MB = 3600MB (3.6GB only audio data without other data like photo, stream and etc)

Based on what i checked, all the data system already gathered all together into this folder
JoomlaFolder/media/com_easysocial/downloads/2d66ccdb62e7d518c93e4aa276b6e5ef/, and you can manually access this link, it will show what data you have in current site.
http://www.yannanderson.com/media/com_easysocial/downloads/2d66ccdb62e7d518c93e4aa276b6e5ef/index.html

Then i try to set that memory_limit higher @ini_set('memory_limit', '17024M'); from the code, it seems like still unable to archive it this huge data. then i hitting this when i manually run that crondata URL on the browser http://take.ms/kSeyH

May i know your server how many memory you can use on your current site?

I assume you are trying to test this download data feature, if yes, perhaps you can try another user account which contain less data and see whether this can process complete?
Arlex Wong
·
Saturday, 21 July 2018 16:39
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Yann,

Yes, this is normal where the download button will appear once the download data complete zip (the description mean that the process gathering data is still in progress)
You can check the status in the backend setting (Users>download request) http://take.ms/K2s46
Muhammad Fadhli
·
Wednesday, 18 July 2018 12:36
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Muhammad,

Thank you for your answer. But unfortunately, I don't understand why the process gathering data is still in progress? How many times is necessary for finish the process ? This process can't be done within seconds? It take 1 week or 1 month ? Why ? I saw the progress in the backend, but how many time need I wait for obtain my .zip file ?
Yann Anderson
·
Wednesday, 18 July 2018 18:30
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Yann,

The process of gathering data is depend on how often your gdpr cron job process and how big the user data itself.

By the way, be aware that cronjob url is different from that has been used for email sendout, where you can refer on this documentation: https://stackideas.com/docs/easysocial/administrators/configuration/general-data-protection-regulation
Muhammad Fadhli
·
Wednesday, 18 July 2018 19:05
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Muhammad,

I'm confused, but I obtain an email error (see attached picture email.jpg) -: http://www.yannanderson.com/index.php?option=com_easysocial: No such file or directory and you can take a look to attached picture plesk.jpg, maybee my cron task on Plesk is wrong ? Do you have an idea ? I read your online help https://stackideas.com/docs/easysocial/administrators/configuration/general-data-protection-regulation but don't see where my error is ?
Yann Anderson
·
Friday, 20 July 2018 05:21
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Yann,

Can you use option 'recuperer une URL' instead see how it goes?
Muhammad Fadhli
·
Friday, 20 July 2018 15:21
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Muhammad,

I do what you do 'recuperer une URL' , and when you see my attached picture cron.jpg you can see the email send by my server. Unfortunately, the button is still missing and my joomla backend tell me that the process in still in progress.

Do you know why ?
Yann Anderson
·
Friday, 20 July 2018 18:14
·
0 Likes
·
0 Votes
·
0 Comments
·
I triyed to press the button "execute task now" but I obtain a 500 error, please see attached pictures
Yann Anderson
·
Friday, 20 July 2018 18:51
·
0 Likes
·
0 Votes
·
0 Comments
·
I do it a second time, see attached picture, plesk told me that the task is successfully done, but I never see the download button
Yann Anderson
·
Friday, 20 July 2018 18:53
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Yann,

As I see the backend seems like the status still in process, Can you provide us with your PhpMyAdmin for a better check on this?
Muhammad Fadhli
·
Friday, 20 July 2018 20:08
·
0 Likes
·
0 Votes
·
0 Comments
·
Hello,

Yes, added in "site details" my plesk / php my admin access

Thanks for helping because I have no acknowledge with plesk, mysql, and more.....
Yann Anderson
·
Saturday, 21 July 2018 00:12
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Arlex,

Thanks for helping!

1) First of all, that's right, I'm just testing this GDPR function to report you (if necessary) if I see a problem.
2) I tested this function with another account that have any audio post: that work fine
3) Regarding the memory limit of my server, I have no idea where is the place to check that, but it's not so important because that work with the others accounts.

Now, it's ok for me and I can close this ticket, but from your side, maybee you can add an option in the backend for limit the .zip file size, and if the limit size is reached, you can (maybee) just inform the user about the audios posted, but not include this audio in the .zip file, no ?

Have a wonderful week-end,

Best Regards from Switzerland

Yann Anderson
Yann Anderson
·
Saturday, 21 July 2018 20:48
·
0 Likes
·
0 Votes
·
0 Comments
·
You're most welcome Yann.

Actually we did consider to implement this but it actually very difficult to restrict this, because from the user side who really want to download their data, i believe they really want to download all his current data.

But we will see what we can do about this in the future.

By the way, thanks for your input Yann.

Just for your information, I have locked and marked this thread as resolved to avoid confusions in the future. Please start a new thread if you have any other issue in the future so it will be easier for us to manage your inquiries.

Thanks for understanding
Arlex Wong
·
Sunday, 22 July 2018 10:36
·
0 Likes
·
0 Votes
·
0 Comments
·
View Full Post