By Dennis T. on Friday, 09 October 2015
Posted in Technical Issues
Likes 0
Views 363
Votes 0
Hi,

i imported manually from the Haufe feed and got several duplicates:
http://www.xyz.com/magazin/news-fuer-professionals?start=20
Hey Dennis,

I already move what my colleague fix file into your /public_html/xxx.com/templates/cd_property../html/com_easyblog , by the way, this fix will be included in next release version.
·
Monday, 19 October 2015 23:57
·
0 Likes
·
0 Votes
·
0 Comments
·
Can I have the permission to test feed import in your site?
·
Saturday, 10 October 2015 03:51
·
0 Likes
·
0 Votes
·
0 Comments
·
Absolutly, every time
·
Saturday, 10 October 2015 13:14
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Dennis T.,

Regarding your issue with the duplicate posts in feed importer, I tested your 'Haufe' feed and it seems like EasyBlog did not process any previous imported items. I also tested this in my dev instance and if I re-run the feed importer, the 2nd time import 0 items.

Anyway, after further debug on your issue, I noticed the duplicate items was having two different IP address. Please see attached image.
It seems like you have two machine running the same feed importer and your two machine is sharing the same database?

Please advise.
Sam
·
Saturday, 10 October 2015 14:34
·
0 Likes
·
0 Votes
·
0 Comments
·
Curious..., i have only one site that imports that feed and one machine.
The cause that no new feed was imported is, that at the moment no new feeds are available...
I created just a new feed scource "Presseportal" and got no duplicates?!
How can that be with the two different ips??
·
Saturday, 10 October 2015 14:39
·
0 Likes
·
0 Votes
·
0 Comments
·
PS: i shift the Haufe feed into the category "Immobilien" because of a new structure...
·
Saturday, 10 October 2015 14:40
·
0 Likes
·
0 Votes
·
0 Comments
·
Hey Dennis,

I am really sorry for the delay of this reply,

I've tried to test import feed from `Haufe` in your site, but it seems like no duplicate posts import in your site, you can take a look of my screenshot below.

May i know do you still getting the duplicate feed issue?
·
Friday, 16 October 2015 11:54
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi,

today i looked into the category "Proffesionals" and detected again double content.
I made no manual import, only with cron
http://www.xyz.com/magazin/interessengruppen/professionals
·
Saturday, 17 October 2015 21:34
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Dennis,

I am sorry for the delay of this reply.

Regarding your issue, look like i've found the culprit to this issue. Somehow, there are two different url for one same blog post from the feed. E.g.


https://www.haufe.de/immobilien/wohnungswirtschaft/gww-vorteile-von-passivhaeusern-bisher-nicht-erke...
http://www.haufe.de/immobilien/wohnungswirtschaft/gww-vorteile-von-passivhaeusern-bisher-nicht-erke...


I not sure why this is happening but look like there are two crons running and one is pointing to HTTP (with http) feed url and another one is pointing to SSL (with https) feed url. In EasyBlog feed importer, it threat these two urls as two different blog post hence when importing the feed post, you get duplicate items

I've added fix on your site so that the checking will ignore the HTTP or SSL to prevent duplicate item being imported. Below is the file I've modified on your site.

JOOMLA/administrator/components/com_easyblog/includes/feeds/feeds.php and added below code at line 176:


$uid = ltrim($uid, 'https://');
$uid = ltrim($uid, 'http://');


The above code should fix your duplicate items issue Also, I've remove the duplicate item from your EasyBlog

Hope this help and have a nice day!
Sam
·
Monday, 19 October 2015 13:44
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Sam,

hmm, only one cron is running?!
Please can you add this modified file to the override folder?
I dont want to lost this hack if its not implemented in the eb update. Thanks
·
Monday, 19 October 2015 19:11
·
0 Likes
·
0 Votes
·
0 Comments
·
Hi Dennis,

Please can you add this modified file to the override folder?
I dont want to lost this hack if its not implemented in the eb update.


The same fix will be added into next release of EasyBlog. By the way, may i know where the location of this this override folder?
Please advise.
Sam
·
Monday, 19 October 2015 19:37
·
0 Likes
·
0 Votes
·
0 Comments
·
/public_html/xyz.com/templates/cd_propert.../html/com_easyblog
·
Monday, 19 October 2015 20:22
·
0 Likes
·
0 Votes
·
0 Comments
·
Hey Dennis,

I will mark this thread as resolved and lock it to avoid any confusions in the future, but if you need any help please feel free to start a new thread in our forums.
·
Tuesday, 20 October 2015 09:54
·
0 Likes
·
0 Votes
·
0 Comments
·
View Full Post