ThemeForest

API vs SCRAP

2557 posts Nice Guy
  • Most Wanted Bounty Winner
  • Elite Author
  • Sold between 250 000 and 1 000 000 dollars
  • Has been a member for 5-6 years
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Won a Competition
  • Bought between 100 and 499 items
  • Exclusive Author
  • Referred between 200 and 499 users
+5 more
RubenBristian says

I am working on a widget which displays social connections(friends, followers, subscribers, etc..)

And i am having an incredibly hard time with different API’s. In any case, for a user to show his Google+ friends, he has to create an API key and so on.. I mean, it’s harder both for the user(novice users will have to create facebook/google/linkedin/etc applications and api keys) both for me..

So in this case, is scraping a good approach?

235 posts
  • Exclusive Author
  • Has been a member for 0-1 years
crossroad says

Yes thats very painful. For example, if you want to get any info from facebook graph (except very basic), your widget would require that the user creates the facebook app, and set some specific privacy settings so that you are able to get the required settings. Most of the users face a lot of difficulties in that and end up complaining that it doesn’t work.

And no, scrapping is not good approach at all.

168 posts
  • Has been a member for 0-1 years
  • Europe
  • Sold between 10 000 and 50 000 dollars
  • Exclusive Author
  • Bought between 1 and 9 items
SakuraPixel says

I think you need a service similar to http://singly.com (guess they handle only mobile apps).

404 posts
  • Elite Author
  • Sold between 100 000 and 250 000 dollars
  • Won a Competition
  • Referred between 500 and 999 users
  • Author had a Free File of the Month
  • Author had a File in an Envato Bundle
  • Bought between 10 and 49 items
+3 more
pixelentity says

twitter did the same thing, you can no longer fetch latest tweets without oauth/apikey and also required to store the content (because the per hour fetch limit restrictions) so a js only solution is out of question.

item support is already hard enough so we decided to just remove all social related custom widgets from our themes and buyers will have to rely on 3rd party plugins for this kind of features.

BF

2557 posts Nice Guy
  • Most Wanted Bounty Winner
  • Elite Author
  • Sold between 250 000 and 1 000 000 dollars
  • Has been a member for 5-6 years
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Won a Competition
  • Bought between 100 and 499 items
  • Exclusive Author
  • Referred between 200 and 499 users
+5 more
RubenBristian says

item support is already hard enough so we decided to just remove all social related custom widgets from our themes and buyers will have to rely on 3rd party plugins for this kind of features.

I found a social widget which is scrapping(it only shows the number of friends/fans/etc..).. This is what i’m also looking for, but don’t know if i should include it or not..

404 posts
  • Elite Author
  • Sold between 100 000 and 250 000 dollars
  • Won a Competition
  • Referred between 500 and 999 users
  • Author had a Free File of the Month
  • Author had a File in an Envato Bundle
  • Bought between 10 and 49 items
+3 more
pixelentity says

I found a social widget which is scrapping
regexping the html is too prone to errors, any random markup change would break the plugin. I’d avoid it

BF

779 posts
  • Sold between 1 000 and 5 000 dollars
  • Most Wanted Bounty Winner
  • Has been a member for 4-5 years
  • Referred between 1 and 9 users
  • Microlancer Beta Tester
  • Serbia
  • Exclusive Author
aleluja says

Imagine all the support requests coz html changed. And you have to debug it. Every time. The users would be angry if you disable the feature.

235 posts
  • Exclusive Author
  • Has been a member for 0-1 years
crossroad says

In addition, its simply against the terms of service of most of these sites.

769 posts
  • Bought between 1 and 9 items
  • Exclusive Author
  • Has been a member for 1-2 years
  • Microlancer Beta Tester
  • Most Wanted Bounty Winner
  • Referred between 50 and 99 users
  • Romania
+1 more
Pricop says

Scraping is not a good idea and as crossroad said it’s against their ToS for sure.

by
by
by
by
by