725 posts WordPress Ninja
  • Has referred 1000+ members
  • Has sold $250,000+ on Envato Market
  • Has been a beta tester for an Envato feature
  • Has collected 10+ items on Envato Market
+8 more
TylerQuinn says

@Tyler

My crawler works in this way:

  1. input the string you want to search e.g. “ComCate – Premium Business Theme”.
  2. filter the first 100 results in google and give back all links.
  3. loop through the websites and search for links to the different filehosts.
  4. Give back all links to the filehosts.

I think this service eats a lot of bandwith because it checks the html of 100 websites. I haven’t done any analytics yet but let’s say an average website is 30kb big (without images) and you check 100 of them you end up with 3mb. If you have 1000 users it would be 3000mb :)

The method I used is a little bit ineffective but I don’t know how to do it another way…

It would most likely be done in batches for the service but thats what I have been tooling with. Right now the wall I am running into is pragmatically figuring out which links belong to the actual file I am looking for. Sending hundreds of DMCA ’s out to links that are not for the file in question could get me in some murky waters :)

1799 posts
  • Has referred 1+ members
  • Has sold $5,000+ on Envato Market
  • Has been a beta tester for an Envato feature
  • Has collected 10+ items on Envato Market
+4 more
BroOf says


@Tyler

My crawler works in this way:

  1. input the string you want to search e.g. “ComCate – Premium Business Theme”.
  2. filter the first 100 results in google and give back all links.
  3. loop through the websites and search for links to the different filehosts.
  4. Give back all links to the filehosts.

I think this service eats a lot of bandwith because it checks the html of 100 websites. I haven’t done any analytics yet but let’s say an average website is 30kb big (without images) and you check 100 of them you end up with 3mb. If you have 1000 users it would be 3000mb :)

The method I used is a little bit ineffective but I don’t know how to do it another way…
It would most likely be done in batches for the service but thats what I have been tooling with. Right now the wall I am running into is pragmatically figuring out which links belong to the actual file I am looking for. Sending hundreds of DMCA ’s out to links that are not for the file in question could get me in some murky waters :)

Yeah I know ;)

15 posts
  • Has been part of the Envato Community for over 5 years
  • Has sold $5,000+ on Envato Market
  • Has collected 10+ items on Envato Market
  • Sells items exclusively on Envato Market
+1 more
JustLikeThat says

I was having the same idea but i wasn’t sure if it could bring profit…

I’ve implemented a piece of software that crawls pages for links and makes a list of them…

36 posts
  • Has been part of the Envato Community for over 4 years
  • Has sold $10,000+ on Envato Market
  • Has collected 1+ items on Envato Market
  • Sells items exclusively on Envato Market
+2 more
hunzonian says

Is this service for the USA only? Just wondering because DMCA is a U.S. law. Do you also handle requests for offshore infringements?

cloud9communication
cloud9communication Recent Posts Threads Started
599 posts
  • Has referred 10+ members
  • Has sold $10,000+ on Envato Market
  • Has collected 10+ items on Envato Market
  • Located in India
+3 more
cloud9communication says

count me in If I am not late :-(

3135 posts
  • Has been part of the Envato Community for over 5 years
  • Has sold $1,000+ on Envato Market
  • Has been a beta tester for an Envato feature
  • Has collected 500+ items on Envato Market
+4 more
Daniel_R says

why use this tool instead of the http://killer.freshface.cz/ ?

you gotta always be so negative….

584 posts
  • Has been part of the Envato Community for over 5 years
  • Has referred 1+ members
  • Has sold $1,000+ on Envato Market
  • Has collected 10+ items on Envato Market
+3 more
SparkyFlash says

Would love to test the software as well. I can help with translating it to Russian, if needed.

64 posts
  • Has referred 500+ members
  • Has sold $100+ on Envato Market
  • Has collected 1+ items on Envato Market
  • Sells items exclusively on Envato Market
+4 more
mackaymusic says

I would like. Now it is possible?

725 posts WordPress Ninja
  • Has referred 1000+ members
  • Has sold $250,000+ on Envato Market
  • Has been a beta tester for an Envato feature
  • Has collected 10+ items on Envato Market
+8 more
TylerQuinn says

Is this service for the USA only? Just wondering because DMCA is a U.S. law. Do you also handle requests for offshore infringements?

100% I know not every site makes it easy to send notices but I am constantly adding new file hosts to the list. You can also use the email templates feature to save templates in other languages.

I am close to opening registration up and letting people in however I do plan on capping it at like 1,00 members to stress test.

725 posts WordPress Ninja
  • Has referred 1000+ members
  • Has sold $250,000+ on Envato Market
  • Has been a beta tester for an Envato feature
  • Has collected 10+ items on Envato Market
+8 more
TylerQuinn says

Registrations are open for a limited time. I have not made any announcements anywhere so get in while you can!

by
by
by
by
by
by