Thursday 15 September 2011

java - Web crawling few websites and searching their content -


I intend to create a website that provides a brief content of specific webpages in specific websites.

So instead of relying on Google or Bing API (which costs money), I thought of searching for a web crawler and a search engine that could do this, I could only use it on a small scale Need for, for example, Apache is too big for example.

The ideal solution will be an embedded library that will receive the list of websites, retrieve their content and save them in DB. Any suggestions for searching later?

Do you mean that you intend to create a service that Does the essence? Here are some APIs you can do:

  • And some of your own:

  • The last 2 were the excellent tutorials to make your own blending Based on -

No comments:

Post a Comment