1. CSS
  2. Flash
  3. HTML
  4. Illustrator
  5. Java
  6. JavaScript
  7. Maya
  8. Photography
  9. Photoshop
  10. PHP
  11. Ruby
  12. Ruby on Rails
  13. 3ds Max


Sorry, but your account doesn't have permission to do that.

Java: Concurrent WebCrawler

  1. Clicks today:
    0
  2. Clicks this month:
    4
  3. Overall rating:
    3.00/5

Java » Networking — 10 months ago
The tutorial describes a way to implement a Web Crawler in Java; a program which crawls through the internet and indexes web pages for later retrieval by a search engine. The focus is on proper concurrency - that is how to process multiple links at the same time using a breadth-first algorithm without running into threading issues. For now, the links are graphed out and displayed, simple indexing will be implemented in subsequent versions.

Comments

Your Comment

You must be logged in to post a comment.