1. CSS
  2. Flash
  3. HTML
  4. Illustrator
  5. Java
  6. JavaScript
  7. Maya
  8. Photography
  9. Photoshop
  10. PHP
  11. Ruby
  12. Ruby on Rails
  13. 3ds Max

Java: Concurrent WebCrawler

  1. Clicks today:
    0
  2. Clicks this month:
    0
  3. Overall rating:
    3.00/5

Java » Networking — over 6 years ago
The tutorial describes a way to implement a Web Crawler in Java; a program which crawls through the internet and indexes web pages for later retrieval by a search engine. The focus is on proper concurrency - that is how to process multiple links at the same time using a breadth-first algorithm without running into threading issues. For now, the links are graphed out and displayed, simple indexing will be implemented in subsequent versions.

Comments

Your Comment

You must be logged in to post a comment.