Skip to content

MurrayFurtado/wipro

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

wipro

Installation Run mvn clean install to build the code and run the tests.

WebCrawler is built using the JSoup HTML parser (https://jsoup.org/) and will output to a text file in the project directory. It allows an arbitary URL to be passed as a command line parameter and will traverse subpages in the same domain.

The processDocument() method has been made public to allow junit to test this method. This is due to the difference in the way the JSoup api loads html from a url vs file.

It is assumed that all urls should be output as absolute.

I've included only one test but this exercises the bulk of the code but only at the top level of a page heirarchy, due to the time restriction on the exercise.

About

Web Crawler Implementation in Java

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published