Skip to content

Commit

Permalink
update packages
Browse files Browse the repository at this point in the history
  • Loading branch information
nkrusch committed Apr 10, 2020
1 parent ae1eb89 commit fe71675
Show file tree
Hide file tree
Showing 3 changed files with 1,499 additions and 1,415 deletions.
19 changes: 19 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,3 +24,22 @@ I make a lot of web apps using react and angular. I know there are dev tools tha
This extension works by taking some start URL, crawling that page for more links, and then recursively crawling those pages for more links. Once all found links have been checked, the extension generates a sitemap file. Of course this approach assumes website is properly using anchor tags to connect its contents. The extension also checks HTTP headers and excludes pages that return failing response codes.

This implementation is not practical if website contains tens of thousands of pages. It can however, crawl a few thousand entries in a reasonable amount of time. Also note while the sitemap is being generated, you may continue regular browsing at the same time. The generator will run in its own window.


# Development

```text
npm install
```

Debug:

```text
npm run start
```

Build:

```text
npm run build
```
Loading

0 comments on commit fe71675

Please sign in to comment.