Java library to extract links such as URLs and email addresses from plain text. It's smart about where a link ends, such as with trailing punctuation.
You might think: "Do I need a library for this? I can just write a regex for this!". Let's look at a few cases:
- In text like
https://example.com/.the link should not include the trailing dot https://example.com/,should not include the trailing comma(https://example.com/)should not include the parens
Seems simple enough. But then we also have these cases:
https://en.wikipedia.org/wiki/Link_(The_Legend_of_Zelda)should include the trailing parenhttps://üñîçøðé.com/äshould also work for Unicode (including Emoji and Punycode)<https://example.com/>should not include angle brackets
This library behaves as you'd expect in the above cases and many more. It parses the input text in one pass with limited backtracking.
Thanks to Rinku for the inspiration.
This library is supported on Java 11 or later. It works on Android (minimum API level 19). It has no external dependencies.
Maven coordinates (see here for other build systems):
<dependency>
<groupId>org.nibor.autolink</groupId>
<artifactId>autolink</artifactId>
<version>0.11.0</version>
</dependency>Extracting links:
import org.nibor.autolink.*;
var input = "two links: https://test.com and https://example.com";
var linkExtractor = LinkExtractor.builder()
.linkTypes(EnumSet.of(LinkType.URL)) // limit to URLs
.build();
var links = new ArrayList<>();
for (var span : linkExtractor.extractLinks(input)) {
var link = input.substring(span.getBeginIndex(), span.getEndIndex());
links.add(link);
}
links; // List.of("https://test.com", "https://example.com")Note that by default all supported types of links are extracted. If
you're only interested in specific types, narrow it down using the
linkTypes method.
The above returns all the links. Sometimes what you want to do is go over some input,
process the links and keep the surrounding text. For that case,
there's an extractSpans method.
Here's an example of using that to transform the text to HTML and wrapping URLs in
an <a> tag (escaping is done using owasp-java-encoder):
import org.nibor.autolink.*;
import org.owasp.encoder.Encode;
String input = "wow http://test.com such linked";
LinkExtractor linkExtractor = LinkExtractor.builder()
.linkTypes(EnumSet.of(LinkType.URL)) // limit to URLs
.build();
Iterable<Span> spans = linkExtractor.extractSpans(input);
StringBuilder sb = new StringBuilder();
for (Span span : spans) {
String text = input.substring(span.getBeginIndex(), span.getEndIndex());
if (span instanceof LinkSpan) {
// span is a URL
sb.append("<a href=\"");
sb.append(Encode.forHtmlAttribute(text));
sb.append("\">");
sb.append(Encode.forHtml(text));
sb.append("</a>");
} else {
// span is plain text before/after link
sb.append(Encode.forHtml(text));
}
}
sb.toString(); // "wow <a href=\"http://test.com\">http://test.com</a> such linked"Note that this assumes that the input is plain text, not HTML. Also see the "What this is not" section below.
Extracts URLs of the form scheme://example with any potentially valid scheme.
URIs such as example:test are not matched (may be added as an option in the
future). If only certain schemes should be allowed, the result can be filtered.
(Note that schemes can contain dots, so foo.http://example is recognized as
a single link.)
Includes heuristics for not including trailing delimiters such as punctuation and unbalanced parentheses, see examples below.
Supports internationalized domain names (IDN). Note that they are not validated and as a result, invalid URLs may be matched.
Example input and linked result:
http://example.com.→ http://example.com.http://example.com,→ http://example.com,(http://example.com)→ (http://example.com)(... (see http://example.com))→ (... (see http://example.com))https://en.wikipedia.org/wiki/Link_(The_Legend_of_Zelda)→ https://en.wikipedia.org/wiki/Link_(The_Legend_of_Zelda)http://üñîçøðé.com/→ http://üñîçøðé.com/
Use LinkType.URL for this, and see test
cases here.
Extract links like www.example.com. They need to start with www. but
don't need a scheme://. For detecting the end of the link, the same
heuristics apply as for URLs.
Examples:
www.example.com.→ www.example.com.(www.example.com)→ (www.example.com)[..] link:www.example.com [..]→ [..] link:www.example.com [..]
Not supported:
- Uppercase
www's, e.g.WWW.example.comandwWw.example.com - Too many or too few
w's, e.g.wwww.example.com
The domain must have at least 3 parts, so www.com is not valid, but www.something.co.uk is.
Use LinkType.WWW for this, and see test
cases here.
Extracts emails such as foo@example.com. Matches international email
addresses, but doesn't verify the domain name (may match too much).
Examples:
foo@example.com→ foo@example.comfoo@example.com.→ foo@example.com.foo@example.com,→ foo@example.com,üñîçøðé@üñîçøðé.com→ üñîçøðé@üñîçøðé.com
Not supported:
- Quoted local parts, e.g.
"this is sparta"@example.com - Address literals, e.g.
foo@[127.0.0.1]
Note that the domain must have at least one dot (e.g. foo@com isn't
matched), unless the emailDomainMustHaveDot option is disabled.
Use LinkType.EMAIL for this, and see test cases
here.
This library is intentionally not aware of HTML. If it was, it would need to depend on an HTML parser and renderer. Consider this input:
HTML that contains <a href="https://one.example">links</a> but also plain URLs like https://two.example.
If you want to turn the plain links into a elements but leave the already linked ones intact, I recommend:
- Parse the HTML using an HTML parser library
- Walk through the resulting DOM and use autolink-java to find links within text nodes only
- Turn those into
aelements - Render the DOM back to HTML
See CONTRIBUTING.md file.
Copyright (c) 2015-2022 Robin Stocker and others, see Git history
MIT licensed, see LICENSE file.
