feat(yaml): lexer that can lex very simple examples

[dyc3]

Summary

I figured I'd take a stab at building the lexer based on the grammar in #3400. It's somewhat inspired by the json lexer. I'm posting it early here so people can see it, and avoid duplicated effort.

related to: #2365

Test Plan

Added some unit tests, and they all pass.

[codspeed-hq]

CodSpeed Performance Report

Merging #3430 will not alter performance

_{Comparing dyc3:07-13-feat_yaml_lexer_that_can_lex_very_simple_examples (b143aed) with main (88f1d5e)}

Summary

✅ 101 untouched benchmarks

[ematipico]

The JSON lexer is old and it hasn't been refactored yet.

In the meantime, we created a proper infrastructure for creating a lexer, and this is documented in the CONTRIBUTING.md file of the biome_parser crate. It is possible to reach this document from the main CONTRIBUTING.md, at the root of the repository.

The new infrastructure gives you many methods that you don't need to implement again, e.g. peek_byte, consume_whitespace

Also, avoid unchecked methods whenever possible.

[dyc3]

in the CONTRIBUTING.md file of the biome_parser crate.

Yeah that's the document I was referencing when writing this. That, and looking at the json lexer. Is there anything more than the "Implement a lexer" section of that doc? It's a little sparse on info.

[ematipico]

Unfortunately that part still lacks some documentation due to some recent refactors. I completely forgot to follow up and add more to it

[ematipico]

I suggest looking at the GraphQL parser and tokenizer. It's the most recent one

[Netail]

@dyc3 any progress? 😅

[dyc3]

I haven't had time recently, but I could try and get this merged this week.