Tokenizer results

Test conditions

• Release mode: -O3 -DNDEBUG

Results

|Commit|Setup|Compiler|identifiers|integers|floats|floats_exp|strings|chars|others| |---|---|---|---|---|---|---|---|---|---|---| |b16d16a|1|GCC 6.2.1|930 ns|4364 ns|6707 ns|7000 ns|486 ns|471 ns|1615 ns| |655842a|1|GCC 6.2.1|902 ns|572 ns|804 ns|1008 ns|485 ns|474 ns|1632 ns| |50e2063|1|GCC 6.2.1|863 ns|550 ns|777 ns|1011 ns|461 ns|463 ns|1484 ns| |0cbb504|1|GCC 6.2.1|853 ns|377 ns|622 ns|878 ns|464 ns|417 ns|1430 ns| |cf90031|1|GCC 6.2.1|794 ns|430 ns|676 ns|902 ns|514 ns|451 ns|1613 ns| |655842a|3|GCC 5.4.0|730 ns|437 ns|592 ns|747 ns|373 ns|401 ns|1672 ns| |50e2063|3|GCC 5.4.0|875 ns|421 ns|657 ns|819 ns|385 ns|363 ns|1587 ns|

Notes

• b16d16a - First version
• 655842a - Removed stream for parsing numbers
• 50e2063 - Iterator functions made inline
• 0cbb504 - Optimized function for parsing numbers

Setups

Setup #1

• ArchLinux x86_64

lscpu

Architecture:          x86_64
CPU(s):                4
Thread(s) per core:    1
Model name:            AMD Phenom(tm) II X4 945 Processor
CPU max MHz:           3000.0000
CPU min MHz:           800.0000
L1d cache:             64K
L1i cache:             64K
L2 cache:              512K
L3 cache:              6144K

Setup #2

• ArchLinux x86_64

lscpu

Architecture:          x86_64
CPU(s):                2
Thread(s) per core:    1
Model name:            Intel(R) Core(TM)2 Duo CPU T5470
CPU max MHz:           1600.0000
CPU min MHz:           800.0000
L1d cache:             32K
L1i cache:             32K
L2 cache:              2048K

Setup #3

• Linux Mint 18 x86_64

lscpu

Architecture:          x86_64
CPU(s):                4
Thread(s) per core:    2
Core(s) per socket:    2
Model name:            Intel(R) Core(TM) i5-3340M CPU @ 2.70GHz
CPU MHz:               2579.976
CPU max MHz:           3400.0000
CPU min MHz:           1200.0000
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              3072K