kitty/gen
Kovid Goyal b815054414
Much faster SIMD UTF-8 decoding of valid UTF-8
Decode 64 byte blocks of valid UTF-8 containing no ESC using the
approach of simdutf: blocks are validated with the lookup tables of
Keiser and Lemire and converted twelve bytes at a time using shuffles
looked up from a mask of the bytes that end code points, with fast
paths for runs of ASCII, two byte and three byte sequences. Anything
else, ESC, invalid UTF-8 and the end of the input, is decoded as
before.

The shuffle tables are generated by gen/utf8_decode_tables.py.

This decodes the text of the unicode benchmark 2.6 times faster, faster
than simdutf's own conversion with error checking, and speeds up the
unicode benchmark by ~8%.

The new AVX2 decoder is faster than the AVX-512 one, so remove the
AVX-512 decoder and use the AVX2 one on CPUs with AVX-512 as well.

Also add a test comparing the SIMD decoders with the scalar one on long
inputs, which exercise the decoding of blocks, as the existing tests use
short inputs.
2026-11-16 13:43:39 +05:30
..
__init__.py
__main__.py Much faster SIMD UTF-8 decoding of valid UTF-8 2026-11-16 13:43:39 +05:30
apc_parsers.py Graphics protocol: Add sub-feature querying 2026-10-25 09:59:12 +05:30
bitfields.py autoformat 2026-08-05 05:32:56 +05:30
color_names.py autoformat 2026-08-05 05:32:56 +05:30
config.py set-colors: Clean up parsing of colors and conf files 2026-10-20 07:32:15 +05:30
cursors.py handle unknown pointer names in OSC 22 more gracefully 2026-08-19 04:56:27 +05:30
go_code.py Add nightly version to version string for nightly builds. Fixes #10751 2026-10-27 10:43:51 +05:30
key_constants.py autoformat 2026-08-05 05:32:56 +05:30
README.rst
rowcolumn-diacritics.txt
srgb_lut.py Move the kitty OpenGL code into a dynamically loaded GPU driver 2026-11-16 13:43:36 +05:30
utf8_decode_tables.py Much faster SIMD UTF-8 decoding of valid UTF-8 2026-11-16 13:43:39 +05:30
wcwidth.py Cleanup previous PR and make VS15 on explicit width cell behavior consistent with VS16 2026-09-18 22:59:19 +05:30

Scripts to generate code for various things like keys, mouse cursors, unicode
data etc. Some of these generate code that is checked into version control.
Some generate ephemeral code used during builds. Ephemeral code is in files
with a _generated.[h|go|c] extension.