c372d85de2
lex: token representation and quoting stuff
...
* `escape` => `quote` and `quotestr`
`quote` writes the result to a I/O handle, `quotestr` returns it as a
heap-allocated string.
* `tokstr` => `tokrepr` and `tokstr`
same deal
2024-12-07 21:27:23 -03:00
7506679f54
lex: tokstr now prints escaped strings
...
this should be the final thing to make [[tokstr]] print syntactically-valid
tokens in all cases
2024-12-06 13:56:26 -03:00
b09e0b37fb
lex: move token pretty-printing to another file
2024-12-05 22:31:33 -03:00
d7b6b380fe
lex: rework types
2024-12-05 22:06:21 -03:00
bdfaa4f1ab
parse: jfdshks
2024-12-05 13:45:11 -03:00
1e5ed47497
parse: show error on test failure
2024-12-05 13:43:31 -03:00
a9a72e8f1f
add unicode escape sequences
2024-12-05 13:43:12 -03:00
b767928130
rename hash literals to pound literals in code
2024-12-05 12:52:02 -03:00
afa2589672
gfjkfsdf
2024-12-05 12:50:29 -03:00
04efdcac8e
add pound literals for booleans and characters
...
replaces the old character literal syntax that i really didn't like and
feels more scheme-ish
2024-12-04 21:40:14 -03:00
1fe5076544
add license :3
2024-12-04 15:02:55 -03:00
696d4910b1
fhdskjgfdsjglfdskjgfd lexer
2024-12-04 14:56:08 -03:00
63fe8290a5
add HAREPATH to makefile for vendored deps
2024-12-04 14:55:59 -03:00
c70ec9f648
Add 'vendor/hare-unicode/' from commit '1488c26f46f7f8568235eaee6224983ac46e78ff'
...
git-subtree-dir: vendor/hare-unicode
git-subtree-mainline: 57979aa6fc1488c26f46
2024-12-04 13:29:21 -03:00
57979aa6fc
finish first implementation of lexer
2024-12-04 13:29:11 -03:00
3efdaf7ade
add readme
2024-12-04 01:36:49 -03:00
85f7875631
initial work on lexer
2024-12-03 23:41:23 -03:00
Drew DeVault
1488c26f46
linebreak: return bytewise position as well
...
Signed-off-by: Drew DeVault <sir@cmpwn.com>
2024-04-17 11:31:28 +02:00
Drew DeVault
9c73c17238
Implement Unicode line breaking algorithm
...
Signed-off-by: Drew DeVault <sir@cmpwn.com>
2024-04-17 11:13:25 +02:00
Drew DeVault
c56f5d40af
unicode::gc: use two-character identifiers
...
Signed-off-by: Drew DeVault <sir@cmpwn.com>
2024-04-16 18:32:11 +02:00
Drew DeVault
8183289d6f
Add line break properties to UCD
...
Signed-off-by: Drew DeVault <sir@cmpwn.com>
2024-04-16 13:17:50 +02:00
Drew DeVault
771e9850fc
unicode: export bidi details
2024-01-26 18:30:39 +01:00
Drew DeVault
2097b64da5
Implement script detection
2024-01-26 11:16:11 +01:00
Drew DeVault
04940cea04
Initial commit
2024-01-25 16:05:58 +01:00
