You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
23 lines
519 B
23 lines
519 B
7 months ago
|
(*===----------------------------------------------------------------------===
|
||
|
|
* Lexer Tokens
|
||
|
|
*===----------------------------------------------------------------------===*)
|
||
|
|
|
||
|
|
(* The lexer returns these 'Kwd' if it is an unknown character, otherwise one of
|
||
|
|
* these others for known things. *)
|
||
|
|
type token =
|
||
|
|
(* commands *)
|
||
|
|
| Def | Extern
|
||
|
|
|
||
|
|
(* primary *)
|
||
|
|
| Ident of string | Number of float
|
||
|
|
|
||
|
|
(* unknown *)
|
||
|
|
| Kwd of char
|
||
|
|
|
||
|
|
(* control *)
|
||
|
|
| If | Then | Else
|
||
|
|
| For | In
|
||
|
|
|
||
|
|
(* operators *)
|
||
|
|
| Binary | Unary
|