2025-04-07
Implemented basic semantic tokens.
Shohei Yamagiwa committed 8 days ago
2025-04-06
Created semantic analyzer to be able to make tokens of atomic, string and type tokens semantic
Shohei Yamagiwa committed 8 days ago
Created semantic token based from Token.java
Shohei Yamagiwa committed 8 days ago
Moved some tokens from Tokens.java to Constants.java, Functions.java and Types.java
Shohei Yamagiwa committed 8 days ago
Moved comment tokens from Tokens.java to Comments.java
Shohei Yamagiwa committed 9 days ago
Separate tokens into Tokens.java, Keywords.java and Operators.java
Shohei Yamagiwa committed 9 days ago
Added package-info.java
Shohei Yamagiwa committed 9 days ago
Changed method signatures
Shohei Yamagiwa committed 9 days ago
Optimized some codes in Tokenizer#execute
Shohei Yamagiwa committed 9 days ago
Optimized some codes in Tokenizer#splitBySpace
Shohei Yamagiwa committed 9 days ago
Changed the way to split tokens by symbols and fixed known bugs.
Shohei Yamagiwa committed 9 days ago
Removed some regex constants.
Shohei Yamagiwa committed 9 days ago
Use String#length instead of String#codePointCount
Shohei Yamagiwa committed 9 days ago
2025-04-05
Tokenizer#splitBySymbol is still buggy.
Shohei Yamagiwa committed 10 days ago
2025-04-04
Changed access modifiers to be able to access methods in Tokenizer.java from TokenizerTest.java
Shohei Yamagiwa committed 10 days ago
Implemented Tokenizer#splitBySymbols to be able to tokenize by more symbols.
Shohei Yamagiwa committed 11 days ago
Implemented equals() to test in JUnit 5.
Shohei Yamagiwa committed 11 days ago
Implemented new constructor and fixed toString() and JavaDoc comments.
Shohei Yamagiwa committed 11 days ago
Added Position#move method.
Shohei Yamagiwa committed 11 days ago
Renamed some fields and methods in Token.java.
Shohei Yamagiwa committed 11 days ago
Made simple test-case for tokenizer.
Shohei Yamagiwa committed 11 days ago
Implemented model-file tokenizer that has abilities to tokenize comments and splits token by spaces.
Shohei Yamagiwa committed 11 days ago
Made skeleton of a model-file validator.
Shohei Yamagiwa committed 11 days ago
Implemented LSP4J to be able to launch basic language server.
Shohei Yamagiwa committed 11 days ago