Implemented model-file tokenizer that has abilities to tokenize comments and splits token by spaces.

Fork: 1

nitta-lab / AlgebraicDataflowArchitectureModel

Browse code Implemented model-file tokenizer that has abilities to tokenize comments and splits token by spaces. language-server
1 parent 727413a commit e6e20d23f6950189e092fac94fae0807a9c2db49 Shohei Yamagiwa authored 4 days ago

Patch

Unified Split

Showing 4 changed files

Ignore Space Show notes View LanguageServer/src/main/java/org/nittalab/dtram/languageserver/model/Position.java 0 → 100644

Ignore Space Show notes View LanguageServer/src/main/java/org/nittalab/dtram/languageserver/model/Token.java 0 → 100644

Ignore Space Show notes View LanguageServer/src/main/java/org/nittalab/dtram/languageserver/model/Tokens.java 0 → 100644

Ignore Space Show notes View LanguageServer/src/main/java/org/nittalab/dtram/languageserver/utils/Tokenizer.java 0 → 100644

Show line notes below