Yes, we use ANTLR 4 to implement Ballerina Grammer…

Yes when we need to analyze the tokens in a context and find the scope that these tokens are in we use tokenStream but most of the cases we use the AST(abstract syntax tree) that we generated after parsing a source file to give completions, definitions, references and hover.