Syntax checking/Parser
Contents
TODO
Refactoring
- change indirect inheritance of EIFFEL_PARSER_SKELETON via EIFFEL_PARSER_ERROR_REPORTER in EIFFEL_PARSER.
report a lot more errors
classes with errors to check if parser works
- See this post on the es-devel mailing list. It's probably better to wait, as we don't really have too much time left.
Important Classes/Files
eiffel.y / eiffel.l
- Eiffel grammar description.
- create EIFFEL_SCANNER, EIFFEL_PARSER and EIFFEL_TOKENS from these files using the makefile in $EIFFEL_SRC/Eiffel/parser/parser/
EIFFEL_TOKENS
- defines the tokens
EIFFEL_SCANNER
- reads list of tokens from file/string
EIFFEL_PARSER
- inherits from EIFFEL_PARSER_SKELETON (where the features parse, parse_string, make_with_factory are implemented)
- make_with_factory (a_factory: AST_FACTORY): give argument of type AST_NULL_FACTORY (inherits from AST_FACTORY)
- AST_NULL_FACTORY doesn't build an AST (AST_FACTORY does, the AST is in EIFFEL_PARSER.root_node after parsing)
- parse (a_file: KL_BINARY_INPUT_FILE) and parse_from_string (a_string: STRING).
EIFFEL_PARSER_ERROR_REPORTER
- provides error reporting features (report_*)
EIFFEL_AST
- base class of AST nodes
ERROR
- deferred; superclass of all error types like EIFFEL_ERROR or SYNTAX_ERROR
- features line, column: INTEGER give location of error
ERROR_HANDLER
- feature error_list: ERROR is a list of errors found by the parser
SHARED_ERROR_HANDLER
- singleton used by all relevant classes
EIFFEL_CLASS_C
- features build_ast and parse_ast show how the parser can be used.
creating a project that uses the parser
The new build (June 11 2006) finally has the new system configuration GUI. It's quite easy to create a project that uses the parser:
- set ISE_LIBRARY to your checkout (ie. the directory that contains the 'library' subdirectory)
- start EiffelStudio and create a new project
- open Project > Project settings...
- go to Target > Group (on the left)
- click on the library icon (the one with books on it) and add the gobo library
- click on the icon again, type 'parser' in the Name field and set the location to $ISE_LIBRARY/Eiffel/parser/parser.ecf
Now you can use the parser.
Tools
Grammar definition file (eiffel.y)
some general information:
- capitalized names like TE_STR_LT are tokens. Search for them in eiffel.l (lower case L):
\""<"\" {
ast_factory.set_buffer (token_buffer2, Current)
last_token := TE_STR_LT
}
So TE_STR_LT corresponds to '<' (\""<"\" is a regular expression)
- all other names are non-terminals, so you can find them in eiffel.y. If you don't know what a non-terminal means, you can always look it up in eiffel.y or ask the person responsible for that part of the file.
changes
There are several types of changes we can do to the eiffel.y file while merging Paul's eiffel.y and the current eiffel.y:
renaming
This doesn't really change the functionality and shouldn't really be a problem.
Example: Paul renamed infix_operator to infix_string (for whatever reasons).
new non-terminals
new Non-terminals are introduced because they simplify an existing rule or simplify error handling.
Example:
current version:
Default_manifest_string:
Non_empty_string
{ $$ := $1 }
| TE_EMPTY_STRING
{
$$ := ast_factory.new_string_as ("", line, column, string_position, position + text_count - string_position, token_buffer2)
}
| TE_EMPTY_VERBATIM_STRING
{
$$ := ast_factory.new_verbatim_string_as ("", verbatim_marker.substring (2, verbatim_marker.count), not has_old_verbatim_strings and then verbatim_marker.item (1) = ']', line, column, string_position, position + text_count - string_position, token_buffer2)
}
;
changed to:
Default_manifest_string:
Non_empty_string
{ $$ := $1 }
| Empty_string
{ $$ := $1 }
;
Empty_string:
TE_EMPTY_STRING
{ $$ := ast_factory.new_string_as ("", line, column, string_position, position + text_count - string_position, token_buffer2) }
| TE_EMPTY_VERBATIM_STRING
{ $$ := ast_factory.new_verbatim_string_as ("", verbatim_marker.substring (2, verbatim_marker.count), not has_old_verbatim_strings and then verbatim_marker.item (1) = ']', line, column, string_position, position + text_count - string_position, token_buffer2) }
;
new rules for error handling
Rules added to non-terminals to do error handling
Example:
current Obsolete non-terminal:
Obsolete: -- Empty
-- { $$ := Void }
| TE_OBSOLETE Manifest_string
{
$$ := ast_factory.new_keyword_string_pair ($1, $2)
}
;
Paul's Obsolete non-terminal:
Obsolete: -- Empty
-- { $$ := Void }
| TE_OBSOLETE Manifest_string
{
$$ := ast_factory.new_keyword_string_pair ($1, $2)
}
| TE_OBSOLETE error { report_expected_after_error (parser_errors.obsolete_keyword, $1, parser_errors.obsolete_string, False) }
;
changed error handling
Already existing error handling in eiffel.y is usually longer than Paul's error handling. That's mainly because he put that code into features.
Example:
current version:
Inheritance: -- Empty
-- { $$ := Void }
| TE_INHERIT ASemi
{
if has_syntax_warning then
Error_handler.insert_warning (
create {SYNTAX_WARNING}.make (line, column, filename,
"Use `inherit ANY' or do not specify an empty inherit clause"))
end
--- $$ := Void
$$ := ast_factory.new_eiffel_list_parent_as (0)
if $$ /= Void then
$$.set_inherit_keyword ($1)
end
}
[...]
;
Paul's version:
Inheritance: -- Empty
-- { $$ := Void }
| TE_INHERIT ASemi
{
report_warning (parser_errors.empty_inherit_clause_warning, Void)
$$ := ast_factory.new_eiffel_list_parent_as (0)
if $$ /= Void then
$$.set_inherit_keyword ($1)
end
}
[...]
;
BON diagrams
Parser
SYNTAX_MESSAGE descendants
