Programming Assignment 3 (P3)
CS536-S24 Intro to PLs and Compilers
Due Friday, March 15 at 11:59 pm
Overview
For this assignment you will use the parser-generator Java CUP to write a parser for the base language. The parser will find syntax errors and, for syntactically correct programs, it will build an abstract-syntax tree (AST) representation of the program. You will also write methods to unparse the AST built by your parser and an input file to test your parser. A main program, P3.java, that calls the parser and then the unparser is provided for you to use. You will be graded on the correctness of your parser and your unparse methods and on how thoroughly your input file tests the parser. In particular, you should write an input file that causes the action associated with every grammar rule in your Java CUP specification to be executed at least once.
Specifications
Getting started
Operator Precedences and Associativities
Building an AST
Unparsing
Modifying ast.java
Testing
Suggestions for How to Work on This Assignment
Getting Started
Skeleton files on which you should build are in the following zip file:
p3.zip
which contains all the files below:
base.jlex: A JLex specification for the base language (a solution to program 2). Use this if there were problems with your JLex specification.
base.cup: A Java CUP specification for a very small subset of the base language (you will need to add to this file).
base.grammar: A CFG for the base language. Use this to guide the enhancements you make to base.cup.
ast.java: Contains class definitions for the AST structure that the parser will build (you will need to add unparsing code to this file, but you should not add any new classes, fields, or methods).
P3.java: The main program that calls the parser, then, for a successful parse, calls the unparser (no changes needed).
Use make test to run P3 using test.base as the input, and sending the unparsed output to file test.out
Alternatively, run it as follows:
java -cp ./deps:. P3 test.base test.out
Makefile: A Makefile for program 3 (no changes needed).
test.base: Input for the current version of the parser (you will need to change this file).
ErrMsg.java: Same as for program 2 (no changes needed).
Please download and use p3.zip
You can directly start using it without any dependency issues.
Here is a link to the Java CUP reference manual. See also the Java CUP course notes.
Operator Precedences and Associativities
The base grammar in the file base.grammar is ambiguous; it does not uniquely define the precedences and associativities of the arithmetic, relational, equality, and logical operators. You will need to add appropriate precedence and associativity declarations to your Java CUP specification.
Assignment is right associative.
The colon operator is left associative.
The relational and equality operators (<, >, <=, >=, ==, and ~=) are non-associative (i.e., expressions like a < b < c are not allowed and should cause a syntax error).
All of the other binary operators are left associative.
The unary minus and not (~) operators have the highest precedence, then multiplication and division, then addition and subtraction, then the relational and equality operators, then the logical and operator (&), then the logical or operator (|), and finally the assignment operator (=).
Note that the same token (MINUS) is used for both the unary and binary minus operator, and that they have different precedences; however, the base grammar has been written so that the unary minus operator has the correct (highest) precedence; therefore, you can declare MINUS to have the precedence appropriate for the binary minus operator.
Java CUP will print a message telling you how many conflicts it found in your grammar. If the number is not zero, it means that your grammar is still ambiguous and the parser is unlikely to work correctly. Do not ignore this! Go back and fix your specification so that your grammar is not ambiguous.
Building an Abstract-Syntax Tree
To make your parser build an abstract-syntax tree, you must add new productions, declarations, and actions to base.cup. You will need to decide, for each nonterminal that you add, what type its associated value should have. Then you must add the appropriate nonterminal declaration to the specification. For most nonterminals, the value will either be some kind of tree node (a subclass of ASTnode) or a LinkedList of some kind of node (use the information in ast.java to guide your decision). Note that you cannot use parameterized types for the types of nonterminals; so if the translation of a nonterminal is a LinkedList of some kind of node, you will have to declare its type as just plain LinkedList.
You must also add actions to each new grammar production that you add to base.cup. Make sure that each action ends by assigning an appropriate value to RESULT. Note that the parser will return a Symbol whose value field contains the value assigned to RESULT in the production for the root nonterminal (nonterminal program).
Unparsing
To test your parser, you must write the unparse methods for the subclasses of ASTnode (in the file ast.java). When the unparse method of the root node of the program's abstract-syntax tree is called, it should print a nicely formatted version of the program (this is called unparsing the abstract-syntax tree). The output produced by calling unparse should be the same as the input to the parser except that:
1. There will be no comments in the output.
2. The output will be "pretty printed" (newlines and indentation will be used to make the program readable); and
3. Expressions will be fully parenthesized to reflect the order of evaluation.
For example, if the input program includes:
if b == -1 [ x = 4+3*5-y. while c [ y = y*2+x. ] ] else [ x = 0. ]
the output of unparse should be something like the following:
if (b == (-1)) [
x = ((4 + (3 * 5)) - y).
while c [
y = ((y * 2) + x).
]
]
else [
x = 0.
]
To make grading easier, put open square brackets on the same line as the preceding code and put closing square brackets on a line with no other code (as in the example above). Put the first statement in the body of an if or while on the line following the open square bracket. Whitespace within a line is up to you (as long as it looks reasonable).
Note: Trying to unparse a tree will help you determine whether you have built the tree correctly in the first place. Besides looking at the output of your unparser, you should try using it as the input to your parser; if it doesn't parse, you've made a mistake either in how you built your abstract-syntax tree or in how you've written your unparser.
It is a good idea to work incrementally (see Suggestions for How to Work on This Assignment below for more detailed suggestions):
Add a few grammar productions to base.cup.
Write the corresponding unparse operations.
Write a test program that uses the new language constructs.
Create a parser (using make) and run it on your test program.
Modifying ast.java (IMPORTANT)
We will test your program by using our unparse methods on your abstract-syntax trees and by using your unparse methods on our abstract-syntax trees. To make this work, you will need to:
1. Modify ast.java only by filling in the bodies of the unparse methods (and you must fill in all of the method bodies).
2. Make sure that no field is null (i.e., when you call the constructor of a class with a LinkedList argument, that argument should never be null). The only two exceptions to these are ReturnStmtNode and CallExpNode; it is OK to make the ExpNode field of a ReturnStmtNode null (when no value is returned), likewise for the ExpListNode field of a CallExpNode (when the call has no arguments). Thus, you shouldn't be checking to see if a field is null or not, other than in these two nodes.
3. Follow the convention that the mySize field of a VarDeclNode has the value VarDeclNode.NON_TUPLE if the type of the declared variable is a non-tuple type.
Testing
Part of your task will be to write an input file called test.base that thoroughly tests your parser and your unparser. You should be sure to include code that corresponds to every grammar rule in the file base.grammar.
Note that since you are to provide only one input file, test.base should contain no syntax errors (you should also test your parser on some bad inputs, but don't hand those in).
You will probably find it helpful to use comments in test.base to explain what aspects of the parser are being tested, but your testing grade will depend only on how thoroughly the file tests the parser.
Suggestions for How to Work on This Assignment
This assignment involves three main tasks:
1. Writing the parser specification (base.cup).
2. Writing the unparse methods for the AST nodes (in ast.java).
3. Writing an input file (test.base) to test your implementation.
If you work with a partner, it is a good idea to share responsibility for all tasks to ensure that both partners understand all aspects of the assignment.
I suggest that you proceed as follows, testing your parser after each change (if you are working alone, I still suggest that you follow the basic steps outlined below, just do them all yourself):
Working together, start by making a very small change to base.cup. For example, add the rules and actions for:
type ::= INTEGER
type ::= VOID
Also update the appropriate unparse method in ast.java. Make sure that you can create and run the parser after making this small change. (To create the parser, just type make in the directory where you are working.)
Next, add the rules needed to allow tuple declarations.
Next, add the rules needed to allow programs to include functions with no formal parameters and with empty statement lists only, and update the corresponding unparse methods.
Still working together, add the rules (and unparse methods) for the simplest kind of expressions — just plain identifiers.
Now divide up the statement nonterminals into two parts, one part for each person.
Each person should extend their own copy of base.cup by adding rules for their half of the statements, and should extend their own copy of ast.java to define the unparse methods needed for those statements.
Write test inputs for your statements and your partner's statements.
After each person makes sure that their parser and unparser work on their own statements, combine the two by cutting and pasting one person's grammar rules into the other person's base.cup (and similarly for ast.java).
Now divide up the expression nonterminals into two parts and implement those using a similar approach. Note that you will also need to give the operators the right precedences and associativities during this step (see above).
Divide up any remaining productions that need to be added, and add them.
Talk about what needs to be tested and decide together what your final version of test.base should include.
When working on your own, do not try to implement all of your nonterminals at once. Instead, add one new rule at a time to the Java CUP specification, make the corresponding changes to the unparse methods in ast.java, and test your work by augmenting your test.base or by writing a base program that includes the new construct you added, and make sure that it is parsed and unparsed correctly.
If you worked alone on the previous program and are now working with a partner, see Programming Assignment 2 for more suggestions on how to work in pairs.
Handing in
Please read the following handing in instructions carefully.
Turn in the following files to the appropriate assignment in Gradescope (note: these should be the only files changed/needed to run with the provided materials):
ast.java
base.cup
test.base
Please ensure that you do not turn in any sub-directories or put your Java files in any packages.
If you are working in a pair, make sure both partners are indicated when submitting to Gradescope.
Grading criteria
General information on program grading criteria can be found on the Assignments page.
For more advice on Java programming style, see these style and commenting standards (which are essentially identical to the standards used in CS200 / CS300 / CS400).