Question

I have a lexical analyser written in flex that passes tokens to my parser written in bison.

The following is a small part of my lexer:

ID [a-z][a-z0-9]*

%%

rule {
    printf("A rule: %s\n", yytext);
    return RULE;
}

{ID} { 
    printf( "An identifier: %s\n", yytext );
    return ID;
}

"(" return LEFT;
")" return RIGHT;

There are other bits for parsing whitespace etc too.

Then part of the parser looks like this:

%{
#include <stdio.h>
#include <stdlib.h>
#define YYSTYPE char*
%}

%token ID RULE 
%token LEFT RIGHT 

%%

rule_decl : 
    RULE LEFT ID RIGHT { printf("Parsing a rule, its identifier is: %s\n", $2); }
    ;

%%

It’s all working fine but I just want to print out the ID token using printf – that’s all :). I’m not writing a compiler.. it’s just that flex/bison are good tools for my software. How are you meant to print tokens? I just get (null) when I print.

Thank you.

Answer 1

I’m not an expert at yacc, but the way I’ve been handling the transition from the lexer to the parser is as follows: for each lexer token, you should have a separate rule to “translate” the yytext into a suitable form for your parser. In your case, you are probably just interested in yytext itself (while if you were writing a compiler, you’d wrap it in a SyntaxNode object or something like that). Try

%token ID RULE 
%token LEFT RIGHT

%%

rule_decl:
    RULE LEFT id RIGHT { printf("%s\n", $3); }

id:
    ID { $$ = strdup(yytext); }

The point is that the last rule makes yytext available as a $ variable that can be referenced by rules involving id.