In compilers design considering that to start building a compiler you need a tokenizer and lexer parsers, but what goes into a fully mature lexer parser?Meaning that if I was to look to build a lexer from scratch for learning purposes, what are design and implementation decisions would go into building a fully matured lexer? Including what should the lexer be capable of (in a more complex scenario)? I understand fundamentally how they work and in both theory, but when developing one, what are other forms of capabilities should they have, and what are ways I can expand my own implementations of the lexers?
In compilers design considering that to start building a compiler you need a tokenizer and lexer parsers, but what goes into a fully mature lexer parser?Meaning that if I was to look to build a lexer from scratch for learning purposes, what are design and implementation decisions would go into building a fully matured lexer? Including what should the lexer be capable of (in a more complex scenario)? I understand fundamentally how they work and in both theory, but when developing one, what are other forms of capabilities should they have, and what are ways I can expand my own implementations of the lexers?
Database System Concepts
7th Edition
ISBN:9780078022159
Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Chapter1: Introduction
Section: Chapter Questions
Problem 1PE
Related questions
Question
In compilers design considering that to start building a compiler you need a tokenizer and lexer parsers, but what goes into a fully mature lexer parser?
Meaning that if I was to look to build a lexer from scratch for learning purposes, what are design and implementation decisions would go into building a fully matured lexer? Including what should the lexer be capable of (in a more complex scenario)?
I understand fundamentally how they work and in both theory, but when developing one, what are other forms of capabilities should they have, and what are ways I can expand my own implementations of the lexers?
Expert Solution
This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
This is a popular solution!
Trending now
This is a popular solution!
Step by step
Solved in 2 steps
Knowledge Booster
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.Recommended textbooks for you
Database System Concepts
Computer Science
ISBN:
9780078022159
Author:
Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:
McGraw-Hill Education
Starting Out with Python (4th Edition)
Computer Science
ISBN:
9780134444321
Author:
Tony Gaddis
Publisher:
PEARSON
Digital Fundamentals (11th Edition)
Computer Science
ISBN:
9780132737968
Author:
Thomas L. Floyd
Publisher:
PEARSON
Database System Concepts
Computer Science
ISBN:
9780078022159
Author:
Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:
McGraw-Hill Education
Starting Out with Python (4th Edition)
Computer Science
ISBN:
9780134444321
Author:
Tony Gaddis
Publisher:
PEARSON
Digital Fundamentals (11th Edition)
Computer Science
ISBN:
9780132737968
Author:
Thomas L. Floyd
Publisher:
PEARSON
C How to Program (8th Edition)
Computer Science
ISBN:
9780133976892
Author:
Paul J. Deitel, Harvey Deitel
Publisher:
PEARSON
Database Systems: Design, Implementation, & Manag…
Computer Science
ISBN:
9781337627900
Author:
Carlos Coronel, Steven Morris
Publisher:
Cengage Learning
Programmable Logic Controllers
Computer Science
ISBN:
9780073373843
Author:
Frank D. Petruzella
Publisher:
McGraw-Hill Education