The theoretical foundations of compiler design are rooted in formal language theory, automata theory, and computability theory. The syntax of a programming language is typically defined using a context-free grammar (CFG), which provides a formal description of the language's structure. The CFG is used to generate a parser, which analyzes the source code and checks its syntax.