Organization of a Natural Language Understanding (NLU) System: Diagrammed Architecture

A Natural Language Understanding NLU system is typically organized as a pipeline of modules that: (1) preprocess raw text, (2) extract linguistic features, (3) produce structured semantic outputs (e.g., intents, entities, slots), and (4) hand off to a downstream dialogue or action component. Many modern systems combine classic NLP steps with neural models (e.g., Transformers) and then route outputs to intent/slot logic.

Below is a representative “reference architecture” that covers both single-turn understanding and multi-turn dialogue context.

Key design idea: NLU outputs are usually structured (e.g., an “intent” label plus a set of “entities/slots”) rather than free-form text, enabling deterministic and testable downstream behavior.

Major concepts (as terms you’ll see in architectures):

• Intent
• Entity
• Slot
• Dialogue state

Core Modules and Their Responsibilities

1) Input handling & normalization

NLU systems commonly begin with normalization such as handling casing, punctuation, whitespace, and sometimes domain-specific cleanup (e.g., mapping “$50” to a numeric token). This improves the stability of later tokenization and model inference.

Common outputs from this stage

• Cleaned text
• Token boundaries (wordpieces/subwords)
• Optional linguistic annotations

Key terms

• Tokenization
• Text normalization
• Preprocessing

---

2) Encoder / feature extractor

Most modern NLU systems use a learned encoder (often a Transformer) that maps token sequences to contextual embeddings. These embeddings capture meaning beyond local word identity.

The encoder feeds multiple “heads” (task-specific classifiers/labelers). This is typical of multi-task NLU designs: the same representation supports intent classification and sequence labeling for entities/slots.

Key terms

• Transformer encoder
• Contextual embeddings

---

3) Task heads (semantic extraction)

This is where NLU produces structured meaning.

Intent classification (single label)

Assigns one intent (e.g., BookFlight, CancelOrder) to the whole utterance.

Entity recognition (span tagging)

Labels spans (e.g., city=Paris) and maps them to entity types.

Slot filling (often sequence labeling)

For a specific intent, slot filling extracts arguments in a structured schema (e.g., destination, date, passengers). In many assistants, slot schema depends on the recognized intent (or is trained jointly).

(Optional) Relation extraction / semantic parsing

Some systems go further by extracting relations between entities or constructing a formal meaning representation.

Key terms

• Sequence labeling
• Classification head
• Span extraction

---

4) Semantic frame construction

The outputs from heads are merged into a “semantic frame” object, such as:

• intent: best intent label
• entities: typed spans
• slots: filled arguments for the current intent schema
• confidence: per-task scores

This frame becomes the core NLU artifact passed onward.

Key terms

• Semantic frame
• Confidence score

---

5) Context manager (multi-turn)

In multi-turn dialogue, the meaning of a new utterance depends on prior turns. A context manager maintains and updates the dialogue state using the newest semantic frame.

Typical responsibilities:

• Update slot values
• Track which entities are already known
• Resolve references (“it”, “that”, “tomorrow”)
• Maintain dialogue policies features

Key terms

• Dialogue state tracking
• Coreference resolution

---

6) Dialogue policy / action router

Based on the updated state and/or NLU confidences, the policy selects an action:

• Execute a task (search, booking, API call)
• Ask a clarification question (if slots missing or confidence low)
• Confirm the inferred intent/slots

This is typically rule-based, learned, or hybrid.

Key terms

• Dialogue policy
• Fallback strategy

Diagram: How Intent + Slots Connect to Dialogue Actions

Interpretation: NLU does not end at extraction—practically, it must drive a safe next step. That’s why confidence handling and dialogue state are first-class citizens in the architecture.