diacritic
Let an agent handle diacritics by mark, script, function, encoding and correct use in names and text processing.
Research draft, second pass
A second pass drafted this model: the structure a model of this thing needs, and what is known about it in the world. The line under this one says how the second half was obtained - researched against sources, or recalled without web access, in which case nothing here was read anywhere and every claim is a lead to verify. Unreviewed either way.
written by Claude from model knowledge without web access - no source was read, every claim is a lead to verify
Researched by: Claude
Purpose and description
Let an agent handle diacritics by mark, script, function, encoding and correct use in names and text processing.
A mark added to a letter or character to change its pronunciation, meaning or tone, such as accents, umlauts, cedillas, tone marks, the Arabic nuqta and the Japanese long vowel mark.
What it is for: Distinguishing sounds, tones and meanings in writing.
It can be identify a diacritic and its function; type and encode diacritics correctly; preserve diacritics in names; handle diacritics in search and sorting.
Distinguishing features
Modifies a base character
Changes sound, tone or meaning
Encoded as combining or precomposed characters
Often stripped incorrectly by software
What it looks like
Small marks above, below or through letters.
How it is recognised
Accents, umlauts, cedillas, tone marks
Combining and precomposed characters
Script-specific marks such as nuqta
Related models
is a kind of - category
is used in - context
is encoded by - standard
affects - computing
In practice
Families and kinds
accents such as acute and grave
umlaut and diaeresis
cedilla and ogonek
tone marks
script-specific marks
Identifiers
Unicode code point combining diacritical marks block characters
Standards and regulation
Unicode Standard and normalisation forms
National orthography rules
Failure modes and hazards
Stripping diacritics from names
Normalisation mismatches in search
Mojibake from wrong encoding
Also called
+144
Where this came from
wikidata · CC0 1.0
Drafted structure
Bundle to layer to finding to question, as the second pass will find it: 4 bundles · 8 layers · 8 findings · 16 questions.
Mark Which diacritic.
Marks differ.
Identity
Name.
Identity
Diacritic.
- Which diacritic is it, and what is its name? definition
- In which languages is it used? provenance
Function
Sound or meaning.
Function
Function.
- What does it change: sound, tone or meaning? definition
- Does it make a separate letter in the alphabet? definition
Encoding Digital text.
Encoding needs care.
Unicode
Code points.
Unicode
Encoding.
- Is it encoded as a precomposed or combining character? definition
- Which normalisation form is used? boundary
Input
Typing.
Input
Typing.
- How can it be typed on this keyboard? action
- Is a font available? boundary
Processing Search and sorting.
Software often mishandles diacritics.
Search
Matching.
Search
Search.
- Should search treat accented and unaccented forms as equal? boundary
- How is that configured? action
Sorting
Collation.
Sorting
Collation.
- Which collation rules apply for this language? provenance
- Does sorting follow local expectations? boundary
Names Respect.
Names deserve correct spelling.
Preserve
Correct spelling.
Preserve
Preserving names.
- Is the person name kept with its diacritics? boundary
- Does the system support it? boundary
Transliteration
Other scripts.
Transliteration
Transliteration.
- How are diacritics handled in transliteration? definition
- Which standard applies? provenance
What the second pass must settle
- Should each diacritic be a separate entry?
- How should language-specific rules be linked?
- How should normalisation guidance be linked?