addPartOfSpeechDetails — Add part-of-speech tags to tokenized documents.

addPartOfSpeechDetails(documents) adds part-of-speech metadata to a RunMat tokenizedDocument compatibility object. Use tokenDetails to view the resulting PartOfSpeech column.

Syntax

updatedDocuments = addPartOfSpeechDetails(documents)
updatedDocuments = addPartOfSpeechDetails(documents,Name,Value)

Inputs

NameTypeRequiredDefaultDescription
documentsAnyYestokenizedDocument object.
NameValueAnyVariadicName-value options: RetokenizeMethod, Abbreviations, DiscardKnownValues.

Returns

NameTypeDescription
updatedDocumentsAnyUpdated tokenized document object.

Errors

IdentifierWhenMessage
RunMat:addPartOfSpeechDetails:InvalidInputInput is not a supported tokenizedDocument object or option form.addPartOfSpeechDetails: invalid input

How addPartOfSpeechDetails works

  • documents must be a RunMat tokenizedDocument object.
  • addPartOfSpeechDetails(documents, Name, Value) supports RetokenizeMethod, Abbreviations, and DiscardKnownValues name-value pairs.
  • RetokenizeMethod defaults to "part-of-speech", which applies common part-of-speech retokenization such as English contractions, wanna/gonna, ellipses, and dotted initialisms. Use "none" to keep existing tokens.
  • Abbreviations is passed through to the sentence-detail prepass when sentence details are absent.
  • DiscardKnownValues defaults to false, so existing known part-of-speech details are preserved while missing or empty entries are filled.
  • DiscardKnownValues, true recomputes every stored tag.
  • RunMat tags English and German tokens with deterministic compatibility taggers covering common pronouns, determiners, coordinate and subordinate conjunctions, adpositions, particles, auxiliary verbs, verbs, adverbs, adjectives, nouns, numerals, punctuation, and other token classes.
  • If an existing tokenizedDocument object already carries Japanese or Korean language metadata, RunMat currently uses token-class-aware fallback tags and a conservative noun fallback for letter tokens. Public Japanese/Korean tokenizedDocument construction and MeCab-backed part-of-speech models remain tracked.
  • Exact MathWorks statistical model parity remains tracked as broader Text Analytics work.

GPU memory and residency

addPartOfSpeechDetails updates host tokenizedDocument metadata and has no provider kernel.

Examples

Add Part-Of-Speech Details

documents = tokenizedDocument("The dogs are running.");
documents = addPartOfSpeechDetails(documents);
tdetails = tokenDetails(documents)

Expected output:

`tdetails.PartOfSpeech` contains tags such as `"determiner"`, `"noun"`, `"auxiliary-verb"`, `"verb"`, and `"punctuation"`.

Keep Existing Tokens

documents = addPartOfSpeechDetails(documents, "RetokenizeMethod", "none")

Expected output:

`documents` receives part-of-speech details without the part-of-speech retokenization pass.

Recompute Part-Of-Speech Details

documents = addPartOfSpeechDetails(documents, "DiscardKnownValues", true)

Expected output:

`documents` has refreshed part-of-speech details.

Using addPartOfSpeechDetails with coding agents

Open a RunMat example with live inputs, then ask the agent to explain how addPartOfSpeechDetails changes the result.

Run a small addPartOfSpeechDetails example, explain the result, then change one input and compare the output.

FAQ

Does addPartOfSpeechDetails use a full NLP model?

No. This compatibility slice uses deterministic English rules and records exact MathWorks model parity as remaining Text Analytics work.

Does addPartOfSpeechDetails execute on the GPU?

No. It updates host tokenizedDocument metadata.

Open-source implementation

Unlike proprietary runtimes, every RunMat function is open-source. Read exactly how addPartOfSpeechDetails is executed, line by line, in Rust.

About RunMat

RunMat is an open-source runtime that executes MATLAB-syntax code blazing on any GPU. It is licensed under the Apache 2.0 license.

  • RunMat automatically optimizes your math for GPU execution on Apple, Nvidia, and AMD hardware. No code changes needed. Simulations that took hours now take minutes.
  • Start running code in seconds. RunMat runs in the browser, on the desktop, or from the CLI. No license server, no IT ticket.

Getting started · Benchmarks · Pricing

Download RunMat

Download RunMat for full performance, or use RunMat in your browser for zero setup.