EN
Sign inGet started
Glossary

Corpus

What is Corpus?

A corpus is a structured collection of texts or language data compiled for analysis, research or training language models. It can be general, such as news texts spanning many years, or domain-specific, such as all of a company's contracts and manuals. Size, balance, currency and the rights to the texts determine how useful the resulting findings are.

How KI.ordo helps

In KI.ordo, the stored knowledge (texts, PDFs with a text layer, Word files and web pages) forms the collection that agents search when answering questions.

Learn more →: Corpus

Topics

  • Data
  • Texts
  • NLP

Try KI.ordo

Agents, flows and templates in one workspace – free 24-hour demo.

Start demo
← All terms

Related terms

Training Data

Training data are the examples from which an AI model learns patterns: large text collections for language models, labelled images for image models. Their quality, diversity and recency largely determine how reliable and fair a model is and how up to date its knowledge will be. For organisations it also matters whether a provider uses the customer data they enter for further training.

  • Data
  • Training
  • +1

Natural Language Processing (NLP)

Natural language processing is the branch of AI that enables computers to analyse, understand and generate human language in text or speech. It covers tasks such as translation, classification, summarisation, sentiment analysis and question answering. Rules and statistical methods once dominated; today the field is shaped by large language models.

  • NLP
  • Language
  • +1

Unstructured Data

Unstructured data follow no fixed table schema: emails, contracts, manuals, web pages, presentations, images or audio recordings. They make up a large share of organisational knowledge but were long difficult to analyse automatically. Language models can read and search such content and turn it into structured information, for example extracting deadlines and amounts from a contract into a table.

  • Data
  • Documents
  • +1

Data mining

Data mining is the systematic search of large data sets for patterns, relationships and anomalies. It draws on statistical techniques and machine learning methods such as clustering, classification or association analysis. A classic example is market basket analysis in retail, which shows which products are often bought together – a basis for product range, placement and recommendations.

  • data analysis
  • pattern recognition
  • +1