Glossary
What is an AI dataset?
An AI dataset is the material a model learns from: what it contains, how it is organised, and what buyers check before licensing one.
Updated
Definition
An AI dataset is an organised collection of examples, such as text, images, audio, code or records, gathered and documented so that a machine learning model can be trained, tuned or evaluated on it.
In plain words
A model can only learn patterns that appear in the examples it is shown. An AI dataset is that set of examples, prepared on purpose. A folder of photos is not yet one. The same photos become one when each is labelled, duplicates are removed, the files share a format, and someone has written down where they came from and what they may be used for.
The examples can be almost anything a computer can read: support tickets, X-ray images, call recordings, sensor logs, product listings, source code. What makes the collection useful is not its size alone but whether it matches the job the model will do once it leaves the lab.
What a usable one contains
- Examples: the individual items, each in a consistent format.
- Labels or targets, where the task needs them: the right answer the model should learn to give, such as a category, a transcript or a fault code.
- Splits: a training portion the model learns from, a validation portion used while tuning, and a held-back test portion used only to measure the result.
- Documentation: who made it, why, how the items were collected and cleaned, known gaps and recommended uses. The research paper Datasheets for Datasets proposed a standard set of questions for exactly this.
- Rights: a record of who owns the material and what licence the buyer receives.
Worked example: a repair archive becomes training material
This scenario is illustrative, not drawn from a real deal. Suppose a regional heating and cooling contractor has fifteen years of technician notes: the symptom a customer reported, what the engineer found, the part replaced and whether the fix held. A company building a diagnostic assistant for field engineers wants exactly that pairing of problem and resolution.
- 1
Scope it
The broker and seller agree which years, regions and job types go in, and leave out jobs with missing outcomes.
- 2
Strip the people
Customer names, addresses and phone numbers are removed, because the buyer needs the fault, not the household.
- 3
Structure it
Free-text notes are kept, but each job gets fields for equipment model, fault category and outcome, so the buyer can filter and label.
- 4
Document it
A short datasheet records the collection period, the share of jobs with notes, known blind spots such as one brand being over-represented, and the permitted uses.
- 5
License it
The contract says the buyer may train and evaluate models, may not resell the raw notes, and must delete them if the deal ends early.
The contractor never sold data before. What changed the archive into an AI dataset was the preparation and the paperwork around it, not new collection.
What a broker checks
- Ownership: did the seller create the material, or is some of it licensed in from someone else with terms that forbid AI use?
- Personal data: can people be identified, and does the seller have a lawful basis to share what remains?
- Fit: does the material cover the situations the buyer's model will face, or only a narrow slice?
- Contamination: has the same material already been published, so the buyer may already have it?
- Regulation: in the EU, the AI Act sets data governance expectations for the datasets behind high-risk systems, including records of origin and checks for bias. Buyers in scope will ask sellers for that information.
Limits and common mistakes
Bigger is not automatically better. A modest, well-labelled collection from a niche that is hard to observe can be worth more to the right buyer than a vast scrape of public pages. The opposite mistake is overselling quality: if a fifth of the labels were guessed by a junior clerk, say so, because the buyer's evaluation will find it anyway. Finally, a dataset is not a model. Selling the examples does not give the seller any claim on what the buyer builds unless the contract says otherwise.
Sources
| Source | What it supports | Checked |
|---|---|---|
| arXiv: Datasheets for Datasets (Gebru et al.) | The proposal that every dataset ship with a datasheet on motivation, composition, collection and uses | 2026-11-07 |
| EU AI Act: Article 10, Data and data governance | Quality and governance expectations for training, validation and testing data in high-risk systems | 2026-11-07 |
Questions people ask
What are examples of AI datasets?
Labelled photos for object recognition, transcribed audio for speech models, pairs of questions and answers for chatbots, historical transactions marked as fraud or not, and code repositories with commit history are all common types.
How big does an AI dataset need to be?
It depends on the task and on whether the buyer is training from scratch or adapting an existing model. Adapting a model to a narrow task can work with far fewer examples than building one, which is why small specialist collections still find buyers.
Can a company sell its internal data as an AI dataset?
Often yes, if it owns the material, removes or has permission for any personal data, and is not bound by customer or supplier contracts that forbid it. Those three checks come before any talk of price.
What is the difference between training, validation and test data?
Training data is what the model learns from. Validation data is used while adjusting settings. Test data is kept apart until the end to give an honest measure of how well the finished model performs.
Become a data broker
The DataBroker course and tools: find companies with data to sell, price it, license it and close the deal.