> For the complete documentation index, see [llms.txt](https://smartpredict.gitbook.io/smartpredict-ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://smartpredict.gitbook.io/smartpredict-ai/module-reference/core-modules/11.-natural-language-processing/text-vectorizer.md).

# Text vectorizer

This module belongs to the category " Natural Language Processing" .

## Description

This module is used to generate vectors that represent the textual data.

![](https://1833277725-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-Lyc1OXsKqB2S62LxsOR%2F-M1Vpk451ddDnxnXF5NC%2F-M1VrBk4-eQQIuhqiFtR%2Fvector%20out.png?alt=media\&token=6a43213f-e7f0-4350-8283-dd0f7f9d36e1)

It executes word level as well as sentence level vectorization. The containing type may be data frame, single string , list or series.<br>

![](https://1833277725-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-Lyc1OXsKqB2S62LxsOR%2F-M1Vpk451ddDnxnXF5NC%2F-M1Vqmt6YvlDb9B-v5p8%2Fimage.png?alt=media\&token=0268b498-06f9-4b49-a945-f66a47cd8116)

## Parameters

To set the vector characteristics, we may choose between : **word level** and **sentence level**.

![](https://1833277725-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-Lyc1OXsKqB2S62LxsOR%2F-M1Vpk451ddDnxnXF5NC%2F-M1VrjG4_4_F4NwPYWmg%2Fvectorizer.png?alt=media\&token=69dd6b03-156b-4f84-81b8-fa9528eeb262)