Classify
Predict
ClassifierFunction
PredictorFunction
ClassifierMeasurements
PredictorMeasurements
ClassifierInformation
PredictorInformation
UtilityFunction
ClassPriors
ValidationSet
NominalVariables
PerformanceGoal

Build a Classifier to Detect the Language of a Text

Import French, English, German, and Spanish texts from the web to use to train a classifier

Open in Cloud
Download Notebook

Use these text examples:

In[1]:=

french=Import["http://fr.wikipedia.org/wiki/Main_Page"];english=Import["http://en.wikipedia.org/wiki/Main_Page"];german=Import["http://de.wikipedia.org/wiki/Main_Page"];spanish=Import["http://es.wikipedia.org/wiki/Main_Page"];

Build a classifier using the training texts:

In[2]:=

language=Classify[{french"French",english"English",german"German",spanish"Spanish"}]

Out[2]=

ClassifierFunction

Input type: Text

Classes: English,French,German,Spanish



Test the classifier on simple phrases:

In[3]:=

AssociationMap[language,{"the house is blue","la maison est bleue","la casa es azul","das Haus ist blau"}]

Out[3]=

the house is blueEnglish,la maison est bleueFrench,la casa es azulSpanish,das Haus ist blauGerman

Detect the languages of texts:

In[4]:=

language[ExampleData[{"Text",#}]]&/@{"AliceInWonderland","LesFleursDuMal","DonQuixoteISpanish","UNHumanRightsGerman"}

Out[4]=

{English,French,Spanish,German}

Related Symbols

Classify
Predict
ClassifierFunction
PredictorFunction
ClassifierMeasurements
PredictorMeasurements
ClassifierInformation
PredictorInformation
UtilityFunction
ClassPriors
ValidationSet
NominalVariables
PerformanceGoal

Publisher Information

Contributed by: Wolfram Staff