Wolfram Language Paclet Repository
Community-contributed installable additions to the Wolfram Language
LexicalCases Overview  | |
Installation
This paclet is hosted on the . First install the paclet from the , then load it with .
Install the paclet and load its definitions with Needs
PacletInstall[ResourceObject["FaizonZaman/LexicalCases"]];Needs["FaizonZaman`LexicalCases`"]
Introduction
Where aims for character patterns and for text patterns, LexicalCases aims for lexical patterns. This is accomplished by expanding the scope of StringExpression where types can be expressed anywhere within. Listed below are the pattern types one can use when searching at the lexical level.
Represents any of the t i | |
Represents any of the lp i | |
Represents a string with inner outer | |
Represents n | |
Represents n m | |
Considers contractions as a single word | |
Represents n m | |
Represents an optional lexical pattern |
Additional pattern constructs made available by the LexicalCases paclet.
Here we can search the Origin Of Species for adverb~adjective patterns ending with "specie" or "species". Note the whitespace string between and . Whitespace is given "for free" between some tokens like . returns a object with several properties.
Search the origin of species for a lexical pattern
In[22]:=
oosp=ExampleData[{"Text","OriginOfSpecies"}];
In[25]:=
ols=
oosp,
["Adverb"]~~
["Adjective"]~~" "~~
["specie"|"species"]
 | LexicalCases |
 | TypeToken |
| TypeToken |
| BoundToken |
Out[25]=
LexicalSummary
|
LexicalSummary Properties
LexicalSummary properties vary in output from data to metadata. One can access various forms of the results, including the data, and their visualization.
"Data" | Returns a list of Associations which contain the match and related metadata like string position |
"Dataset" | |
"Counts" | |
"CountGroups" | |
"CountGroupPercentages" | Returns "CountGroups" with the count replaced by percentage |
"PartOfSpeechGroups" | |
"WordStemGroups" | |
"Source" | Returns a string indicating whether the source is "Wikipedia" or "Text" |
"TotalMatchCount" | Returns the total number of matches found |
"LexicalStructure" | Returns a text structure diagram of the lexical pattern |
"Survey" | Returns a Dashboard of results |
LexicalSummary properties
View the list of properties.
In[26]:=
ols["Properties"]
Out[26]=
{Data,Dataset,Counts,CountGroups,CountGroupPercentages,LowercaseCountGroupPercentages,PartOfSpeechGroups,WordStemCountGroups,Source,TotalMatchCount,LexicalStructure,Survey}
LexicalStructure
LexicalStructure
View a lexical pattern's structure via the "LexicalStructure" property
In[12]:=
ols["LexicalStructure"]
Out[12]=
| ||||||||||||||
StringExpression |
View a lexical pattern's structure via the LexicalStructure function
In[11]:=
 | LexicalStructure |
 | TypeToken |
| TypeToken |
| BoundToken |
Out[11]=
| ||||||||||||||
StringExpression |
Data
Data
Use the and properties to extract the results from the summary object.
"Data"
"Dataset"
In[27]:=
ols["Dataset"]
Out[27]=
| ||||||||||||||||||||||||||||||||||||||||||||||||||||
Counts
Counts
Use to view the frequency of matches, or use to group matches by frequency.
"Counts"
"CountGroups"
Return a dataset of matches grouped by their count
In[28]:=
ols["CountGroups"]
Survey
Survey
Return a Survey of results
Note that "Survey" returns a lexical dispersion plot. This plot is not particular to the survey property, there are two other ways to produce it .
LexicalDispersion
LexicalDispersion
Quickly get a lexical dispersion plot from a summary object
Display the first 5 examples
Get a lexical dispersion plot of the 5 most common bigrams in the origin of species
Searching Files and Services
Services — Wikipedia
Services — Wikipedia
Search over Wikipedia articles containing the keyword "science fiction"
Files
Files
Built-in String Functions
Get example text
Uppercase all verbs in a string
It's also possible to use the operator forms of these functions.
Define a Q operator for matching a lexical pattern
Abstractions
LexicalMap
LexicalMap
Map a function over lexical patterns in a string. This is effectively the same as using a LexicalPattern in StringReplace.
LexigramCount
LexigramCount
Compute the LexigramCount for a lexical pattern
Compute the LexigramCount for a lexical pattern
Conclusion