Face Analysis from Star Trek Video

Identify the faces of a set of of characters in a Star Trek promotional video

Use

and

to automate curation of a dataset of faces of Star Trek characters:

In[1]:=

searchCharacterPhotos[name_]:=Flatten[FindFaces[#,"Image"]&/@WebImageSearch["star trek "<>name]]faces=AssociationMap[searchCharacterPhotos,{"Jean-Luc Picard","William Riker","Phillipa Louvois","Data"}];

Display thumbnails for the result of the search:

In[2]:=

Map[ImageResize[#,30]&,faces,{2}]

Out[2]=

Jean-Luc Picard

,William Riker

,Phillipa Louvois

,Data



Import a Star Trek promotional video:

In[3]:=

starTrekVideo=ResourceData["Example""Face Analysis from Star Trek Video","Video"]

Out[3]=

Advanced machine learning functionality allows for the creation of a powerful face recognizing function even if the provided dataset is small. Use

FaceRecognize

to find and identify faces in one of the frames:

In[4]:=

(f=FaceRecognize[faces,VideoExtractFrames[starTrekVideo,11.2],All])//Dataset

Out[4]=

Highlight the faces on the original image:

In[5]:=

HighlightImage[VideoExtractFrames[starTrekVideo,11.2],f〚All,"BoundingBox"〛,ImageLabelsf〚All,"Name"〛]

Out[5]=

FaceRecognize

relies on neural networks and transfer learning to automatically train a

ClassifierFunction

In[6]:=

recognizer=FaceRecognize[faces]

Out[6]=

ClassifierFunction

Input type: Image

Classes: Data,Jean-Luc Picard,Phillipa Louvois,William Riker



Create a simple function to massage the output of the face recognizer into something easier to plot:

In[7]:=

recognizeFaces[a_]:=Thread@{a["Time"],ReplaceAll[recognizer[FindFaces[a["Image"],"Image"]],{{}{None},_Missing"Other"}]}

Apply the recognizer function on all the frames of the video:

In[8]:=

recognizedFaces=Join@@VideoMapList[recognizeFaces,starTrekVideo];

Aggregate and reduce the result:

In[9]:=

recognizedFaces=GroupBy[DeleteCases[recognizedFaces,{_,None}],Last,Map[First]];

Plot the resulting timeline:

In[10]:=

NumberLinePlot[recognizedFaces,PlotLegendsKeys[recognizedFaces]]

Out[10]=

	William Riker
	Phillipa Louvois
	Jean-Luc Picard
	Data
	Other

Publisher Information

Contributed by: Wolfram Staff

Wolfram Language Example Repository

Face Analysis from Star Trek Video

See Also

Publisher Information

Face Analysis from Star Trek Video

See Also

Related Symbols

Publisher Information