Wolfram Function Repository
Instant-use add-on functions for the Wolfram Language
Function Repository Resource:
Numerically stable implementation of addition on log-scaled numbers
ResourceFunction["LogSumExp"][array, spec] reduces array by aggregating the specified dimensions with the LogSumExp operation. |
Compute the LogSumExp of a list of numbers:
In[1]:= |
Out[1]= |
This is the same as:
In[2]:= |
Out[2]= |
However, LogSumExp can be computed in a numerically stable way using MachinePrecision even when larger numbers are involved:
In[3]:= |
Out[3]= |
The naive implementation loses precision and switches to arbitrary precision to compensate:
In[4]:= |
Out[4]= |
Compare with the exact result:
In[5]:= |
Out[5]= |
Compute the LogSumExp on symbolic data:
In[6]:= |
Out[6]= |
Reduce a matrix by applying LogSumExp to its rows:
In[7]:= |
Out[7]= |
In[8]:= |
Out[8]= |
Apply to columns:
In[9]:= |
Out[9]= |
Aggregate both rows and columns:
In[10]:= |
Out[10]= |
This is equivalent to:
In[11]:= |
Out[11]= |
The LogSumExp operation allows you to do addition outside of a Log in the same way that addition allows you to multiply outside of a Log:
In[12]:= |
Out[13]= |
A Log transform turns multiplication into addition:
In[14]:= |
Out[14]= |
And it turns addition into LogSumExp:
In[15]:= |
Out[15]= |
Wolfram Language 13.0 (December 2021) or above
This work is licensed under a Creative Commons Attribution 4.0 International License