  | 
    | 
    | 
    | 
    | 
    | 
    | 
    | 
    | 
    | 
    | 
 
 
   | 
 
 
   | 
  
  
   
      | 
      | 
    
   
    Higher order Boltzmann machines 
     | 
    
   
     | 
    
   
     | 
    (Sejnowski, ~1986) 
     | 
     | 
    
   
   | 
   | 
 
 
   | 
 
 
   | 
  
  
   
      | 
      | 
    
   
    | • | 
    The usual energy
    function is quadratic in the states: 
     | 
    
   
   | 
   | 
 
 
   | 
 
 
   | 
    | 
   | 
 
 
   | 
 
 
   | 
  
  
   
      | 
      | 
    
   
    | • | 
    But we could use
    higher order interactions: 
     | 
    
   
   | 
   | 
 
 
   | 
 
 
   | 
    | 
   | 
 
 
   | 
 
 
   | 
  
  
   
      | 
      | 
      | 
      | 
      | 
      | 
      | 
      | 
      | 
    
   
    | • | 
    Unit k acts as a
    switch. When unit k is on, it switches 
     | 
    
   
     | 
    in the pairwise
    interaction between unit i and unit j. 
     | 
     | 
    
   
     | 
    
   
     | 
    – | 
    Units
    i and j can also be viewed as switches that 
     | 
     | 
    
   
     | 
    control
    the pairwise interactions between j and k 
     | 
     | 
    
   
     | 
    or
    between i and k. 
     | 
     | 
    
   
   | 
   | 
 
 
   |