A subtelty
The obvious way to implement a relational graph
in a neural net is to treat a neuron as a node in
the graph and a connection as a binary
relationship. But this will not work:
We need many different types of relationship
Connections in a neural net do not have labels.
We need ternary relationships as well as
binary ones. e.g. (A is between B and C)
Its just naïve to think neurons are concepts.