A neural network is a series of algorithms that endeavors to recognize underlying relationships in a set of data through a process that mimics the way the human brain operates. ... Neural networks can adapt to changing input; so the network generates the best possible result without needing to redesign the output criteria.
Below I've drawn a typical feed forward neural network:
Now my question is, as far as lingo goes, what is a layer?
Could each individual process (rectangle) be considered a layer? or is a layer the combination a single row of the flow diagram? I sometimes see the Multiply + Add as a single layer, and the nonlinear function (relu) as a separate layer. But I would really appreciate a definitive answer.