I'm currently trying to produce the following picture of a "special neural network architecture" using TeX:

The first part (before the "big block entitled logic" and ommiting the grey lines) is just a standard picture of a feedforward neural network as addressed by this post.
The picture is easy to draw by hand but I have no idea how to tikz or Tex this...