Having read nearly every post about AD and DNN over the past couple of years or so, I find it interesting to realize that AD's and DNN don't mesh well in its current implementation. Oddly enough I have found myself with the the same struggles most folks experience with integrating AD and DNN.
I thought about creating my own, but to keep the DNN community spirit, I'd like to foster renewed thinking how AD could be implemented.