At the moment it seems to me on the .NET side NBitcoin would compete with Bitcoin.js on the other.
Update: I decided on NBitcoin. It has a great book to learn from. Note I will not form opinion on my question, I contributed a great chunk of this book, so I would be biased.