Hmm, mumble looks promising, it's already in the debian repo, but the client is very bloated, and I don't see where to download the source code. Downloading from mumble.com also requires agreeing to some kind of service agreement.
I'm thinking that maybe encryption in the voip software isn't...