Maybe it was the loss of his family that forced him to a life of piracy and crime?
Why is everyone dressed like how they do in dragonball?