Getting a soft-body physics effect with skinned meshes can be a a huge pain in Unity. Check out this demo scene where we use mesh vertex offsets along with simple spring physics to simulate a soft-body balloon.
Download the package here. Feel free to adapt this for your project!