On solution seems to go to Edit>Project Setting>Time and change Fixed Timestep to 0.005 and Maximum Allowed Timestep to 0.05.
as described here : https://forums.oculusvr.com/developer/discussion/86423/hand-physics-capsules-not-following-the…
Why are we 2 years later and there is still this bug when building with Unity 2019 ?!
I had to find the AndroidManifest.xml in \Temp\StagingArea\ then copy it into \Assets\Plugins\Android\
Then modify theses two lines :