Visible to the public Unifying Standard Physics-based Control with Learning-based Perception and Action to Enable Safe and Agile Object Manipulation