The increasing level of control over motional quantum states of massive, solid-state mechanical devices opens the door to an hitherto unexplored parameter regime of macroscopic quantum physics. I will report on our recent progress towards controlling levitated solids in the quantum regime. I will discuss the prospects of using these systems for fundamental tests of physics, including the interface between quantum and gravitational physics.