Here we consider a proof-of-concept scenario where a tennis ball is thrown at a table. The ball bounces multiple times on the table as well as on the ground. This interaction of the ball with the world is recorded using Microsoft Kinect 1.0. The trajectory of the ball is estimated and a physics model is used to estimated the coefficient of restitution with respect to table and ground.