Photo responsive polymer is well known for its photo bending feature, which contracts under UV light, and goes back to original shape under visible light. The main reason for this reversible deformation under different kinds of light is due to azobenzene monomer included in the polymer. As azobenzene monomer turns from trans to cis state by photoisomerization, the polymer starts to lose its alignment, and starts shrinking. In order to predict photo deformation of the photo responsive polymer, we propose new modeling approach by connecting three different scale modeling method: quantum mechanics, molecular dynamics, and continuum mechanics. By using the modeling approach, we predict photo deformation of photo responsive polymer at various light input.