Havdalah

Question

I keep my havdalah candle in the drawer with my silverware, so all Shabbat I am opening and closing this drawer. I don't touch the havdalah candle, but it is moved (indirectly) every time I open the drawer. Is this a problem?