There is a small slot on the bottom center of the lens. Just stick a screwdriver in there and twist. It'll pop right off. To replace the lens, put it in the top first and snap it back in. you might have to press it all around the edges to seat it fully. I replaced the bulbs with LEDs. In the last picture with the light on, you can see that slot very easily.
Thanks Mike. I popped out the light bulb and it seems the bulb is ok. Since both the lights do not turn on, it seems that the issue comes from the switch. I assume these lights are controlled by the courtesy light switch. The 一 shaped indicator on the switch does not turn on if I turn on the switch. Does that mean the switch is bad? Or where should I start to diagnose the issue?
Did you try resetting the circuit breaker? The rubber nipple to the left of the courtesy light switch would be the one to push to reset. If that doesn't work I would suspect the breaker as having gone bad instead of the switch. I've had several breakers go belly up on me. I keep extras on hand. Never had a switch go bad.