You either find a rock/dirt wall and tunnel straight into it, or you dig a stair down.
Digging a down stairway is the first step; then you have to go directly down a level and dig the stairs going up. This will allow you to tunnel underground.
http://afteractionreporter.com/2009/...-no-srsly-wtf/