you will want to start by looking around your spawnpoint for these things.
Or you can find a hill to build a little house into the side
Exploring
To explore the world you will want to bring along these few things
You will not want to go very far away from your house on the first time (maybe try exploring a lake or woods nearby. )
Sunflowers always point which way the sun sets so they are a useful navigation tool