Workers from small colonies only go out at night to feed, they feel much saver. Also such a small colony don't need much food. Don't worry as long as they are alive they will do just fine.
You need much patient with ants, once they colony gets bigger you will have you hands full.
