Pathfinding is the act of finding a path between one point and another.
Pathfinding and controlling enemy behaviors are the main areas in which you'll probably use AI.
AI can be used to generate random maps.
Using a special algorithm, you can generate a random perfect maze.
A* (pronounced "A star") is the best pathfinding algorithm known. It is guaranteed to find the path of the lowest score, should any path exist, between two points.
Although it's the best pathfinding algorithm, A* is also very CPU-intensive and slow.
A* can handle multiple types of terrains and find the best path through these terrains to the goal.