What are large or continuous action spaces?

A large or continuous action space is when someone (or something) has many different choices to make, like picking from a huge bag of toys instead of just two.

Imagine you're playing with a robot that can move around, and it wants to pick up a toy. If the robot only had two options, go left or go right, that would be a small action space. But if the robot could choose any direction, like turning 360 degrees smoothly, then it has a large or continuous action space, because there are so many possible choices.

Like Choosing Your Favorite Ice Cream Flavor

Think about picking your favorite ice cream flavor at an ice cream shop. If there were only two flavors, chocolate and vanilla, that would be like a small action space. But if the shop had 100 different flavors, or even any flavor you can imagine, then choosing becomes much harder. That’s like having a large action space, lots of options to pick from.

Sometimes, instead of picking from many choices all at once, it's easier for the robot (or person) to choose smoothly, like how you slowly turn the knob on your favorite toy car, that’s a continuous action space.

Take the quiz →

Examples

  1. A child choosing between ten different toys
  2. A robot picking one of a hundred possible actions
  3. Choosing the best flavor among dozens of ice creams

Ask a question

See also

Discussion

Recent activity