A taxonomy in WordPress is a way to group content. Each taxonomy holds a set of terms, and each post can be assigned to one or more of them. Categories and tags are the two built-in taxonomies every site uses for posts.
Categories and tags
Categories are hierarchical: a category can have child categories, such as Recipes with Desserts under it. Tags are flat, with no parent-child relationship, and suit loose descriptive labels. Both are taxonomies for posts, and WordPress also uses taxonomies internally, for example for post formats and navigation menus.
Custom taxonomies
Developers can register their own with the register_taxonomy() function, usually alongside a custom post type. A recipe site might add Cuisine and Diet. A store built on WooCommerce uses taxonomies for product categories, product tags and product attributes. A custom taxonomy can be hierarchical like categories or flat like tags, and can be shared between several post types.
Behind the scenes, terms are stored in the wp_terms and wp_term_taxonomy database tables, and the link between a post and its terms lives in wp_term_relationships.
Taxonomies and SEO
Each term gets an archive page with its own URL, such as /category/recipes/, which lists the content assigned to it. Used well, these archives are useful landing pages that group related content and strengthen internal linking. Used carelessly, they create hundreds of thin pages: a tag used on a single post produces an archive that repeats that post. Common practice is to give important archives an introduction of their own, keep the number of tags small, and apply noindex to archives that add nothing.
A good taxonomy reflects how visitors look for content, not how the site was built. Planning it before a site grows is far easier than reorganizing thousands of posts later.