Magento 2 Meta Robots Extension

Comprehensive Robots Meta Tag Control

The extension provides complete control over robots meta tags across your entire Magento 2 store. Robots meta tags tell search engines how to handle individual pages - whether to index them, follow their links, display snippets, and more. With this extension, you can configure these critical SEO directives at multiple levels to ensure optimal search engine treatment of your content.

Page-Specific Configuration

Configure robots meta tags for individual products, categories, and CMS pages using the dedicated Meta Robots attribute. This page-level control allows you to make strategic decisions about which pages should appear in search results and which should remain hidden. For example, you might want to exclude "Out of Stock" products, internal-use pages, or duplicate content from search indexes while keeping your main catalog visible.

The Meta Robots attribute provides a simple interface for setting common directives like INDEX, NOINDEX, FOLLOW, and NOFOLLOW without editing code or templates.

URL-Based Rules

Create powerful rules that apply robots meta tags based on URL patterns. This approach is perfect for handling entire sections of your site with consistent SEO requirements. For instance, you can automatically apply NOINDEX directives to all URLs containing specific parameters, filter pages, or temporary promotional pages.

Full Action Name Rules

Set robots meta tag rules based on Magento's full action name - the internal controller identifier for each page type. This technical approach gives developers and advanced users precise control over how different page types are handled. Apply rules to all search result pages, customer account pages, or any other controller action across your store.

Intelligent Canonical URL Integration

When used with our Canonical URL Extension, the Meta Robots Extension automatically optimizes your canonical tag implementation. Pages marked with NOINDEX directives don't receive canonical tags, as there's no need to specify a preferred version of a page that shouldn't be indexed at all. This intelligent coordination prevents conflicting signals to search engines and keeps your SEO implementation clean and logical.

Smart Hreflang Management

For multilingual stores using our Hreflang Extension, the Meta Robots Extension provides intelligent integration. Pages with NOINDEX directives automatically have their hreflang alternate language links removed. Since NOINDEX pages shouldn't appear in search results, there's no need to declare their localized versions to search engines. This coordination ensures your international SEO implementation remains consistent and error-free.

XML Sitemap Optimization

When combined with our XML Sitemap Extension, pages marked with the NOINDEX directive are automatically excluded from your XML sitemaps. This makes perfect sense: if you're telling search engines not to index a page through robots meta tags, you shouldn't simultaneously list it in your sitemap as content to be crawled. The extensions work together to maintain consistent messaging about which pages deserve search engine attention.

This automatic coordination saves you from manually managing sitemap exclusions and ensures your sitemap accurately reflects your indexing strategy.

Unified SEO Strategy

The Meta Robots Extension is designed to work seamlessly with our other SEO tools, creating a cohesive, intelligent SEO system. Rather than managing multiple conflicting settings across different tools, you get automatic coordination that maintains logical, consistent SEO directives across your entire site.

For comprehensive SEO optimization, consider using the complete Magento 2 SEO Extension, which includes this functionality along with additional SEO features in one unified solution.

Benefits for Your Business

• Control Search Visibility: Strategically decide which products and categories appear in results
• Improve Crawl Efficiency: Direct search engine resources to your most valuable pages
• Maintain Clean Indexes: Remove outdated, temporary, or low-value pages from search results
• Protect Sensitive Pages: Hide customer account pages, checkout steps, and internal tools
• Coordinate SEO Signals: Automatically align robots tags, canonicals, hreflang, and sitemaps