WordPress indexing for new posts and pages

WordPress powers nearly half the web. Search engines are highly optimized to crawl WordPress architecture, but default settings and bloated themes can easily sabotage your indexing speed. If your new posts are not showing up in Google, here is how to fix your WordPress configuration.

1. The fatal checkbox

The most common reason a WordPress site drops out of search results is a single checkbox. Go to Settings > Reading in your admin dashboard. Ensure that "Discourage search engines from indexing this site" is unchecked. When this is checked, WordPress adds a noindex tag to every single page.

2. Generate a dynamic XML Sitemap

WordPress core creates a basic sitemap, but you need a robust SEO plugin like Yoast SEO, Rank Math, or SEOPress. These plugins dynamically update your sitemap.xml the second you hit "Publish".

Submit this sitemap URL (usually yourdomain.com/sitemap_index.xml) to Google Search Console. This is your baseline for discovery.

3. Control taxonomy bloat

By default, WordPress creates a new URL for every tag, category, author, and date archive. If you use 10 tags per post, you are generating 10 useless, thin-content pages that drain your crawl budget.

• Solution: Use your SEO plugin to set tags, author archives, and date archives to noindex. Keep categories indexable only if they contain unique descriptions and list multiple posts. Force Google to focus on your actual content, not your sorting system.

4. Google Indexing API plugins

If you run a news site or a job board on WordPress, you can use the Google Indexing API for instant discovery. Plugins like "Instant Indexing for Google" automatically ping the API when a post is published or updated.

Warning: Google strictly limits this API to JobPosting and BroadcastEvent data. Using it for standard blog posts violates their terms and can lead to quota suspension. For standard blogs, rely on fast indexing services instead.

5. Site speed and caching

Googlebot will not wait 10 seconds for your heavy WordPress theme to load. If your server is slow, Google reduces its crawl rate to prevent crashing your site. Install a caching plugin (like WP Rocket or LiteSpeed Cache) and compress your images to ensure search bots can fetch your pages in milliseconds.