A new article has been posted, but it is not appearing in the sitemap
- Let’s start by dividing them based on whether or not they are listed in the sitemap.
- Reasons why the answer may not appear immediately after publication, even when refreshing the screen.
- Here is the order in which you can check things without using a plugin:
- The most common points of failure when verifying directly.
- Handle the situation differently depending on whether a URL is present or absent.
- When a new article does not have an XML entry with a URL.
- The XML file contains a URL, but it is not appearing in the search results.
- Will resubmitting the sitemap expedite the process?
- Organizing the scope of WordPress checks using SOHO SEO.
- What will you choose from my website now?
- Frequently Asked Questions.
- WordPress-related links
If a new article is uploaded but does not appear in the sitemap, it is essential to first determine whether the article has actually been omitted. There is a significant difference between cases where the URL is missing from the XML file and cases where the URL is present but the Search Console screen has not yet been updated.
The conclusion is simple. Directly open the sitemap URL, check the new article URL, and then examine the publication status and search engine blocking settings. If the URL already exists, it is difficult to consider it an error simply because it does not appear directly in the Search Console.
Let’s start by dividing them based on whether or not they are listed in the sitemap.
A sitemap is an XML file that informs search engines about the list of URLs on a website. Starting with WordPress 5.5, a basic sitemap is typically provided at your site’s address followed by /wp-sitemap.xml without the need for a separate plugin.
The phrase “not reflected,” as used by the site operator, encompasses two distinct situations. Either the exact URL of a new article is completely absent from the XML file, or the URL exists but the search console report and the indexing status have not yet been updated.
Crawling is the process by which Google visits web pages. Indexing is the process of processing the content so that it can be included in search results.
The two are not the same.
Reasons why the answer may not appear immediately after publication, even when refreshing the screen.
When a new article is published, the following processes occur separately: a sitemap file is created, Google verifies the file, the article is visited, and a determination is made about whether to include it in search results. These processes are not handled simultaneously.
Google states that it may take at least a few days for new pages or modifications to be reflected on most websites. This means that it is unlikely to index content on the day it is published, unless it is highly time-sensitive content like news.
Therefore, submitting a sitemap to the Search Console does not immediately result in new articles being indexed. A sitemap is a hint that provides URLs, but it is not a queue for scheduling indexing.
Waiting is also part of the inspection process.
Here is the order in which you can check things without using a plugin:
Do not change the plugin or submit the sitemap multiple times from the beginning. By following the steps below, you can avoid mixing file-related issues with indexing problems.
- Open the site address/wp-sitemap.xml file in your browser.
- Follow the sub-sitemap corresponding to the article list.
- Find the exact URL of the new article in the XML.
- In the administrator screen, check whether the article is in a published state.
- Check that the search engine blocking setting is not enabled for the entire site.
- Check the site’s URL/robots.txt file to ensure that the new article’s path is not being blocked.
- In Search Console’s URL inspection feature, directly inspect the specified URL.
Articles that are not publicly accessible or are protected by a password cannot be accessed by general visitors. It is not unusual for such articles not to appear in the sitemap or for Google to be unable to read them.
If a page has the “noindex” setting, Google may exclude it from search results. On the other hand, if robots.txt blocks access, Google may not be able to read the “noindex” directive within the page.
The two settings do not have the same function.
When checking a URL, also verify that it is not being blocked, that it does not have a “noindex” directive, and that there are no server errors. Even if a page opens normally, it does not guarantee that it will be indexed, but at least you can narrow down where the problem might be occurring.
The most common points of failure when verifying directly.
It is often confusing to determine which sitemap is actually being used. A basic WordPress sitemap and a sitemap from an SEO plugin can both exist simultaneously, and the site operator may verify one URL while submitting a different URL to the search console.
Even when opening the XML file, it is difficult to determine which sitemap a new article has been added to. Furthermore, it is challenging to determine whether a URL has been indexed based solely on its existence. This is because it is necessary to check the public status, robots.txt file, noindex directive, and server response individually.
Direct inspection is useful for narrowing down the cause, but in sites with multiple overlapping configurations, it is difficult to distinguish between the cause of the omission and indexing delays at the same time. Repeated verification also takes time.
Specifically, if you need to check the featured image, title, author, and mobile screen and page experience for each article individually, it is easy for site map issues and the article’s own checklist items to become mixed up. At this point, the Post SEO checklist in SOHO SEO allows you to check the SEO score and corresponding items for each article at a glance. While it does not directly determine site map omissions or indexing delays, it can be used as a supplementary tool to check for elements that may have been missed at the article level.
The tool is only intended to assist with verification.
The final determination should be based on the actual XML file and the results of the URL verification in the Search Console.
Handle the situation differently depending on whether a URL is present or absent.
When a new article does not have an XML entry with a URL.
First, fix the article’s publication status and the site-wide search engine blocking settings. Then, check whether the article type is included in the sitemap, and verify which URL is actually used: either the default WordPress sitemap or the sitemap from the SEO plugin.
If the entities responsible for creating the sitemap are divided, there is a risk of confusion where one entity submits a different URL to the search console than the one listed in the sitemap. It is generally easier to manage if the submitted sitemap URLs are consolidated into a single set.
If the URL is missing, first correct the settings.
The XML file contains a URL, but it is not appearing in the search results.
If the URL is present in the sitemap and the page opens correctly, first check for any blocks, noindex directives, and server responses in the URL inspection tool. If there are no issues, the next step is to allow several days for processing.
The following improvements can be made: adding general links from related articles, categories, and menus to the new article. However, even with the addition of internal links, the indexing or search ranking is not guaranteed.
If a URL is provided, there may be an indexing delay.
Will resubmitting the sitemap expedite the process?
While it is possible to resubmit a sitemap through the Search Console, Google does not guarantee that it will immediately download the file or crawl the URL. Submitting the same sitemap multiple times a day is not recommended.
If repetitive checks are cumbersome, you can consider using a WordPress plugin as an auxiliary tool. However, the actual XML file and the URL inspection results from Search Console remain the final standard.
Resubmission is not an all-purpose solution.
Organizing the scope of WordPress checks using SOHO SEO.
If you need to manage the sitemap URL and search exclusion settings within WordPress, then SOHO SEO addresses the issues discussed in this article. In the sitemap settings, you can enable or disable both the standard XML sitemap and the Google News sitemap, which contains articles published within the last 48 hours. You can also edit the robots.txt file in the robots.txt & llms.txt section.
Areas that rarely need to be excluded from search results, such as dates, authors, tags, site-wide search results, and selected taxonomy archive pages, can be distinguished using the “noindex” management feature. If you frequently manually link related articles or external reference documents between articles, you can use the “Internal/external link management” feature to find candidate words and apply links. However, this does not replace the actual XML file and the URL inspection results in the Search Console. Also, the “noindex” management feature is not a function to exclude individual articles and pages from search results.
What will you choose from my website now?
If the new article’s URL is not present in the XML file, first correct the following: its publication status, whether it is blocked by search engines, and whether the article type is included. After that, consolidate the actually submitted sitemap URL from either the default sitemap or the plugin sitemap into one.
If a URL already exists in the XML sitemap, do not immediately conclude that there is a “sitemap error.” If the URL passes the inspection and opens normally, it is reasonable to strengthen the internal links and wait for several days.
The state of being included in the sitemap and the state of being included in the Google index must be managed separately throughout the entire process.
- Does the new article URL actually exist in the XML file?
- Is the article publicly accessible and not protected by a password?
- Is the search engine blocking setting not enabled?
- Is the robots.txt file blocking access to the article path?
- Are there any “noindex” directives or server errors?
- Are you repeatedly resubmitting the sitemap when you should be waiting?
Frequently Asked Questions.
Q. What should I check first on my website?
A. First, check the actual sitemap XML file to see if the new article’s URL exists. If the URL is not present, verify the publication status, whether it is blocked by search engines, and the article type. If the URL is present, check for “noindex” directives and server errors using the URL inspection tool in the Search Console.
Q. Why does a page not appear in search results even though it has a URL listed in the sitemap?
A. It is possible that Google has not yet crawled the URL, or that it has not indexed the content after processing it. A sitemap is a helpful hint for discovery, but it does not guarantee search engine visibility.
Q. Can this problem be easily verified using a tool? What kind of tool should be used?
A. You can use tools as assistants to check the sitemap and indexing status. However, the actual sitemap XML file and the URL inspection results in the Search Console are the final criteria.
Q. Can I manage the sitemap and search exclusion settings together in WordPress?
In SOHO SEO, you can enable or disable both standard XML sitemaps and Google News sitemaps, and manage search exclusion settings for archive pages, including dates, authors, tags, and search results within the site.
You can also edit the robots.txt file. However, whether the changes are actually reflected can only be confirmed by checking the XML file and the URL inspection results in the Search Console.