How has Google crawled and indexed links on a webpage?

easytake456

New Member
Hey Guys,

Has any one known about ways that Google has crawled and indexed links on a webpage?

which tool or software Google is using for this task?
 

PTTed

Active Member
Hey Guys,

Has any one known about ways that Google has crawled and indexed links on a webpage?

which tool or software Google is using for this task?

Here is the best explanation I think you will find about how Google crawls and indexes web pages.
Here is another good explanation.

Basically Google uses computers to go look for new web pages and to check for any changes to existing web pages. The computers go fetch the documents and then analyze them.

When Google sees a link to a URL that it didn't know about before, then it schedules a computer (Googlebot) to go fetch that new page.

So Google discovers new web pages when a human submits a new web page to them or when they discover a new URL on a web page they just fetched.
 

elasticcat

Member
When Google sees a link to a URL that it didn't know about before, then it schedules a computer (Googlebot) to go fetch that new page.
Googlebot will fetch and rendering content on a webpage to create cached version and making indexed pages on search engine results for a website?
 

PTTed

Active Member
Googlebot will fetch and rendering content on a webpage to create cached version and making indexed pages on search engine results for a website?

Yes. Googlebot fetches a web page. The page then gets analyzed according to all of the metrics that Google measures such as the number of times a certain word appears, what words are emphasized on the page (bold or larger font sizes or located in headers, etc.), what images are on the page, among many other things. It also makes a list of the URL's and whether the links to those URL's are regular links or nofollowed.

The analysis and breakdown of that page then determines what searches that page might show up for if and when those searches ever occur.
 
Top