{"id":313,"date":"2018-07-07T17:45:29","date_gmt":"2018-07-07T12:15:29","guid":{"rendered":"https:\/\/www.techandtrain.com\/blog\/?p=313"},"modified":"2025-10-22T14:55:34","modified_gmt":"2025-10-22T09:25:34","slug":"introduction-to-search-engines-part-1","status":"publish","type":"post","link":"https:\/\/www.techandtrain.com\/blog\/2018\/07\/introduction-to-search-engines-part-1\/","title":{"rendered":"Introduction to Search Engines – Part 1"},"content":{"rendered":"

Search engines have changed the way we work with the digital world completely. Digital world around us including the internet has evolved along with search engines almost simultaneously. Here is a primer on the working, technologies, statistics, history, tips for using, searching, etc. for Google.<\/p>\n

How do they work?<\/strong><\/p>\n

Search engines work to search across billions of web pages, portals, documents, images, articles, news, journals, etc. to bring relevant and ranked results to your device. They do this by using few concepts like META Tags, Linking of web pages & content with each other, citations, source, web page credibility, social media relationships, configurations on websites like robots.txt \/ sitemap, etc.<\/p>\n

Statistics<\/strong><\/p>\n

What you see as result on the first page of Google India is not the same in Google Europe for the same search word. Search results are customized and localized for each country, individual, session and even device at times. Currently as per publicly available statistics Google gets 40,000+ search requests per second which translates to few billion searches per day and would touch almost 1 Trillion searches approximately per year.<\/p>\n

History of Google<\/strong><\/p>\n

Derived from word Googol and started at Stanford University. Initial algorithm was named BackRub.<\/p>\n

Technology<\/strong><\/p>\n

Search engines have a spider \/ crawler which crawls across the internet to search and index \/ store the data in various databases. Ranking algorithm ranks all the content and refines it as per various parameters. Clustered servers across the world process the requests of search and provide content to devices. Lot of optimization based on new searches and corrections for old search terms \/ updating based on content changes happen regularly.<\/p>\n

Tips & Tricks<\/strong><\/p>\n

Try: <vs.> <“EXACT SEARCH TERM”> <“SEARCH TERM -WITH SPECIFIC WORD EXCULED”> <“SITE: Search within a site”> <“DEFINE:”> <“SearchTerm1 * SearchTerm2 – Search everything including both terms and combinations with anything inbetween”><\/p>\n

Explore options of SETTINGS & TOOLS especially in IMAGE Search<\/p>\n

Google Scholar<\/strong><\/p>\n

Search for scholarly papers, articles, theses, journals, books, reports, patents, etc.<\/p>\n

Alternative search engines<\/strong><\/p>\n

Bing, DuckDuckGo, Yippy, Ask, DogPile, Yandex, etc.<\/p>\n

If you want to learn more about the technologies used by search engines, try out:<\/p>\n

Apache Solr<\/a><\/p>\n

Apache Nutch<\/a><\/p>\n

In Part – 2 we will discuss advanced topics like AdWords, AdSense, Google Analytics, Google Search Console, new implications of rankings based on https \/ SSL, details of Nutch & Solr, algorithms for search, other search engines like Yahoo, Bing, etc.<\/p>\n","protected":false},"excerpt":{"rendered":"

Search engines have changed the way we work with the digital world completely. Digital world around us including the internet […]<\/p>\n","protected":false},"author":2,"featured_media":314,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[67],"tags":[68,69],"class_list":["post-313","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-search","tag-google","tag-searchengines-search"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2018\/07\/SearchEngine.jpg?fit=1920%2C1279&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7do02-53","jetpack-related-posts":[{"id":1383,"url":"https:\/\/www.techandtrain.com\/blog\/2024\/11\/how-can-portals-commerce-have-intelligence-via-llms-gai-chatgpt-gemini-etc-part-1\/","url_meta":{"origin":313,"position":0},"title":"How can portals & commerce have intelligence via LLMs\/GAI\/ChatGPT\/Gemini\/etc. – Part 1","author":"Neil Harwani","date":"November 26, 2024","format":false,"excerpt":"Here is my solution template for having intelligence from AI\/GAI\/LLMs in Portals & Commerce - Part 1: Assumptions: Java\/PHP\/Dot Net\/SharePoint\/Liferay\/WordPress\/Drupal type of a portal and \/ or commerce Just like we have HTML - HEAD \/ BODY \/ FOOTER \/ HEADER \/ META TAGS \/ BACKEND LOGIC in Java \/\u2026","rel":"","context":"In "AIML"","block_context":{"text":"AIML","link":"https:\/\/www.techandtrain.com\/blog\/category\/aiml\/"},"img":{"alt_text":"Credits: www.Pixabay.com","src":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/web.jpg?fit=1200%2C800&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/web.jpg?fit=1200%2C800&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/web.jpg?fit=1200%2C800&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/web.jpg?fit=1200%2C800&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/web.jpg?fit=1200%2C800&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":956,"url":"https:\/\/www.techandtrain.com\/blog\/2022\/10\/notes-on-liferay-search-optimization-part-1\/","url_meta":{"origin":313,"position":1},"title":"Notes on Liferay search optimization – Part 1","author":"Neil Harwani","date":"October 1, 2022","format":false,"excerpt":"Notes on Liferay search optimization - Part 1. There are two parts to search optimization in Liferay. One is the internal search and other is the SEO \/ Digital Marketing for content. Below, I am sharing concepts and keywords to explore for both areas. Liferay internal search: Search BluePrintsSearch InsightsCustom\u2026","rel":"","context":"In "Liferay"","block_context":{"text":"Liferay","link":"https:\/\/www.techandtrain.com\/blog\/category\/liferay\/"},"img":{"alt_text":"Credit: www.Pixabay.com","src":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2022\/10\/Search.png?fit=1200%2C573&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2022\/10\/Search.png?fit=1200%2C573&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2022\/10\/Search.png?fit=1200%2C573&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2022\/10\/Search.png?fit=1200%2C573&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2022\/10\/Search.png?fit=1200%2C573&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":297,"url":"https:\/\/www.techandtrain.com\/blog\/2018\/06\/facebook-privacy-security-tips\/","url_meta":{"origin":313,"position":2},"title":"Facebook Privacy & Security tips","author":"Neil Harwani","date":"June 24, 2018","format":false,"excerpt":"Many of us use Facebook for various reasons like socializing on the internet, managing and participating in groups, creating and managing company pages, keeping in touch with friends and colleagues, sharing our updates & pictures, etc. But many don't pay attention to privacy and security aspects of using Facebook. Here\u2026","rel":"","context":"In "Social Media"","block_context":{"text":"Social Media","link":"https:\/\/www.techandtrain.com\/blog\/category\/social-media\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2018\/06\/Facebook.jpg?fit=1200%2C797&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2018\/06\/Facebook.jpg?fit=1200%2C797&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2018\/06\/Facebook.jpg?fit=1200%2C797&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2018\/06\/Facebook.jpg?fit=1200%2C797&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2018\/06\/Facebook.jpg?fit=1200%2C797&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":1376,"url":"https:\/\/www.techandtrain.com\/blog\/2024\/11\/possibilities-for-ai-powered-features-in-liferay-part-1-via-chatgpt-gemini\/","url_meta":{"origin":313,"position":3},"title":"Possibilities for AI powered features in Liferay – Part 1 via ChatGPT & Gemini","author":"Neil Harwani","date":"November 17, 2024","format":false,"excerpt":"A good list on possibilities for AI powered features in Liferay - Part 1 from GAI\/LLMs. Sharing here for everyone's benefit. Came across during talking to ChatGPT and Gemini, very good ideas - some are inbuilt, some need customizations. Possibilities are endless. ******************************** Liferay, a digital experience platform (DXP), integrates\u2026","rel":"","context":"In "AIML"","block_context":{"text":"AIML","link":"https:\/\/www.techandtrain.com\/blog\/category\/aiml\/"},"img":{"alt_text":"Credits: www.Pixabay.com","src":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/Mountain.png?fit=1200%2C872&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/Mountain.png?fit=1200%2C872&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/Mountain.png?fit=1200%2C872&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/Mountain.png?fit=1200%2C872&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/Mountain.png?fit=1200%2C872&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":1252,"url":"https:\/\/www.techandtrain.com\/blog\/2024\/04\/search-related-techno-functional-tips-part-1\/","url_meta":{"origin":313,"position":4},"title":"Search related techno-functional tips – Part 1","author":"Neil Harwani","date":"April 27, 2024","format":false,"excerpt":"We can search a lot of things using Elasticsearch \/ SOLR or similar appliances by Google etc. but we can't load everything in memory generally. It will simply overwhelm the heap and the processing engine with lot of calculations depending on type of system. That necessitates us to device proper\u2026","rel":"","context":"In "Elasticsearch"","block_context":{"text":"Elasticsearch","link":"https:\/\/www.techandtrain.com\/blog\/category\/elasticsearch\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/04\/Search.png?fit=1200%2C675&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/04\/Search.png?fit=1200%2C675&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/04\/Search.png?fit=1200%2C675&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/04\/Search.png?fit=1200%2C675&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/04\/Search.png?fit=1200%2C675&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":1380,"url":"https:\/\/www.techandtrain.com\/blog\/2024\/11\/web-portal-commerce-cyber-forensics\/","url_meta":{"origin":313,"position":5},"title":"Web portal & commerce cyber forensics","author":"Neil Harwani","date":"November 24, 2024","format":false,"excerpt":"For this discussion, we will refer the top open-source products like Liferay, Drupal, WordPress, etc. and one proprietary portal like SharePoint which has good documentation. Home - Liferay WordPress.com: Build a Site, Sell Your Stuff, Start a Blog & More Drupal - Open Source CMS | Drupal.org Microsoft SharePoint Online\u2026","rel":"","context":"In "Cyber Forensics"","block_context":{"text":"Cyber Forensics","link":"https:\/\/www.techandtrain.com\/blog\/category\/cyber-forensics\/"},"img":{"alt_text":"Credits: www.Pixabay.com","src":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/interface.png?fit=1200%2C801&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/interface.png?fit=1200%2C801&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/interface.png?fit=1200%2C801&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/interface.png?fit=1200%2C801&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.techandtrain.com\/blog\/wp-content\/uploads\/2024\/11\/interface.png?fit=1200%2C801&ssl=1&resize=1050%2C600 3x"},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/posts\/313","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/comments?post=313"}],"version-history":[{"count":3,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/posts\/313\/revisions"}],"predecessor-version":[{"id":317,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/posts\/313\/revisions\/317"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/media\/314"}],"wp:attachment":[{"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/media?parent=313"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/categories?post=313"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.techandtrain.com\/blog\/wp-json\/wp\/v2\/tags?post=313"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}