hey me aaj apko ek robots.txt kya hota hai..kam kya karta hai or isko add kese kare

robots.txt Kya hai

Ye ek text file hi hoti hai jo har site me hoti hai, Blogger me automatic hi generate ho jati hai.. Isse Search engine jese Google, Yahoo, Bing ko batate hai ki kya kya index kare or kya nahi kare.. Jese maan lijiye aap ne koi Page banaya, koi Labels, ya fir koi Post jo aap nahi chate ki search me aaye to aap usko disallow kar sakte hai robots.txt ki madad se..
Har site ki robots.txt file ki link aesi hoti hai –
www.website.com/robots.txt

Robots.txt ka kaam kya hai

Jab bhi koi search engine ka bot hamari site par aata hai site ko search me index karne ke liye to sabse phele wo robots.txt ko hi dekhta hai usse usko pata chal jata hai kya index karke search me dikhana hai or kya nahi.
Simple Sabdo me – Ye ek Robot hota hai apni site ka jo Search Engine jab apni site par aata hai to unko batata hai kaha par permission hai aapko.
Jese ki aap jabte hoge me Blogger.com ke bare me bata raha hu. to ye article sirf Blogger ke liye hai.

Blogger ki Robots.txt File kaise banaye

Iske liye aap simple me jo site bata raha hu aap uspar jaye

Robots.txt Generate kare!

Ab jo site khulegi, usne apne blog ka pura address dale http:// ke sath
jese http://hindimehelp.blogspot.com

1. Apne blog ka address dale HTTP:// ke sath
2. Generate Sitemap par click kare

*Site Map kaise Add karte hai Google search Console me uske bare me mene yaha bataya hai, Jo site map ke bare me mene bha bataya hai, usme jo code ham use karte hai wo yaha bhi generate kar sakte hai.
Ab ek Code Generate hoga, usko Copy karle

To aapka Code to teyaa hai, Chaliye ab dekhte hai kaise or kaha isko blogger me add kare

Ye Setting Agar aapne Galat kari to ho sakta hai aapki Site Search Engine Ignore karde or aapki site search me naa aaye. Diya se kare or agar samaj nahi aaye to isko naa kare..

Blogger ki Custom Robots.txt file add kare

Sabse phele Blogger ke account me login kare
Settings >> Search Preferences >> Custom robots.txt me jaye fir Edit par click kare.

Ab Yes par tik karke apna Code daalde Box me.

Save Changes par click kare.
ab ye to huaa kaise banate hai or kaise add karte hai.. Chaliye ab jaante hai agar hame koi Page, Post, Labels ko disallow karna ho search me to kaise kare..
ye bhi Pade : Blog ki Traffic badane ke tarike

Robots.txt Allow/DisAllow kaise kare

Important Note: agar aapko achi se samaj aa raha ho jab hi kre nahi to kuch nahi kare.. isse aapki site ke search par asar padega.
Agar kisi Page ko Search me nahi Dikhana hai to aap usko Disallow ke sath likh sakte hai
jese maal lijiye koi page hai jisko aap nahi chate ki index ho to –
disallow: Disallow: /p/about-us.html
agar koi labels hai to –
Disallow: /search/label/yourlabel
Post ko Disallow kare –
Disallow: /2015/08/my-blog-posts.html
Issi trha agar maan lijiye aapko pure page ko disallow karna hai to
Disallow: /p
or agar kuch allow karna hai jese
Allow: /p/About-us.html
Is trha aap apne hisab se set kar sakte hai kya index kare or kya naa kare search engines

Read more: http://hindimehelp.com/blogger-robots-txt/#ixzz3tTQx2Fjo