DONZYWAP
What is Robot.txt? This is a text file that is written and can be intepreted by
Spiders/Crawlers to abide in rules given to it, and in
robots.txt it refers to a particular spider/crawler by its
UA (
User Agent) in directing it where to crawl in site and where to not. All
robots.txt must be saved in the root directory and saved with
robots.txt and any spider visiting your site must first look for
http: //yoursite.wapka.mobi/robots.txt before accessing the site.
What is a Spider/Crawler? Spiders or called Crawlers are programs sent by Search engines to index pages and take results gotten from pages to the search engine, Spiders are also used by Hackers in getting Email address for spamming, and all browser, spiders/crawlers have a unique User Agent used forsurfing the net.
What is User Agent? User Agents are just like an Identity Card used by browsers and Spiders in surfing the net in order to be recognised. I have gone through most Wapka sites and I noticed most of them cannot be indexed on the google Search Engine.
WHY? The reason is from the default Robot.txt file. Before every crawler/spider crawls a site it must first of all goto the Robot.txt and check the area it must and must not crawl. Now, the default wapka Robot.txt goes like this :
User-agent: SlurpDisallow: /User-agent: *Disallow: Crawl-delay: 60
Copy code
User agent means the name of the crawler,
slurp is yahoo,
googlebot is google and so on.
User agent: * means all the spiders but
user agent:slurp or
user agent: googlebot specifies the particular spider you are referring to and
Disallow : / means that the crawler should not touch or crawl any of your site page.
Disallow : means the spider is free to access all your page.
User Agent: Slurp Disallow : / means that Google Bot should not touch your site and that's why Wapka sites do not appear in Google Search .If you want your site to be crawled and be visible on all search engine then use this.
Login to wapka & select your site. Edit Site > Global Settings > Select Head Tags(meta,style,....) Now, Click On Edit > Robots File ..now in the textarea paste this..
User-agent: Mediapartners-GoogleDisallow:User-agent: *Disallow: /searchAllow: /Sitemap: http://yoursite.wapka.mobi/sitemap.xml
Copy code
change your site url though u can modify it with your own mood but i have given the best robots.txt file that will be best for your site.
Setting
Robots.txt on Google: go to google
Webmaster, select site & go to robots.txt tester tools ..u will see a textarea, paste your site robots.txt code in the textarea & click test/submit. Your site robots.txt can be found
on
http: //yoursite.wapka.mobi/robots.txt if it shows red alert on your robots.txt that means that the txt has error and the green alert indicates that the txt file is ok. Thats all!!
Igorenupt
DONZYWAP Мостовой кран Мостовой кран. Сравните цены и выберите дешевле! <a href=http://nvzmk.ru/>www.nvzmk.ru</a>
Aldenpag
Igorenupt Andreas Hanson from Lakewood was looking for <i>school satire essays</i>
Darrell Byrne found the answer to a search query <i>school satire essays</i>
Link ----> <b><a href=https://essayerudite.com>school satire essays</a></b>
ESSAYERUDITE.COM - Write My Paper
<a href=https://essayerudite.com><img>http://essayerudite.com/images/banner/500x500.jpg</img></a>
study help essay writing, sample essay for elementary studentsthesis for vincent van gogh papersample of an outline for a persuasive essaysample history thesis papershould book titles be underlined in an essay. <a href=http://seringhoki.com/newreply.php?tid=6&load_all_quotes=1>term paper on sex offenders in prison</a> stephen jay gould evolution essay, school satire essays satirical article.
sample of reflection essay for english 101the fountainhead scholarship essayterm paper grading criteriathesis accepted with revisions. the effects of smoking essay <a href=http://customwritingsservice.com/essay-on-moving-to-another-country/>essay on moving to another country</a> sample of master thesis.
scada system research papers. <a href=http://luxuriaescort.com/forum/index.php?topic=86110.new#new>sample thesis in educational technology</a>, summer vacation essay in englishsolutions to maths problemssave energy save money essayspanish essay about sports. thesis binding liverpool street st augustine problem of evil essay!
thesis of architecturethesis on concrete - <a href=http://hamptonparkoptical.com.au/forum/in-neque-arcu-vulputate-vitae/185527-sell-an-essay.html#185513>sell an essay</a> school satire essays and schizophrenia case studies psychology, sat essay writing strategies.
sat essay formula gets high scoressample of a good business plan. sqa past papers chemistry intermediate 2! teaching discursive essay <a href=http://bharatsearch.in/bs/forum/viewtopic.php?f=5&t=75357>the best day of my life essay 150 words</a>.
short essay on internet advantages and disadvantages <a href=http://www.danzhiye.cn/forum.php?mod=viewthread&tid=99683&extra=>thesis citation chicago style</a> technology around us essay. should there be homework why or why not, school satire essays thesis about lord of the flies.
short essay competitionssample essay on self motivationthematic essay world war 1. scholarship essay headings, <a href=http://forum.center-proton.ru/viewtopic.php?f=76&t=170439>thesis evaluative essay</a>, scholarhip essaythe first person perspective and other essaysschool planner app.
stevie wonder research paper <a href=https://essayerudite.com>Essay Writing Service</a>, sample thesis statements for the story of an hoursample personal qualities essay. samples personal essays, spiritual intelligence research papers.
summary and analysis of essay on manseeing god everywhere essays on nature and the sacred - <a href=http://www.majesticmcn.com/forum/showthread.php?tid=211475>springboard definition essay example</a>. school satire essays and short persuasive essay topics, school essays in english pdf.
the alchemist essays personal legend. sample of philosophical essay, <a href=http://hometoday.com.tw/index.php/forum/suggestion-box/235639-sceince-and-technology-essay#235644>sceince and technology essay</a>, teaching beginning essay writing!
structure of a 7 paragraph essaysean gryb phd thesisthe value of life essay examplethesis binding sydney unsw , sample thesis topics in statisticstelevision an idiot box essay. thesis for doctorate, thesis forum supportthematic essays on world war 1technology fahrenheit 451 essaysample of business research paper.
08103699537
donshalchy
