About Robot.txt in Wapka and Xtgem Websites | Wapka coding help

DONZYWAP What is Robot.txt? This is a text file that is written and can be intepreted by Spiders/Crawlers to abide in rules given to it, and in robots.txt it refers to a particular spider/crawler by its UA (User Agent) in directing it where to crawl in site and where to not. All robots.txt must be saved in the root directory and saved with robots.txt and any spider visiting your site must first look for http: //yoursite.wapka.mobi/robots.txt before accessing the site. What is a Spider/Crawler? Spiders or called Crawlers are programs sent by Search engines to index pages and take results gotten from pages to the search engine, Spiders are also used by Hackers in getting Email address for spamming, and all browser, spiders/crawlers have a unique User Agent used forsurfing the net. What is User Agent? User Agents are just like an Identity Card used by browsers and Spiders in surfing the net in order to be recognised. I have gone through most Wapka sites and I noticed most of them cannot be indexed on the google Search Engine. WHY? The reason is from the default Robot.txt file. Before every crawler/spider crawls a site it must first of all goto the Robot.txt and check the area it must and must not crawl. Now, the default wapka Robot.txt goes like this :

User-agent: SlurpDisallow: /User-agent: *Disallow: Crawl-delay: 60

Copy code

User agent means the name of the crawler, slurp is yahoo, googlebot is google and so on. User agent: * means all the spiders but user agent:slurp or user agent: googlebot specifies the particular spider you are referring to and Disallow : / means that the crawler should not touch or crawl any of your site page. Disallow : means the spider is free to access all your page.User Agent: Slurp Disallow : / means that Google Bot should not touch your site and that's why Wapka sites do not appear in Google Search .If you want your site to be crawled and be visible on all search engine then use this.

User Agent: *Disallow :

Copy code

Login to wapka & select your site. Edit Site > Global Settings > Select Head Tags(meta,style,....) Now, Click On Edit > Robots File ..now in the textarea paste this..

User-agent: Mediapartners-GoogleDisallow:User-agent: *Disallow: /searchAllow: /Sitemap: http://yoursite.wapka.mobi/sitemap.xml

Copy code

change your site url though u can modify it with your own mood but i have given the best robots.txt file that will be best for your site. Setting
Robots.txt on Google: go to google
Webmaster, select site & go to robots.txt tester tools ..u will see a textarea, paste your site robots.txt code in the textarea & click test/submit. Your site robots.txt can be found
on http: //yoursite.wapka.mobi/robots.txt if it shows red alert on your robots.txt that means that the txt has error and the green alert indicates that the txt file is ok. Thats all!!

# 2017-03-19 16:46 · (0)

Igorenupt

DONZYWAP Мостовой кран Мостовой кран. Сравните цены и выберите дешевле! <a href=http://nvzmk.ru/>www.nvzmk.ru</a>

# 2017-03-31 22:16 · (0)

Aldenpag

Igorenupt Andreas Hanson from Lakewood was looking for school satire essays

Darrell Byrne found the answer to a search query school satire essays

Link ----> <a href=https://essayerudite.com>school satire essays</a>

ESSAYERUDITE.COM - Write My Paper

<a href=https://essayerudite.com><img>http://essayerudite.com/images/banner/500x500.jpg</img></a>

study help essay writing, sample essay for elementary studentsthesis for vincent van gogh papersample of an outline for a persuasive essaysample history thesis papershould book titles be underlined in an essay. <a href=http://seringhoki.com/newreply.php?tid=6&load_all_quotes=1>term paper on sex offenders in prison</a> stephen jay gould evolution essay, school satire essays satirical article.
sample of reflection essay for english 101the fountainhead scholarship essayterm paper grading criteriathesis accepted with revisions. the effects of smoking essay <a href=http://customwritingsservice.com/essay-on-moving-to-another-country/>essay on moving to another country</a> sample of master thesis.
scada system research papers. <a href=http://luxuriaescort.com/forum/index.php?topic=86110.new#new>sample thesis in educational technology</a>, summer vacation essay in englishsolutions to maths problemssave energy save money essayspanish essay about sports. thesis binding liverpool street st augustine problem of evil essay!
thesis of architecturethesis on concrete - <a href=http://hamptonparkoptical.com.au/forum/in-neque-arcu-vulputate-vitae/185527-sell-an-essay.html#185513>sell an essay</a> school satire essays and schizophrenia case studies psychology, sat essay writing strategies.
sat essay formula gets high scoressample of a good business plan. sqa past papers chemistry intermediate 2! teaching discursive essay <a href=http://bharatsearch.in/bs/forum/viewtopic.php?f=5&t=75357>the best day of my life essay 150 words</a>.
short essay on internet advantages and disadvantages <a href=http://www.danzhiye.cn/forum.php?mod=viewthread&tid=99683&extra=>thesis citation chicago style</a> technology around us essay. should there be homework why or why not, school satire essays thesis about lord of the flies.
short essay competitionssample essay on self motivationthematic essay world war 1. scholarship essay headings, <a href=http://forum.center-proton.ru/viewtopic.php?f=76&t=170439>thesis evaluative essay</a>, scholarhip essaythe first person perspective and other essaysschool planner app.
stevie wonder research paper <a href=https://essayerudite.com>Essay Writing Service</a>, sample thesis statements for the story of an hoursample personal qualities essay. samples personal essays, spiritual intelligence research papers.
summary and analysis of essay on manseeing god everywhere essays on nature and the sacred - <a href=http://www.majesticmcn.com/forum/showthread.php?tid=211475>springboard definition essay example</a>. school satire essays and short persuasive essay topics, school essays in english pdf.
the alchemist essays personal legend. sample of philosophical essay, <a href=http://hometoday.com.tw/index.php/forum/suggestion-box/235639-sceince-and-technology-essay#235644>sceince and technology essay</a>, teaching beginning essay writing!
structure of a 7 paragraph essaysean gryb phd thesisthe value of life essay examplethesis binding sydney unsw , sample thesis topics in statisticstelevision an idiot box essay. thesis for doctorate, thesis forum supportthematic essays on world war 1technology fahrenheit 451 essaysample of business research paper.

# 2017-04-12 16:20 · (0)

Bible Quiz And Answers	VIEW
Quran Reader	VIEW
Facebook Panel	VIEW
Create logo	VIEW
Web Browsers	VIEW
Search Panel	VIEW

Download More	VIEW
Guest Book	VIEW
Discussion Forum	VIEW
Free walpapers	VIEW
Sports News	VIEW
Football Scores	VIEW
Language Translator	VIEW
Random Facts	VIEW

User Upload Your Files	UPLOAD FILES
Java Games	DOWNLOAD
Symbian Games	DOWNLOAD
Android Games	DOWNLOAD
Android Applications	DOWNLOAD
Symbian Applications	DOWNLOAD

China Games	DOWNLOAD
Prov Files	DOWNLOAD
Handlers Applications	DOWNLOAD
Computer Softwares	DOWNLOAD
Windows Phone Applications	DOWNLOAD
Blackberry Softwares	DOWNLOAD
Java Applications	DOWNLOAD
Android Themes	DOWNLOAD
Android Walpapers	DOWNLOAD
Java Themes	DOWNLOAD
Symbian S60 Themes	DOWNLOAD
Sonny Ericsson Themes	DOWNLOAD
Creat Logos	DOWNLOAD
Online Theme Maker	DOWNLOAD
Funny Pictures	DOWNLOAD
Ebooks	DOWNLOAD

Phyno & Flavour In Their Village at Enugu As They Celebrate With Masquerade (see Photos & Video)

Edo State Decides September 2016 Election!! APC Tells Voters“Thank You For Not Changing The Change

NEW SONG DROP YUNG FLAMES -GUILTY NATION

German Rock Festival Suspended After 72 Injured in Lightning Storm

Tanker Carries 221 Shipwreck Survivors to Safety in Italy

Tropical Rains, Possible Tornadoes Threaten Half of the US By JACOB JORDAN Associated Press

Bill Clinton Opens Up About Muhammad Ali on the Campaign Trail By MATTHEW CLAIBORNE

Hillary Clinton Invokes Muhammad Ali to Bash Donald Trump By LIZ KREUTZ ( @ABCLiz)

Michael J. Fox Reflects on Friendship With Muhammad Ali MORGAN WINSOR

Bernie Sanders Says Voters Shouldn't Have to Choose Against Somebody By MARYALICE PARKS