To get top ranking in google or any search engine you must have properly optimize xml sitemap and robots file. Robot file will block unnecessary crawler to craw your site & save your bandwidth and xml sitemap display all pages of your website that helps all search engine to crawl your website. And you can submit xml sitemap to google and bing webmaster tool which will help you to solve if any errors given by google and bing.
