Following the search engine rules will solve crawl-ability problems and improve SEO. Whenever you launch a website, make an invitation to the search engine.