When it comes to marketing there are very few new ideas and this is the same in internet marketing and website promotion as with any other form of business promotion.

So when you see another website above yours in the rankings what can you do about it?

The first thing is to prepare a Search Engine Optimisation strategy plan and one of the best places to start this is to identify your competitors and see how they are outranking you at the moment, you need to analyse the structure of there site, what keywords have they targeted, how have they used the keywords on the page what links to they have coming back to them and which of these links is producing the most benefit for them.

You then need to prioritise the work that needs doing so you can get the most benefit from it in the shortest time.

The keyword research is the key to this and once you have this solid base you can more forward from there to take advantage of the other things you have learned about your competitors site.

It is important to have robots txt on your site, this allows you a degree of control over where the search engine spiders visit and what they report and store in their index about your site, this allows you to keep them away from commercially sensitive material or out of member only information if you have a membership area on the site.

Matt Cutts a leading engineer at Google has produced a video that explains the robots txt in more detail and and answes some questions such as

Why is my url showing up in Google when I blocked it in robots.txt? Did you fetch that url?

How do I make that url disappear from Google?

The video can be seen on Matts Blog at http://www.mattcutts.com/blog/robots-txt-remove-url/

This is going to be be of interest to any one who needs to know how to sculpt the page rank of their sites to ensure they are getting the most from the search engines.

This is an important part of search engine optimisation and implementing these changes on your site in the appropriate manor can help your rankings in the search engines.

One word of advice, do not go too over board with the robots txt file or you might find you have stopped the search engines indexing some important parts of your website and this will see you fall in the rankings rather than rise.