Everybody has their own way of dealing with search engine bots. Not saying that what I say is the God's own truth, but it might be effective, if used properly. Having said that, let's get on with my newest tips for SEO'ing your website - Order and recognizing behaviourial patterns of each individual SE spider.

Order

We all know search engines love text, but if there's one thing which comes close to text as an SE spider favourite - it is order. Bots love alphabetically arranged links, date wise arranged links and category wise arranged links - in that order. Let's say you have a ton of links - to galleries, other linksites, hosted galleries, et al. Start with a list of your categories, arranged alphabetically. Let's call this the index page. Now, for link sites, free hosted galleries and TGP's, arraange your links first by date, and within each date, by alphabet. So that's Category -> Date -> Alphabet. For your own in house galleries, skip the date. It works wonders in ways you won't be able to imagine. I started getting hits for keywords I didn't even know were on my site. Here's an example: You have a list of galleries: Dirty Aly, Dirty Daisy, Dirty Fuckers, Dirty Juliet . Now the title of your page says 'Sex Galleries'. So for a search for "'dirty' 'something' 'sex' and/or 'galleries'" you have a better chance of making it - because whatever you have in your page title counts, the number of times you have 'dirty' in one sentence counts and whatever you have in the URL counts. Can't change the URL, and not sound practise to change the page title, but you can add value to your search results by keeping your links alpabetical.

SE Spider Individuality

Each bot - GoogleBot, Yahoo! Slurp, msnbot and all the others - have things they do, and things they won't do, and it varies from site to site. The trick is to find out the limitations of your site vis-a-vis each bot, and then act accordingly. Here's a few practical examples:

• Bot Visit Frequency - How often does a particular bot visit your site and/or pages? If most of your pages are spidered every day, then you don't have to think too much about it. But if only your index page is spidered everyday, and the other pages maybe once a month or so, then it needs a little tweaking. Fill up your index page with keyword rich words to attract hits to the index page. Keep the links which you want spidered at the top of your page, in bold and link to the important pages from every other page you can. This way, when the spider wants to go through the rest of your pages, it knows which page is important.
• PHP - The GoogleBot won't go through PHP, unless a) Your content is unique and cannot be found elsewhere and b) It considers the page to be very important. The yahoo and msn bots have no such sensitivites, and will eat up PHP the same as HTML. If you have a PHP page which generates another HTML page, the yahoo bot will follow the HTML page to it's source PHP page and spider that one too. The msnbot will even follow sites starting from dynamic trade URL's.
• Galleries - For an adult website, galleries make up a big part of the total content. So, it makes a big difference if your galleries are spidered. Find out which bot is visiting your galleries. Cater to that bot. Keep it happy. New galleries, text, categories, order, whatever. If your galleries start showing up in search results, it will give a big boost to your search engine traffic. Goggle will spider galleries, so will msn, but yahoo is reluctant unless the gallery is being linked to from a lot of external places ( other domains ). Which is why most 'free adult sites' with inhouse galleries recieve more traffic from google than yahoo, while for text based and other content sites, the traffic from both google and yahoo might be closer to each other.
• Revisit After Meta Tag - A small matter, but one that has enormous impact on the behaviour of a bot. If you put in Revisit After 'X' Days, there has to be an update on the page every 'X' days. Once the bot finds the tag, and comes back to the page after 'X' days, finds no update - IT WILL NOT visit the page again until it's indexing your whole site and any further updates you make to that page are pretty useless. So, if you are not sure whether a page is going to updated, or if the page has static content which is unlikely to change, better not to put in the 'Revisit After' meta tag.