From: Tony on
I've searched the web & can't find an answer to this.

Is it possible to successfully use Response.AddHeader for a robots meta tag?

For example, I want to do

<%
IF request("PageID") = 252 THEN Response.AddHeader "robots", "noindex"
:
%>



From: Bob Milutinovic on

"Tony" <TonyB77(a)yahoo.com> wrote in message
news:OgmjFletIHA.1772(a)TK2MSFTNGP03.phx.gbl...
> I've searched the web & can't find an answer to this.
>
> Is it possible to successfully use Response.AddHeader for a robots meta
> tag?
>
> For example, I want to do
>
> <%
> IF request("PageID") = 252 THEN Response.AddHeader "robots", "noindex"
> :
> %>

It looks like you're confusing response headers with the HTML "head"
section; the two are entirely unrelated.

The response header is the data block sent back to the browser by the web
server which passes things like the result code, cookies, etc., and which
you never get to see (unless you're doing "raw" browsing with something like
SamSpade or Lynx).

The HTML "head" section is actually simply a part of the HTML stream, which
the server pays no attention to as a separate entity from the "body" or any
other part of the stream. It's this location that you'll need to add your
"robots" directive to, as a meta tag (you'll find plenty of references to
the "robots" meta tag using Google).

- Bob.


From: Dave Anderson on
"Bob Milutinovic" wrote:
> The response header is the data block sent back to the browser by
> the web server which passes things like the result code, cookies,
> etc., and which you never get to see (unless you're doing "raw"
> browsing with something like SamSpade or Lynx).

On a side note, you can add a [Headers] tab to the [Page Info] window in
Firefox, by adding the "Live HTTP Headers" extension:
https://addons.mozilla.org/en-US/firefox/addon/3829

In addition, you can use the extension to capture a log of all[1]
request/response headers, and use its "replay" feature to tweak your request
headers before re-submitting a request (this includes all headers and even
POST body content).



[1] You can filter out immaterial request info, such as image and css
requests

--
Dave Anderson

Unsolicited commercial email will be read at a cost of $500 per message. Use
of this email address implies consent to these terms.

From: Tony on
"Bob Milutinovic" wrote...
>
> "Tony" wrote ...
> > I've searched the web & can't find an answer to this.
> >
> > Is it possible to successfully use Response.AddHeader for a robots meta
> > tag?
> >
> > For example, I want to do
> >
> > <%
> > IF request("PageID") = 252 THEN Response.AddHeader "robots", "noindex"
> > :
> > %>
>
> It looks like you're confusing response headers with the HTML "head"
> section; the two are entirely unrelated.

No, I'm afraid that you are confused.

What you are discussing is correctly called the HTTP Headers, not the "response
headers".


>
> The response header is the data block sent back to the browser by the web
> server which passes things like the result code, cookies, etc., and which
> you never get to see (unless you're doing "raw" browsing with something like
> SamSpade or Lynx).
>
> The HTML "head" section is actually simply a part of the HTML stream, which
> the server pays no attention to as a separate entity from the "body" or any
> other part of the stream. It's this location that you'll need to add your
> "robots" directive to, as a meta tag (you'll find plenty of references to
> the "robots" meta tag using Google).

Duh.

You can modify some HTTP meta response by adding comments within the <HEAD></HEAD>
section.

My original question, is do search bots bother to read the HTTP headers for a robots
name/content pair.




From: Tony on
"Tony" wrote...
:> You can modify some HTTP meta response by adding comments within the <HEAD></HEAD>
> section.

Sorry spellcheck.

That should have read:
You can modify some HTTP meta response by adding CONTENT within the <HEAD></HEAD>
section.