.htaccess file for noindex

Hi All

New to Haproxy so need some help.

I currently have my robots.txt on AWS S3 and have a backend that uses it:

http-request set-path {{ robots_url }}

I also want to setup a htaccess file in a similar way if possible to stop my cname domains from being crawled, like this answer here:

Is it possible to do in Haproxy configuration file?

1 post - 1 participant

Read full topic