############################################################################### ### Robots.txt for www.myus.com ############################################### ### Modified: 2009.08.14 (MJD) ############################################### # Allow all crawlers: User-agent: * # Disallow the Perl code: Disallow: /cgi-bin/ # Disallow admin site: Disallow: /admin/ # Disallow JPGs and GIFs: Disallow: /images/ # Disallow our partner landing pages: Disallow: /3015/ Disallow: /309e/ Disallow: /309E/ Disallow: /309p/ Disallow: /309P/ Disallow: /30cc/ Disallow: /30no/ Disallow: /accessnow/ Disallow: /amexsa/ Disallow: /Amexsa/ Disallow: /AMEXSA/ Disallow: /centurionpremiumoffer/ Disallow: /fashionpagina/ Disallow: /FashionPagina/ Disallow: /gmme/ Disallow: /Gmme/ Disallow: /GMME/ Disallow: /gulfregion/ Disallow: /GulfRegion/ Disallow: /holidayshopping/ Disallow: /HolidayShopping/ Disallow: /ingear/ Disallow: /InGear/ Disallow: /members/ Disallow: /members2/ Disallow: /nu15/ Disallow: /nusno/ Disallow: /p15/ Disallow: /paypalca/ Disallow: /plus15/ Disallow: /plusno/ Disallow: /pno/ Disallow: /shoes/ Disallow: /Shoes/ Disallow: /smhicon/ Disallow: /SMHIcon/ Disallow: /smhs/ Disallow: /SMHS/ Disallow: /southafrica/ Disallow: /SouthAfrica/ Disallow: /SOUTHAFRICA/ Disallow: /times2/ Disallow: /Times2/ Disallow: /TIMES2/ Disallow: /trendy/ Disallow: /Trendy/