# Todos los bots sin grupo propio User-agent: * # Backend, sesion y datos privados. NO se bloquea /web/ entero: ver DEU-0020. Disallow: /web$ Disallow: /web/login Disallow: /web/signup Disallow: /web/reset_password Disallow: /web/session Disallow: /web/dataset Disallow: /web/webclient Disallow: /web/database # Estatico que Google NECESITA para renderizar y para el favicon. Allow: /web/assets/ Allow: /web/image/ Allow: /web/content/ # Cuenta, carrito, pago y formularios. Disallow: /my/ Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/confirmation Disallow: /website/form/ Disallow: /website/info Disallow: /sell-your-device/login Disallow: /sell-your-device/offer Disallow: /sell-your-device/continue-to-offer Disallow: /sell-your-device/select-features Disallow: /buyback/success Disallow: /buyback/terms Disallow: /customers Disallow: /recompra-pantallas-gracias # Tienda con filtro, orden o precio: combinaciones sin valor de busqueda, # canonicalizadas a la categoria limpia. La categoria limpia y la ficha, abiertas. Disallow: /shop*?*attrib= Disallow: /shop*?*order= Disallow: /shop*?*min_price= Disallow: /shop*?*max_price= # Busqueda interna: lleva noindex,follow. Googlebot y Bingbot si entran, para leerlo. Disallow: /shop*?*search= # Buscadores: pueden leer el noindex de la busqueda (DEC-0002) User-agent: Googlebot User-agent: Bingbot # Backend, sesion y datos privados. NO se bloquea /web/ entero: ver DEU-0020. Disallow: /web$ Disallow: /web/login Disallow: /web/signup Disallow: /web/reset_password Disallow: /web/session Disallow: /web/dataset Disallow: /web/webclient Disallow: /web/database # Estatico que Google NECESITA para renderizar y para el favicon. Allow: /web/assets/ Allow: /web/image/ Allow: /web/content/ # Cuenta, carrito, pago y formularios. Disallow: /my/ Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/confirmation Disallow: /website/form/ Disallow: /website/info Disallow: /sell-your-device/login Disallow: /sell-your-device/offer Disallow: /sell-your-device/continue-to-offer Disallow: /sell-your-device/select-features Disallow: /buyback/success Disallow: /buyback/terms Disallow: /customers Disallow: /recompra-pantallas-gracias # Tienda con filtro, orden o precio: combinaciones sin valor de busqueda, # canonicalizadas a la categoria limpia. La categoria limpia y la ficha, abiertas. Disallow: /shop*?*attrib= Disallow: /shop*?*order= Disallow: /shop*?*min_price= Disallow: /shop*?*max_price= # Bots de IA: permitidos, con las mismas reglas que todos User-agent: GPTBot User-agent: ClaudeBot User-agent: PerplexityBot User-agent: Google-Extended User-agent: Applebot-Extended # Backend, sesion y datos privados. NO se bloquea /web/ entero: ver DEU-0020. Disallow: /web$ Disallow: /web/login Disallow: /web/signup Disallow: /web/reset_password Disallow: /web/session Disallow: /web/dataset Disallow: /web/webclient Disallow: /web/database # Estatico que Google NECESITA para renderizar y para el favicon. Allow: /web/assets/ Allow: /web/image/ Allow: /web/content/ # Cuenta, carrito, pago y formularios. Disallow: /my/ Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/confirmation Disallow: /website/form/ Disallow: /website/info Disallow: /sell-your-device/login Disallow: /sell-your-device/offer Disallow: /sell-your-device/continue-to-offer Disallow: /sell-your-device/select-features Disallow: /buyback/success Disallow: /buyback/terms Disallow: /customers Disallow: /recompra-pantallas-gracias # Tienda con filtro, orden o precio: combinaciones sin valor de busqueda, # canonicalizadas a la categoria limpia. La categoria limpia y la ficha, abiertas. Disallow: /shop*?*attrib= Disallow: /shop*?*order= Disallow: /shop*?*min_price= Disallow: /shop*?*max_price= # Busqueda interna: lleva noindex,follow. Googlebot y Bingbot si entran, para leerlo. Disallow: /shop*?*search= # Meta: portada, categorias, fichas e imagenes abiertas; combinaciones de /shop no User-agent: meta-externalads User-agent: meta-externalagent # Backend, sesion y datos privados. NO se bloquea /web/ entero: ver DEU-0020. Disallow: /web$ Disallow: /web/login Disallow: /web/signup Disallow: /web/reset_password Disallow: /web/session Disallow: /web/dataset Disallow: /web/webclient Disallow: /web/database # Estatico que Google NECESITA para renderizar y para el favicon. Allow: /web/assets/ Allow: /web/image/ Allow: /web/content/ # Cuenta, carrito, pago y formularios. Disallow: /my/ Disallow: /shop/cart Disallow: /shop/checkout Disallow: /shop/payment Disallow: /shop/confirmation Disallow: /website/form/ Disallow: /website/info Disallow: /sell-your-device/login Disallow: /sell-your-device/offer Disallow: /sell-your-device/continue-to-offer Disallow: /sell-your-device/select-features Disallow: /buyback/success Disallow: /buyback/terms Disallow: /customers Disallow: /recompra-pantallas-gracias # Tienda con filtro, orden o precio: combinaciones sin valor de busqueda, # canonicalizadas a la categoria limpia. La categoria limpia y la ficha, abiertas. Disallow: /shop*?*attrib= Disallow: /shop*?*order= Disallow: /shop*?*min_price= Disallow: /shop*?*max_price= # Busqueda interna: lleva noindex,follow. Googlebot y Bingbot si entran, para leerlo. Disallow: /shop*?*search= Sitemap: https://www.removiles.com/sitemap.xml