coyotino [he/him]@beehaw.org to Technology@beehaw.orgEnglish · 5 months agoMicrosoft and Reddit Are Fighting About Why Bing’s Crawler Is Blocked on Redditwww.404media.coexternal-linkmessage-square35fedilinkarrow-up1110arrow-down10
arrow-up1110arrow-down1external-linkMicrosoft and Reddit Are Fighting About Why Bing’s Crawler Is Blocked on Redditwww.404media.cocoyotino [he/him]@beehaw.org to Technology@beehaw.orgEnglish · 5 months agomessage-square35fedilink
minus-squareMoonrise2473@feddit.itlinkfedilinkarrow-up10·5 months agofor common people they respect and even warn a webmaster if they submit a sitemap that has paths included in robots.txt
for common people they respect and even warn a webmaster if they submit a sitemap that has paths included in robots.txt