Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is an important and useful improvement. Many domain parkers/squatters/etc who snap up dead domains have robots.txt files that block everything or almost everything, breaking the ability to see the previous site via archive.org.

(Side note: domain name expiration was a mistake.)



A fun thing to do before your website expires is set up HSTS with "includeSubDomains" and enroll your website in HSTS preload. Many of the bots that backorder domains in order to put ad pages on them don't use SSL at all (not even LetsEncrypt) and the domain ends up becoming useless for them.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: