For nearly 30 years, robots.txt was just a gentleman’s agreement. Martijn Koster proposed it in 1994, everyone adopted it, but no standards body ever formally defined it. There was no official spec for how crawlers should parse the file, what happens when the server returns a 500, or how wildcard matching works. In September 2022, […]
Vyapar’s blog was running on traditional WordPress. Fully server-rendered, every page request hitting the WP server, and a mobile Performance score of 33 on PageSpeed Insights. LCP was sitting at 7.8 seconds. I owned the migration to a headless WordPress setup end to end. WordPress stays as the CMS backend. Marketing still creates and edits […]
In December 2025, I migrated an entire product site from its own domain to a subdomain under a parent brand. suvit.io became taxone.vyapar.com. 900+ pages. Full rebrand. New DNS, new CDN, new tracking, new Search Console property. Seven months later, the site is recovering and trending upward. But the migration surfaced problems I didn’t expect, […]