Rendered at 13:45:23 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
mathisdev7 2 hours ago [-]
Nice, thanks!
edit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie
seandotexe 1 hours ago [-]
Thank you for catching! The docs were a bit too eager on the package simplifying I worked on (oops!).. "npm i -g crawlie" is now correct
we're shipping fast, will break less things now though I promise ;)
SeriousM 7 hours ago [-]
That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.
seandotexe 5 hours ago [-]
Thank you!! Lots more to come
Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.
davekilleen 2 hours ago [-]
Nice
seandotexe 1 hours ago self.__VINEXT_RSC_CHUNKS__=self.__VINEXT_RSC_CHUNKS__||[];self.__VINEXT_RSC_CHUNKS__.push("e:I[\"6ed23a8ff0cc\",[],\"default\",1]\nc:[\"$\",\"div\",null,{\"className\":\"_comments_4x64e_1\",\"children\":[[\"$\",\"$Le\",\"48597591\",{\"id\":48597591,\"user\":\"mathisdev7\",\"text\":\"Nice, thanks!\u003cp\u003eedit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie\u003c/p\u003e\",\"date\":1781870393000,\"comments\":[{\"id\":48597824,\"user\":\"seandotexe\",\"text\":\"Thank you for catching! The docs were a bit too eager on the package simplifying I worked on (oops!).. \\\"npm i -g crawlie\\\" is now correct\u003cp\u003ewe're shipping fast, will break less things now though I promise ;)\u003c/p\u003e\",\"date\":1781872240000,\"comments\":[],\"commentsCount\":0}],\"commentsCount\":0}],[\"$\",\"$Le\",\"48595649\",{\"id\":48595649,\"user\":\"SeriousM\",\"text\":\"That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.\",\"date\":1781852493000,\"comments\":[{\"id\":48596236,\"user\":\"seandotexe\",\"text\":\"Thank you!! Lots more to come\u003cp\u003eHonestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.\u003c/p\u003e\",\"date\":1781857725000,\"comments\":[],\"commentsCount\":0}],\"commentsCount\":0}],[\"$\",\"$Le\",\"48597363\",{\"id\":48597363,\"user\":\"davekilleen\",\"text\":\"Nice\",\"date\":1781868325000,\"comments\":[{\"id\":48597828,\"user\":\"seandotexe\",\"text\":\"Appreciate it Dave! Excited for you to try it out\",\"date\":1781872269000,\"comments\":[],\"commentsCount\":0}],\"commentsCount\":0}]]}]\n")ss="_toggle_18fc9_14">[-]
edit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie
we're shipping fast, will break less things now though I promise ;)
Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.