It feels like we've hit a point where search engines can become what "todo list apps" were for devs 10 years ago.
What a homebrewed solution lacks in coverage it excels in indexing and serving a small slice of the internet really really well.
It feels like we've hit a point where search engines can become what "todo list apps" were for devs 10 years ago.
What a homebrewed solution lacks in coverage it excels in indexing and serving a small slice of the internet really really well.
To be fair they are a supremely interesting problem to hack away at, and one that will meet you where you are.
Almost anyone can put together a basic search engine in a few thousand lines of code, it's just not very hard to make a program that will index a few million documents better than Confluence.
Then, between that first ansatz and a working scalable internet search engine, you have a pile of interesting problems touching every aspect of computer science and computer hardware and networking, enough so that hundreds of people will have gotten PhDs in narrow sub-problems of those problems you'll be facing.
It's great because you can just tackle the stuff you feel comfortable approaching and leave the rest for later.