Search Engine Update 2

Search Engine Project Update

I’m sorry for the lack of project updates 🙇 I have been working on a lot of OSS work so this has taken a back seat. However, I have added a lot to the project since my last update . It’s nearing completion.

I have added all necessary components for a v1:

• I added a searcher and cartographer (which has implemented primitive PageRank) as outlined in the original plan
• Added inter-service communication
• I have worked to standardise all the services with a common bootstrap so metrics and health checks are exposed
• I also added a caching layer for robots.txt as well as CSRF protection
• I have also worked to build a Kubernetes cluster for all the services. However, I am running into issues, mostly around scale—this service will likely need a multi-node cluster due to computational cost. In order to reduce costs, I plan to self-host Kubernetes

Introducing: Michichusa (道草)

Additionally, I have a name and an overall goal for the system. The goal is twofold: the first is to provide a place to find cool and niche websites in the so-called small web. The second is to allow users to select a language and reading level and have it show interesting articles. The name for this is Michichusa (道草), a Japanese word for the grass that grows by the side of the road, meaning to pause and get lost in side thoughts.