Kagi's mission is to humanize the web and this project is built to help surface recent (7 day old or newer) results from the small web - people and stories that typically zip by in legacy search engines. Read more about it in the announcement blog post.
Few things to note:
-
Kagi search engine now surfaces posts from the small web for relevant queries in its search results.
-
Try the Kagi Small Web website to read and appreciate the posts directly.
-
You can also use the RSS feed or access these results as a part of a broader Kagi News Enrichment API.
If the blog is included in small web feed list (which means it has content in English, it is informational/educational by nature and it is not trying to sell anything) we check for these two things to show it on the site:
- Blog has recent posts (<7 days old)
- The website can appear in an iframe
What is Small Web exactly? Recommend reading:
- https://neustadt.fr/essays/the-small-web/
- https://benhoyt.com/writings/the-small-web-is-beautiful/
- https://smallweb.page/why
- https://ar.al/2020/08/07/what-is-the-small-web/
- https://news.ycombinator.com/item?id=29768197
smallweb.txt - Contains the feeds of indexed blogs
smallyt.txt - Contains the feeds of indexed YouTube channels
yt_rejected.txt - Contains the list of YouTube channels that were reviewed (in an automated way) and rejected
app/ - App powering the Kagi Small Web website
Add a new personal blog RSS feed to the list. Rules:
- Do not submit your own website unless you submit 2 other sites that are not yours (and are not in list).
- Locate and submit the RSS feed of the website. Place in the file so that it remains sorted.
- Content must be in English (currently, other languages are not accepted).
- Only personal blogs may be submitted.
- The blog must have a recent post, no older than 6 months, to meet the recency criteria for inclusion.
- The site must not contain any forms of monetization, such as advertisements, newsletter signup popups, etc.
Add a new YouTube channel RSS feed to the list. Rules:
- Do not submit your own YouTube channel unless you submit 2 other channels that are not yours (and are not in list).
- Locate and submit the RSS feed of the YouTube channel. Place in the file so that it remains sorted.
- Content must be in English (currently, other languages are not accepted).
- Preference is given to channels focusing on hobbies or passions.
- The channel must not post more than twice a week.
- The channel must have fewer than 400,000 subscribers.
Hint: To extract the RSS link from a YouTube channel, you can use this tool.
Remove a website if :
- Content is not in English.
- Website has poor quality content.
- Website contains intrusive monetization such as ads or newsletter popups.
- Website purpose is monetization rather than education.
Clicking "Remove website" will edit small web list in new tab, where you can locate and remove the website feed in question. Make sure to add in comments the rason for removal.
Remove a YouTube channel if :
- Content is not in English.
- Channel has poor quality content.
- Channel's purpose is monetization rather than education.
Clicking "Remove" will edit small youtube list in new tab, where you can locate and remove the YouTube channel feed in question. Make sure to add in comments the reason for removal.
The original list of small web blogs has been assembled from various sources including:
- https://github.com/outcoldman/hackernews-personal-blogs
- https://news.ycombinator.com/item?id=22273224
- https://news.ycombinator.com/item?id=15154903
- https://news.ycombinator.com/item?id=30245247
- https://news.ycombinator.com/item?id=29758396
- https://news.ycombinator.com/item?id=27302195
- https://github.com/rushter/data-science-blogs
- https://github.com/kilimchoi/engineering-blogs#-individuals
- https://github.com/ysfelouardi/awesome-personal-blogs?search=1
- https://ooh.directory/blogs/personal/
- https://indieblog.page/all
- https://biglist.terraaeon.com
- https://tech-blogs.dev
- https://hn-blogs.kronis.dev/all-blogs.html
- https://dm.hn
The seed list for YouTube channels has been assembled from these HN discussions.
- https://news.ycombinator.com/item?id=32220192
- https://news.ycombinator.com/item?id=25647657
- https://news.ycombinator.com/item?id=32378309
- https://news.ycombinator.com/item?id=20385679
- https://news.ycombinator.com/item?id=24374979
- https://news.ycombinator.com/item?id=24589474
- https://news.ycombinator.com/item?id=24671019
- https://news.ycombinator.com/item?id=35120777
- https://news.ycombinator.com/item?id=12702651
- https://news.ycombinator.com/item?id=17202615
- https://news.ycombinator.com/item?id=29666539