So, in the era of increasingly good AI powered tools and general search engines full of SEO spam, last week I started creating something little old school and against the trends.

For now It’s a have-fun-and-find-out project that main aim is to provide good search results for general web development queries with a special focus on independent blog authors.

The thesis is that no SEO spam website is in the index, which will already filter out most annoying noise on Google/Bing.

Search results are grouped per type: docs, blogs and magazines (e.g. blog platforms or bigger websites).

For now it’s far from being done in terms of having a full index, but in most cases it already replaces my go-to search engine when I’m looking up some stuff during work.

I’m looking forward hearing out what y’all think and if you think it makes sense overall I can only encourage you to post some links to blogs or docs that are still missing in the index. I’m more than happy to add it to the crawler.

Responds like: “nei, total shit, who would need that” also accepted but constructive critique more appreciated ;)

EDIT: everyone many thanks for all your voices and comments. I’m super grateful for all of them and happy that we have such place like Lemmy!

  • sznowicki@lemmy.worldOP
    link
    fedilink
    arrow-up
    2
    ·
    1 year ago

    The crawler takes only the sources that are defined in the crawler repo (it’s open source, check the github org or kukei-spider).

    So in this way it’s “curated” in a sense that it would not add anything else to the index.