4,951 karma · joined March 8, 2019
But tl;dr many students have been accused of using AI by teachers who think that AI detection software works, when it really doesn't. So the goal of this site is to communicate to teachers that AI detection software isn't reliable.
I originally discovered this in a reddit comment which you can see here: https://www.reddit.com/r/ChatGPT/comments/13hi5y6/comment/jk...
I think releasing a purely AI version of this is not feasible at the moment, because of the obvious issue of hallucinations. It's not an educational product if it's giving people false information. In fact, it's actively harmful. And it's sad that people are trying to cash in on the AI hype without any regard for the accuracy of their content.
There is some typo tolerance, so it's hard to tell exactly what is matching on those pages.
I'm working on adding query operators so you can specify things like exact matching, and in general working on improving the results.
This type of feedback is very helpful, so thank you!
A lot of the online writing happening now is essays on some topic, or people trying to share notes on things they learn. And I think this type of writing is more conducive to a project like this.
Working on increasing it significantly, but will take some time. Try it again in a month and you may find it more useful. Right now it's mostly filled with tech, business, and politics.
I am working on increasing the amount of blogs significantly, but please bear with my modest index in the meantime.
I'd love to chat about this more, will send you an email.
> changing a search phrase or word and doing a new search, I notice the results do change, but there's no way to know if it really happened. Changing a Google search, the whole page flashes empty, that way I see/sense there's something new. In your case, a change is subtle, very subtle, too subtle. In one instance I had to look carefully to see the change in results.
That is a good point. I did try to remove any loading indicators because I thought it would be smoother, but maybe it's a bit too smooth for people to realize their search went through. Will think more on how to fix this.
I think most of us in this space are willing to collaborate so something interesting could happen.
Popularity is certainly a flawed measurement, but it's hard to come up with a scalable way to determine quality that isn't flawed in some way.
Instead of being flawed by encouraging people to get tons of backlinks, this is flawed by encouraging people to do stuff that gets lots of upvotes.
Very open to more ideas on how to measure quality.
However, if you want fresher content, you can use the date range selector and set it to "Past Week" for the best posts of the week.
If you're submitting a blog and we don't already have a tag that fits, you can add it to the "Notes" section.
That's interesting to hear, and fits well with the goals of the site. I want it to be more of a "discovery engine" than a "search engine". Search is one path to discovery, random posts are another, there are probably more.
One thing I'm thinking of adding is the ability to easily see the blog posts that any given post links to. If you see an interesting post, you could pull up everything that may be related.
> definitely going to keep checking back to pad my RSS feeds with interesting content.
Sadly not every blog has RSS, and many RSS feeds are incomplete. Another thing I would like to build is auto-generated RSS feeds for all blogs, which would also make it easy for people to programmatically parse any blog and do interesting things.
Technorati was one of the inspirations here so that's great to hear.
> Would love to hear details about how you created the database, the infrastructure, etc if it's not a trade secret. Kudos on the launch!
Sure, it's actually fairly simple! The search backend itself is running on Typesense [0], which was very quick and easy to setup.
Due to the way ranking is calculated, I can actually avoid doing any real web crawling (though, I may add that in soon to help increase the index size). Ranking is based on submission to online communities, so all I really need is those submissions.
Using the Reddit, HN and Twitter APIs, I search for any submissions related to any blogs in the database, then those submissions give me the post URLs.
Once I have the post URLs, I just need to request those specific URLs to get the post data.
Then there's scripts for things like content extraction, inflation calculation, currency conversion etc.
All of those scripts are in python.
The frontend is a simple React app built with Next. All pages are statically generated.
Let me know if there's any more questions!
I see the manual curation as more of a temporary measure in the beginning. There are various ways blog detection can be automated and scaled, but manual curation for now gives me a better understanding of the data, and ensures I don't run into random edge cases.
> Because after trying a few search "getting a job in vc", "best computer chair", "learning erlang" I'm not confident this answer better results than Google.
Right now it's more useful for very broad queries like "inflation" or "covid". The index is pretty small at the moment, but the more posts that get added to the index, the more specific queries we'll be able to find good results for.
> You've got a content size problem as you are manually curating, and this will lead to people not use your search as a default, and probably not use it as a search engine, but instead as a discovery system.
That's actually what I want! This is not a search engine to replace Google, it's a discovery tool for blog posts.
Thanks for all the feedback here, and will definitely check out the newsletter.
> Edit: hmmm... though looking further, maybe this goes against your MarketRank philosophy.
It doesn't at all, but curious as to why you'd think that. We're not talking about using backlinks to rank pages after all, just as a discovery tool, which I think is great.
Other ones worth checking out include:
- https://search.marginalia.nu/ (A non-commercial search engine)
- https://wiby.me/ (Tends to have those really weird and cool indie sites)
- https://searchmysite.net/ (An index of personal websites)
- https://indieweb-search.jamesg.blog/ (Search IndieWeb websites)
- https://millionshort.com/ (Ignore the first million results from Google)
Blog Books makes it easier to read more books by bringing the books directly to your inbox that you already check every day.
You choose how much you want to read (e.g. 500 words), and how often (e.g. weekly), and the book contents will be sent to your email inbox or RSS reader on that schedule.
It’s mostly limited to books in the public domain right now, though there are a few recent ones as well. Hoping to get a lot more books in this format in the future.
Check out listen notes [0] for some inspiration. It’s a podcast search engine that is profitable, and the founder has some good write ups on the blog.
There are 1000 feed reader apps that exist right now, some of which have the branding of "it's just like Google Reader", so what am I missing here?