Hacker News Reader

chris_fon Show HN: PyTorch search engine

Any specific sites? Happy to spin one of these up for you focused on Web3. These work the best when the search engine creator has domain expertise to showcase the best sources.

I could try to find some sources, but my guess at the best Web3 sites would probably miss the mark.

chris_fon Show HN: PyTorch search engine

That's great! And I think the results even improve a little more if you just search 'distributed model parallel' without 'pytorch' [0]

So still some work to do, but I've personally found this type of search engine really valuable for some of my interests where I am able to curate the sites that might not normally rank, but I know are higher quality.

[0] https://you.com/niche/pytorch?q=distributed+model+parallel

chris_fon Show HN: PyTorch search engine

Yeah, that's a good point. As new ones get built, we will need a way to make them discoverable.

Also, just as a heads up, there is a link at the bottom of the search page [0] if anyone would like to build one of these search pages on any topic that might be interesting. It's just a form now bc we are working through the process.

[0] https://form.asana.com/?k=13NZtQkfNVw3CTE1jxngvg&d=119356944...

chris_fon Show HN: PyTorch search engine

Good stuff! Github is one of the sources, but not specific repos. I actually think we can break out Github into individual repo sources pretty easily.

chris_fon Show HN: PyTorch search engine

In the broadest sense, a highly targeted search engine (like this) can provide better results because Google has to determine user search intent AND return the right results from trillions of webpages. The advantage of this search engine is that all of the users are looking for the same type of information, and the result sources can be curated to ensure high quality and relevant results.

The more targeted the topic, the harder the time Google has to provide quality signal through the noise of SEO and sheer volume of content on the web.

In addition to the above, the UI provides some cool features like allowing horizontal scrolling of sources to provider higher information density (important for discovery), and some source content can be viewed in the side pane without leaving the page.

But ultimately it would be good to hear if this approach does make it easier to find relevant and higher quality Pytorch info.

chris_fon Show HN: PyTorch search engine

Appreciate the feedback, it is helpful! The relevance tuning is a continuous work in progress.

chris_fon Show HN: PyTorch search engine

Here are some more example queries:

https://you.com/niche/pytorch?q=install+osx&fromSearchBar=tr...

https://you.com/niche/pytorch?q=save+trained+model

https://you.com/niche/pytorch?q=check+if+pytorch+is+using+GP...

chris_fon The world needs a non-profit search engine

Worth mentioning is the Alexandria.org project [0]. It is a non-profit search engine built on data from Common Crawl. The coverage is limited because of Common Crawl, but the relevance is decent. They also provide an API.

I believe one of the biggest impacts toward breaking up Google's monopoly on search is making them open up access to their index, even requiring Google to provide direct API search access for others to build alternative search products. They have a search API today, but it is prohibitively expensive to build on ($5/1000 calls).

I built a fairly popular search engine a couple years back, but the cost of Google's search API and increasing number of bot attacks make it difficult to reason keeping it online.

[0] https://www.alexandria.org/

chris_fon A gallon equals how many pints?

I just finished reading the PaLM [0] blog post and being genuinely impressed with all the NLP advancements. This search result was a fun juxtaposition.

SERP: https://imgur.com/a/YbEtrLZ

Note: The answer 9.6076 is not wrong. It's for an imperial gallon, but it is an odd results being in the US.

[0] https://ai.googleblog.com/2022/04/pathways-language-model-pa...

chris_fon Teclis – Non-commercial web search

Mojeek is excellent, and because they use 100% their own index they have a much higher hill to climb.

When I say "Best"for a general search engine, my definition is that it would fulfill the needs of myself and my non-technical family members. Kagi and Brave Search both do that while being different enough to not be just another Bing clone. I use Mojeek often, think it is great, and having their own index is a tremendous asset, but it doesn't quite meet that full definition yet.

chris_fon Teclis – Non-commercial web search

Credit to them for trying some new things on the UI front, but it looks like the organic results are from Bing (like most other alt/privacy search engines). It would be interesting to learn more about how/if they plan to build their own index, or set themselves apart.

IMO, Kagi and Brave search are the two best alternative general search engines right now.

Runnaroo was pretty good as well ;-)

chris_fon Coalition of US crypto firms unveils travel rule compliance platform, TRUST

Thought that it was interesting that this is a centralized platform, especially considering the coalition of companies. This type of use case has been a typical example of something that a blockchain based solution could be applicable.

chris_fon Machine-Learning media bias

This is really an analysis of the use of biased language in news articles, which is interesting but only one dimension of potential bias.

It is very possible to use non "charged" language, but still report a topic with a strong bias. For example, Slate is left leaning by most measures, but the below landscape chart from the study has them dead center. Maybe they are better at using neutral terms?

https://space.mit.edu/home/tegmark/phrasebias.jpg

chris_fon The data brokers quietly buying and selling your personal information

They key is to only submit information that they already have, not anything new. For documents that need to be uploaded in some cases, the options are either to use a heavily redacted real document with everything blacked out except for the essential info, or just upload a random file because most of the time no one checks and it is just a required field to submit a form.

You are correct it is not actually "deleted", but it will stop your information from showing up on the website.

IMO, the "best" free people search is https://www.truepeoplesearch.com/. Their opt-out process is also pretty easy.

chris_fon The data brokers quietly buying and selling your personal information

As an exercise I once went through the process of manually requesting my information removed from most of the top brokers.

It would be difficult to automate because the opt-out processes usually aren't straightforward like unsubscribing from an email list. Many sites make it purposely difficult and involve going through multiple steps, providing verification like a drivers license, and email confirmations.

Here is a really good check list of different brokers: https://inteltechniques.com/data/workbook.pdf

chris_fon Searching the web for under $1000/month

Nice! Maybe at one point you can release a general web search engine for the Common Crawl corpus? It seems even simpler than this proof of concept, but potentially more useful for people looking for a true full text web search.

There isn't an easy way today to explore or search what is contained in the Common Crawl index.

chris_fon Runnaroo search engine has been taken down indefinitely

Thank you for all the kind words! I'm the creator of Runnaroo.

Runnaroo started as just a fun experiment, but it quickly became apparent that you could launch a meta-search engine better than just about everything out there (including DDG [0]), and I was frankly surprised how quickly it was embraced by such a large number of people (it's Show:HN reached the #2 spot [1]).

The challenge then became how to fund the cost of the site in an ethical way in line with the site's core principles. I started looking at different solutions [2], including becoming the first search engine to implement Web Monetization, but I never really even came close.

I believe Runnaroo will live on in some iteration, I just have to figure out what that would be.

Also, if you used Runnaroo and liked it, please don't hesitate to reach out (anything AT runnaroo.com). It has been a solo project, but I'm sure the future will involve more collaboration.

I would also be interested in sharing the story of how Runnaroo evolved over the last year, and the different experiences of launching a search engine if anyone is interested or has a platform for those conversations.

------

[0] Don't take my word for it - https://news.ycombinator.com/item?id=24248666

[1] https://news.ycombinator.com/item?id=23771131

[2] https://coil.com/p/runnaroo/Privacy-and-Search-Engine-Moneti...

chris_fon Runnaroo search engine has been taken down indefinitely

Please ping me at contact at runnaroo.com if you don't mind.

chris_fon Runnaroo search engine has been taken down indefinitely

Thank you so much for the kind words! It was very much a labor of love as there was no tracking, ads, or really any significant attempt at monetization.

I was actually happy keeping it up for all of the users such as yourself, but it started to become not worth the effort as it grew and more and more people would abuse the service.

Runnaroo is a one-man side project operation, and I hope it has shown what is possible in the search engine space with minimal resources.

chris_fon I tracked down my impostor

This is an interesting talk by Frank Abagnale (the real life person the story was based on) at Google.

https://www.youtube.com/watch?v=vsMydMDi3rI

chris_fon My 15 Years Striving for Search Engine Independence. AMA

Quite impressive. There are now companies coming out with the option of being paid search engines, most recently Neeva. What's your opinion on this approach?

chris_fon A look at search engines with their own indexes

Good article. Petal search and Gowiki were completely new to me and I pay pretty close attention to other search engines (I created Runnaroo).

Another area to focus on when reviewing search engines are the enriched results (i.e. "Instant Answers", "Deep Searches", etc.).

These types of results have become almost an expectation for average search user almost as much as the organic results.

chris_fon Brave is launching its own search engine with the help of ex-Cliqz devs and tech

Very cool Matt!

My only feedback is that it would be good if the source of the instant answer was displayed and linked to so that I could go to the underlying webpage source directly.

chris_fon Brave is launching its own search engine with the help of ex-Cliqz devs and tech

https://www.runnaroo.com/blog/the-search-engine-hacker-news-...

Uses Google index for organic search, but respects quotes unlike Google, Bing, or DDG. I'm the creator.

Gigablast also mentioned here is very cool as well.

chris_fon The Process Is Not the Product. The New Agile Anti-Manifesto

A lot of other professions build complex things, even sometimes involving large teams across different departments. Do they all have their different industry frameworks/methodologies (like Agile), or is that unique to software?

chris_fon Promoted Add-ons Pilot Wrap-up

I was part of the pilot [0], and enjoyed the process. It didn't cost anything, and they only requested random surveys on the service.

My extension just sets the default search engine to Runnaroo, and I don't promote it much because people can just do that through the browser, but it was nice to get some increased exposure and I did notice an uptick in downloads, especially initially.

In general, I'm all for Mozilla testing different monetization strategies to offset some of their reliance on Google.

[0] https://addons.mozilla.org/en-US/firefox/addon/runnaroo/

chris_fon Request for Startups

> "To me it seems the public can't be persuaded that paying for something is better than getting it "for free" (with ads and tracking)"

This is even more true when the paid option is often a worse version of the "free" offering.

chris_fon How Vivaldi browser is different from Google Chrome

Agree. I went and looked how they monetize after reading the article [0] . Revenue comes from the below:

1. Search engine partners

2. Affiliate links on 'Start Page'

[0] https://vivaldi.com/blog/vivaldi-business-model/

chris_fon Startpage.com: Privacy-oriented search engine

> "There's also things like https://coil.com/ who seem like they help support online content creators. I wonder if there's a way to treat search results like "content".

It is possible. I built the search engine [0] that was the first to integrate Coil as a monetization source. It is pretty small, but Coil payments do cover about 2% of the monthly cost to run the service.

Infinity Search also uses Coil. [1]

Here is an article with some thoughts around monetizing a privacy based search engine [2].

---------

[0] https://www.runnaroo.com/

[1] https://webmonetization.org/

[2] https://coil.com/p/runnaroo/Privacy-and-Search-Engine-Moneti...

chris_fon Ecosia – A search engine that plants trees

>"...it doesn't proxy at all, you are literally redirected to Google and it doesn't add anything. "

If you are looking for proxied Google results, your main options are Runnaroo [0] and Startpage [1].

I'm the creator of Runnaroo, and I prefer it to Startpage (and also DDG, but that is another thread).

[0] https://www.runnaroo.com/

[1] https://www.startpage.com/