HNHacker News
TopNewBestAskShowJobs

achillean

1,592 karma · joined December 3, 2009

I run a small search engine that finds the stuff that's not on Google.

Contact me at jmath (at) shodan (dot) io

submissionscomments
achillean··on Store SQLite in Cloudflare Durable Objects
We've been using it for https://internetdb.shodan.io and it's been doing a few thousand lookups/ second without problems.
achillean··on Do svidaniya, Igor, and thank you for Nginx
In January 2021, Nginx took over Apache as the #1 web server on the Internet that users can install:

https://i.imgur.com/pjU1G61.png

https://trends.shodan.io/search?query=http+port%3A443#facet/...

I'm a bit surprised it didn't happen earlier as it feels like it's been the dominant choice for tech people.

achillean··on Shodan 2000
"compromised" means that it looks like the service was taken over by somebody else. That can mean website defacement (ex. "Hacked by XXX"), database ransomware or any other way that a bad guy can compromise a service.
achillean··on Shodan 2000
Typically it means you've configured your firewall correctly. Shodan continuously crawls the Internet so it's not based on user requesting scans. The IPv4 space is fairly small so Shodan just checks every IP (3+ billion) to find the services that run on it. Your activity/ use of Shodan doesn't affect how Shodan crawls the Internet - unless you request a scan using the API/ CLI. For more information: https://help.shodan.io/the-basics/what-is-shodan
achillean··on Shodan 2000
No, it's not static. The information is pulled from a file that gets updated by a separate script.
achillean··on Give me /events, not webhooks
We provide both long-polling and webhooks but almost everybody chooses to use webhooks. From what I've seen, a reason is that a lot of other tools/ platforms that you want to integrate with don't support long-polling. They prefer to get notified when something happens instead of keeping a persistent connection.
achillean··on Show HN: Giving a 2D grid a 3D look – part 4
This looks amazing! Are you considering open-sourcing it? Would love to see how it fits as a background for https://2000.shodan.io

There are probably a lot of outrun-style websites/ projects that could use this.

achillean··on We analyzed 425k favicons
Nmap generated a similar version many years ago and it's still available at:

https://nmap.org/favicon/

We also did something looks at favicons by IP:

https://faviconmap.shodan.io/

achillean··on Shodan Search Engine: Search Engine for the Internet of Everything
Your account got banned due to scraping of the website.
achillean··on Shodan Search Engine: Search Engine for the Internet of Everything
We don't do bans like that so it sounds like there might have been a configuration/ network issue.
achillean··on HTTP Status 418 – I'm a teapot
There are a few thousand web servers that return this status code for their main page :) https://www.shodan.io/search/report?query=http.status%3A418&...
achillean··on Mēris botnet, climbing to the record
That's not what the article said though. They say that the compromised devices had these characteristics among others:

* Port 2000 open

* Port 5678 open

* SOCKS proxy on port 80 (maybe)

Most likely most of the visitors to your website won't have those ports open and exposed to the Internet. That is a really easy way to filter traffic based on the network fingerprint. Especially when you're under attack it's a great way to reduce a majority of the impact without requiring any AI/ ML - just filter traffic from IPs that have TCP port 5678 open. That same technique was also used to identify Mirai bots and it worked well.

achillean··on Mēris botnet, climbing to the record
In cases like this it's actually not that difficult as they're using devices that can be fingerprinted from the Internet. We at Shodan provide a local, embedded database (SQLite or RocksDB) so you can see which open ports connecting IPs have. If an IP is connecting from a device that's running weird ports, is compromised or has other unusual characteristics then you can either flag the connection as high risk or outright drop it if you're under attack. It's mostly used by banks etc. for fraud prevention but we have a few that use it for blocking traffic based on IP risk.
achillean··on US Cybercom says mass exploitation of Atlassian Confluence vulnerability ongoing
Yes, via the API. Btw all of our websites are entirely built on the same public Shodan API that everybody else has access to.
achillean··on US Cybercom says mass exploitation of Atlassian Confluence vulnerability ongoing
FYI: Shodan also does monthly hostname-based scans of the Internet where we set the "Host"/ SNI headers. We use our own DNS DB to grab a list of hostnames/ IPs to launch scans of:

https://www.shodan.io/domain/ycombinator.com

At the moment, I think we're checking around 600 million hostnames.

achillean··on Please log in with router's password
It doesn't matter. We check every IPv4 regardless. And for our regular crawling we don't ping before we try to connect as a lot of firewalls block ICMP.
achillean··on Please log in with router's password
That's not how it works. Shodan continuously checks all IPs on the Internet. When you visit the website you're checking for existing information in the database. Your use of the Shodan website/ API doesn't change how Shodan crawls the Internet.
achillean··on Please log in with router's password
Bingo. Many years ago I tried to fix it but it was quickly reverted. I understand their policy though and hopefully it will get fixed at some point.
achillean··on Please log in with router's password
Ah yeah, I didn't think you were :) It's just a common misconception so I wanted to let readers here know.
achillean··on Please log in with router's password
The Wikipedia article is unfortunately woefully out of date in describing what Shodan does. For example, Shodan collects data on thousands of ports:

https://www.shodan.io/search/facet?query=net%3A0%2F0&facet=p...

And we don't concentrate on a single type of device/ service (the article mentions SCADA). We identify everything from industrial control systems (1) to Minecraft servers (2). The news coverage makes it sound like we're skewed towards ICS, webcams or vulnerabilities but our focus is on providing a comprehensive view of what's connected to the Internet.

If you want to quickly check if your IP is exposing anything unexpected to the Internet simply visit:

https://me.shodan.io

If you see a 404 then nothing public was found. Note that this looks up information in the existing Shodan database - it doesn't launch a scan.

(1) Industrial control systems: https://www.shodan.io/search/report?query=tag%3Aics

(2) Minecraft servers: https://www.shodan.io/search?query=minecraft

achillean··on Please log in with router's password
Note that Shodan doesn't try to login using default credentials. If you see banners advertising their defaults it just means that the device is telling you what its defaults are - it doesn't mean that the device is still using them.

That being said, a ton of devices still use default credentials but we don't have any numbers on how many exactly.

achillean··on Ask HN: Failed project you spent 15 hours/week for 5 years on?
I worked nearly full-time for about 2 years using my personal savings on a project management software for labs ("Labengine"). The big hook was that it let you run common bioinformatics apps on your data and it would automatically convert the input file to the expected format (there were lots of competing bioinformatics file formats at the time). I had a few of my old professors use it and "love" it but nobody ended up paying. It was a good lesson for me to not work on a project in isolation too long; release early release often is the motto now.

Edit: I stopped working on it after it bombed horrifically but kept burning through my savings and after a few other ideas ended up with a successful company (Shodan). I still learned a lot from failing with Labengine but I don't think working on it another few years would've made it successful.

achillean··on Thousands of unauthenticated databases exposed on the internet – study
There definitely are instances of those databases on the west coast. For example: https://www.shodan.io/search?query=product%3Aelastic+state%3...
achillean··on Thousands of unauthenticated databases exposed on the internet – study
It was probably one of @Viss's talks. Here's one he did at DEFCON: https://www.youtube.com/watch?v=-T-3buBwMEQ
achillean··on Hacker deleted all of NewsBlur’s Mongo data and is now holding the data hostage
We also crawl IPv6 but it's a very different and more complicated algorithm. We would still end up crawling a sizable chunk but there are obviously unknowns in how biased our dataset would be (i.e. we might index mostly cloud servers and fewer residential devices).
achillean··on Hacker deleted all of NewsBlur’s Mongo data and is now holding the data hostage
Looks like this is an automated campaign:

https://www.shodan.io/search?query=READ__ME_TO_RECOVER_YOUR_...

achillean··on Hacker deleted all of NewsBlur’s Mongo data and is now holding the data hostage
Here is an overview of what Shodan is:

https://help.shodan.io/the-basics/what-is-shodan

The scanning algorithm is mostly just this:

1. Generate a random IPv4 address

2. Select a random port from a list of ~2k ports

3. Check the random IP on the random port

4. Store the result of the check

5. GOTO 1

The above loop runs endlessly and because IPv4 is fairly small it doesn't take long to check everything.

achillean··on Hacker deleted all of NewsBlur’s Mongo data and is now holding the data hostage
We have a service where we'll notify you if anything new gets exposed on one of your IPs:

https://monitor.shodan.io

If you have a membership (which is a one-time payment of $49 - no subscription necessary) then you can monitor up to 16 IPs. We have a lot of individuals that have configured monitoring for their home network just in case something accidentally gets exposed.

achillean··on Hacker deleted all of NewsBlur’s Mongo data and is now holding the data hostage
We actually scan on average once a week. I used that language to be ultra conservative but I'll need to change it. For the past 8+ years we've been doing weekly scans.
achillean··on Hacker deleted all of NewsBlur’s Mongo data and is now holding the data hostage
It's possible to check every IP on the Internet nowadays so you don't need to keep a list. You can just brute-force check every IPv4 address in less than an hour. I've written on the subject a few times:

https://blog.shodan.io/its-the-data-stupid/

← PreviousPage 3 of 10Next →