HNHacker News
TopNewBestAskShowJobs

hyperknot

1,249 karma · joined August 14, 2015

founder of MapHub: https://maphub.net/

personal website: https://hyperknot.com/

email: zsolt@maphub.net

submissionscomments
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
PMTiles could come up with a version in the future where instead of one 90 GB file, they have 9 thousand 10 MB files. That would work well I believe.
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Do you think it'd be more clear to only accept donations on GitHub Sponsors and only offer actual support plans on the website? I mean actual email support, helping companies migrate their existing map stack to OpenFreeMap.
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
I definitely not want to charge for requests, that's the founding principle of this project.

And the risk of this project is largely mitigated by offering the full repo as open-source, so you can always self host this if needed.

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Thanks a lot for the offer, I'll definitely reach out!
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
So a full planet OSM extract is about 300 million binary files, in total about 90 GB. The most popular ways to store it:

- MBTiles - an SQLite file, each file is a row in a table, you need a server to serve it.

- PMTiles - a single file, optimised for serverless usage.

- Extract them into a directory, which in practice should be on a partition image. This is the approach I choose.

I tested ext4 and Btrfs and I choose Btrfs. The reason is how ext4 and Btrfs handles inodes. Btrfs handles inodes so much better compared to ext4, it doesn't allocate them at start and also allows putting tiny files right with the metadata.

Because here the average tile size is only 405 bytes, most of the tiles can actually stored with the Btrfs metadata block. From the latest run:

Btrfs data is 51.57GiB

Btrfs metadata is 84.37GiB

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
I explained a bit about PMTiles in this comment: https://news.ycombinator.com/item?id=41636376

In summary, on a cold start (so now when it's on HN it might be totally meaningless), the following page loads in like 8-10 sec for me: https://pmtiles.io/?url=https%3A%2F%2Fdata.source.coop%2Fpro...

Technically why it's slow is entirely on CloudFlare, so I can only guess. But probably they are not mirroring files of this size across their datacenters / servers. I don't know how their public buckets hosting is done, but it's definitely very slow.

OpenFreeMap on the other hand seems almost instant for me.

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Thanks! I don't know where you'd be able to get property boundaries, I guess it's usually not open-source / public data? Probably depends on the country / city.
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Round Robin DNS. The browser selects the best server, based on ping or some other internal metric.

Also thanks for the donation!

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Bunny is also $10-$60/TB/month.

I believe Hetzner should not have any problem with using 100 mbps out of the 1 Gbps on their servers. That's 30 TB/month for free, per server. It'd be $300-$1800 per month on Bunny.

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
I'll write a detailed blog post for that, definitely.

Basically Protomaps / PMTiles allows you to do this serverless, but it has it's downsides.

There are two ways to use PMTiles with Cloudflare:

- Putting the file in a public bucket and use HTTP range requests.

- Deploy a worker to access it.

For the range request version, you can test PMTiles here: https://pmtiles.io/?url=https%3A%2F%2Fdata.source.coop%2Fpro....

It loads in 8-10 sec for me on a cold start. Of course it gets faster if many of us try to request it at the same time, but if you check it once per day for example, it'll be really slow, up to 10 sec.

Compare that with OpenFreeMap here: https://openfreemap.org/quick_start

It's near instant for me. (I know it's not full screen but you can make the app and then see how it's in full screen).

For the Cloudflare Workers version, I didn't find any publicly available full planet test, so I don't know the performance, but Workers are not free. It might not matter for a small project, but the $0.30/million requests per month can easily add up if your project gets popular.

In terms of OpenFreeMap, hosting it on a Cloudflare Worker would be prohibitively expensive.

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Satellite images are definitely expensive, they are by far the biggest cost for MapHub. I spend more on satellite images per month than on servers. I couldn't find a high quality satellite images from free sources.
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
At Hetzner, the bandwidth is unlimited in theory. In practice, there are stories of terminating accounts of those who used too much.

I don't think this project will ever make $2k per month. TBH, I'd be happy it it ever reaches $200 per month. I have to be very careful about what hosting providers to use and CDNs are out of the question.

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Thanks a lot for your words! I'm also curious whether the donations will be able to cover the bandwidth costs. Currently I'm paying for 3 dedicated servers at Hetzner and getting a total of $11 per month from donations.
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
Currently I'm paying for 3 dedicated servers at Hetzner and getting total donations of $11 USD per month.

Making this automatic might not be easy, but I might do it one day, it might help with the donations.

hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
CloudFlare buckets don't support indexing / directory listing, so you need to get the exact URL. To help with this, here is a file listing the content of the bucket: https://btrfs.openfreemap.com/files.txt
hyperknot··on Show HN: OpenFreeMap – Open-Source Map Hosting
As far as I know, there are no "Free Map Tiling provider"-s. This project aims to be exactly one. You can use it with Leaflet using the https://github.com/maplibre/maplibre-gl-leaflet plugin.
hyperknot··on Infineon's CO2 Sensor Monitors Indoor Air Quality
I think he meant How?, meaning normally a calibration is placing indoor monitors outdoors for 20 mins.
hyperknot··on Show HN: OpenFreeMap – Free OpenStreetMap Vector Tile Hosting
If you have any questions feel free to ask.
hyperknot··on My Room in 3D
Does anyone know what is the GUI library on the right hand side? I've seen it on multiple websites but the classnames doesn't reveal anything.
hyperknot··on Ask HN: What are you working on?
The community has started a mapbox-gl-js 1.x fork called maplibre-gl-js, I'll be migrating to it in the future: https://github.com/maplibre/maplibre-gl-js
hyperknot··on Ask HN: What are you working on?
I'm working on my side project, a Google My Maps alternative using OpenStreetMap data: https://maphub.net/

Just today I did my biggest feature launch so far, adding real-time collaboration, which might even be a first for map platforms: [1]

Originally I launched MapHub here in 2016 as a Show HN. Ever since I've been running it without any kind of monetization. I'm planning to launch it out-of-beta next month and add freemium packages. Feedback welcome!

[1] https://maphub.medium.com/real-time-collaborative-maps-on-ma...

hyperknot··on We got banned from PayPal after 12 years of business
Local bank transfer to Transferwise Borderless Accounts.
hyperknot··on How does the Hololens 2 matter?
Check out 360 degree Panorama formats, especially "Cubic" [1]. A similar approach was used back in 1992, in CAVE [2], using 6 virtual cameras.

[1] https://wiki.panotools.org/Panorama_formats#Cubic [2] https://en.wikipedia.org/wiki/Cave_automatic_virtual_environ...

hyperknot··on Sequel Pro – Open source macOS native MySQL GUI client
You are right, I thought you were talking about using private keys.
hyperknot··on Sequel Pro – Open source macOS native MySQL GUI client
TablePlus definitely can connect using SSH certificate. I'm using it like that right now.
hyperknot··on Show HN: Hacker News job trends
It's actually 1/e ~ 36.7%, the solution to the mathematical problem of how can you find the best sample in a sequence, if you cannot go "back" and pick one of the previous ones. As long as you can ask people to "wait a bit" this is not the best solution.
hyperknot··on ​Pipenv: One Year Later and a Call for Help
One thing in particular Pipenv/pipfile needs to address is a standardised calculation of the hashed virtualenv paths.

I tried creating a PR for SublimeText's Anaconda plugin, and realised that right now it requires 4(!) separate subprocess calls, each of which starts a Python process to simply get the path of the current project's virtualenv. Until there is a very simple way (a max. 10-20 line function) to calculate this path, including a reference implementation in Python and JS, there is no way widespread editor support can happen.

https://github.com/pypa/pipfile/issues/88 https://github.com/pypa/pipenv/issues/985 https://github.com/DamnWidget/anaconda/issues/717 https://github.com/DamnWidget/anaconda/pull/720

hyperknot··on Apple’s new APFS file system
Isn't it possible that Apple developed this filesystem primarily to be used with their SSD based devices which are using their custom controllers, which simply takes care of this low level protection? SSD controllers are said to be very complicated piece of proprietary technologies, and I believe they are using sophisticated algorithms for integrity protection.
hyperknot··on Ask HN: What do you want to see in Ubuntu 17.10?
The default Python on any system is the only one which is really well tested and works with all the not-trivial-to-compile packages. Making py3 the default is exactly for deprecating py2 support, thus an apt-get install python27 would never have the wide range of apt installed packages, like it does now.
hyperknot··on Ask HN: What do you want to see in Ubuntu 17.10?
Opposing view: This would make me stay on 16.04 LTS for a long long time.
← PreviousPage 4 of 7Next →