HNHacker News
TopNewBestAskShowJobs

gbrits

134 karma · joined July 18, 2013

gbrits-at-gmail.com
submissionscomments
gbrits··on Wrecking sandwich traders for fun and profit
The deception works because the sandwich-traders are generalizing their code to 'work' for all kinds of contracts. This with the intent to just about frontrun anything that matches their pretty broad criteria. Since there's likely multiple predators operating, only the fastest one wins. This doesn't leave time to test individual contracts out locally. Or so the rationale most likely goes
gbrits··on Introducing dbt + Materialize
Exciting! Does this already have the concept of backfilling as mentioned by GP. Interested to know as well
gbrits··on Apache Arrow 3.0
As I understand, arrow is particularly interesting since it’s wire format can be immediately queried/operated on without deserialization. Would saving an Arrow-structure as parquet not defeat that purpose, since your would need the costly deserialization step again on read? Honest question
gbrits··on 14,000x Speedup (2015)
A Geohash (https://en.wikipedia.org/wiki/Geohash), a (decoding of a) recursive spacing-filling curve, would be much faster still: you literally slash a couple of characters of the tail of the hash to end up with your bigger cell, etc. It does mandate the way in which the grid/globe is subdivided though, which may not be suitable for the stated case.
gbrits··on SeaweedFS – A simple and highly scalable distributed file system with S3 API
Currently using Minio which is a relative success. However as part of quality checks we're using a lot 'listObjectsV2' S3-calls to check for gaps in our data, which is pretty slow. When using SeadweedFS plus, say, a Filer meta-data store based on Redis, this would presumably be faster?
gbrits··on Building Domain Driven Microservices
Comment as bookmark
gbrits··on My dad got scammed for $3k worth of gift cards
It's the discount. E.g.: $10 buys you a $12 gift card .. buys you a $14.4 gift card... ad infinitum
gbrits··on God be with you till we meet again (1918)
Facinating. There's a lot of Dutch people here. Some might want to translate
gbrits··on Dow Falls 2997 points worst drop since 1987 crash
“and that IRR includes crashes like these.”

No it doesn’t.

gbrits··on MessagePack: like JSON, but fast and small
Agreed. It really blows generic compression algos out of the water. Didn't know about Zstandard dictionary encoding. This might just be what I'm after. Thanks
gbrits··on MessagePack: like JSON, but fast and small
Slightly related: recently wrote a binary encoder/decoder that used bitpacking, delta-encoding, and other well-known 'tricks' to efficiently pack batches of 10k-100k events of the same uniform type (essentially encoding column by column and using similarities to my advantage). Nothing too fancy, but it was A) a huge success in terms of compresison-ratio and B) a hassle to write. Do any, more or less, turn-key solutions exist for this? Specifically targeting Node but a commandline util might work as well.
gbrits··on Tailwind UI
How so? Haven't tried tailwind, but wanted to try it on a pretty decent-sized Vue-project
gbrits··on Materialize: A Streaming Data Warehouse
Looks promising! Can materialized views be backfilled?
gbrits··on Materialize: A Streaming Data Warehouse
Is this similar to TimescaleDB's Continuous Aggregates? Interested in knowing the overlap / differences.
gbrits··on Amazon SageMaker Autopilot
Do any of these autoML offerings have a way to use the generated model in JavaScript/nodejs? I know of [sklearn-porter](https://github.com/nok/sklearn-porter) which transpiles scikit-learn models to JavaScript among other targets, but not sure if this nicely connects with any of the solutions discussed.
gbrits··on Effects of short-term fasting on cancer treatment
I follow everything else but what's the health benefit of avoiding meat?
gbrits··on Show HN: Stock Trading with Insomnia REST Client and Alpaca API
So the market maker who pays for order flow data takes the spread. But how are they able to trade with the buyer at $100.01 when there are limit asks on the book already at that price? Seems they need to cut the line?
gbrits··on Serverless Best Practices
To solve connect to a connection pool service instead of a RDBMS directly. E.g. Pgbouncer for Postgres
gbrits··on Amazon Sumerian: A way to create VR, AR, and 3D experiences
A bit at a tangent, but I was recently looking for software (open source or commercial) that could help me develop a 'interior design / planning' editor. I.e.: given a specific area (outside dimensions), allow to drag walls, doors, etc to create a floorplan, and given that, allow more detailed planning like kitchen, bathroom appliances, etc. Ideally, this would result in a 3d-model which could be imported in a tool like Amazon Sumerian to do a 3d-walkthrough. Any advice on where to look?
gbrits··on Huge Commercial Cave in the Ozarks for Sale
emphasis on should
gbrits··on Show HN: Link.fish – API to extract data from websites as JSON
So where's the point & click GUI to select items from a page? Signed up, but can't seem to find it on first glance
gbrits··on Show HN: Ready-to-use API to convert any web page to PDF using headless Chrome
Assuming you want this done automatically, what's the advantage of 'printing' multiple tabs to PDF in a headless browser, over just sequentially loading and printing the pages you want done?
gbrits··on Introducing Object Storage
Using managed queues (SQS) from AWS. The rest is on Vultr. That mix-and-match works perfectly for my use-case. In other words, no need to be able to run everything on a single platform to get cost gains.
gbrits··on Stripe Sigma
Agreed, although Mapbox comes close imho.
gbrits··on Faiss: A library for efficient similarity search
Could this be used for record deduplication? Say you have products from various data sources. A product has various features/facts that almost always don't line up 100%. Could this library be used to match over such records? One of the more specific constraints is that no 2 records from dataset A can match on 1 record from dataset B and viceversa
gbrits··on Solving State Explosion with Petri-Nets and Vector Clocks
This is solid: http://www.informatik.uni-hamburg.de/TGI/PetriNets/
gbrits··on Web Scraping: Bypassing “403 Forbidden,” captchas, and more
Interested to know where to get 100k proxies for $100/mo. Can you give some options?
gbrits··on Static Site Post Scheduler: Using AWS Lambda and Serverless to Schedule Blog Posts
How about using the new AWS Step Functions instead? This would allow a full push model while still keeping a nice and tight workflow:

1. fire off AWS Step function on new post to S3 bucket

2. read delay / schedule time in metadata from (assumable) markdown post

3. trigger AWS Step Function using the Wait State defined based on read value from 2.

4. As part of Step Function: After Wait State -> Execute Lambda to publish post.

Note: 3) requires setting variable time in Wait State based on environment. Haven't read up so don't know if that's possible, but guess it should be.

gbrits··on Build a crawler to crawl million pages with only one machine in just 2 hours
Network latency would be a valid concern for avg. time/req. not for throughput (necessarily)
gbrits··on Is PostgreSQL good enough?
Thanks. Reading the 'problems' section: a simple solution for "Resilience against crashing or hanging workers" would be having a TTL on the lock. If only...
← PreviousPage 2 of 4Next →