HNHacker News
TopNewBestAskShowJobs

potatosareok

198 karma · joined May 19, 2014

submissionscomments
potatosareok··on The State of LTE in September 2015
I don't see how them having controlling stake in TMobile helps them on that goal. I don't see either how wireless carriers have a real way to limit Googls mobile ad. I think Android alone accomplishes that goal, and until and unless phone carriers role out their own os alternatives that people don't hate, they'll be forced to offer Android.

Their involvement with spectrum bidding got them open access rights for only a few million.

Maybe I'm missing something obvious here though..

potatosareok··on Building Analytics at 500px
Makes sense I'm used to physical servers with tons of ram at work. If you don't mind, and I assume you're on Amazon entirely then, what size instances/how many are you using for the ETL(luigi) nodes? And do is there any infrastructure besides s3 (mysql dump, logs) => amazon instances (luigi) => redshift being involved?
potatosareok··on The State of LTE in September 2015
I don't understand why they would want to. Cell phone carriers aren't high profit business and has a ton of employees. Verizon has 180k employees and has net income of I see around 5billion profit on around 100 billion in income last year. Verizon FiOS pretty much got last Verizon CEO fired.

Google margins are way higher and Verizon employees more call center reps then all of Google in total.

From my understanding Google fiber is basically cheap dark fiber they got with some great regulatory concessions.

My view of it is Google spends enough just to prompt others to take actions (see their involvement in specturm bidding). Though my post might come off as judgemental, I'm not judging Google - that's merely good business for them to do. Wireless companies themselves are hardly examples of efficiency.

potatosareok··on Building Analytics at 500px
Thanks a lot for a detailed post. 20gb of log to not seem like much though? Not really sure of 500px scale. Fully conceding that at my company probably are logging too much, I'm wondering what takes ETL pipeline 4hr to run over that. Is just no need to optimize it since there's no benefit to have these metrics real time? Or am I missing some really data heavy part. Again not trying to be negative just wondering.

Luigi seems cool, can anyone comment on it compared Airflow or Spring XD, or is are those just different products.

Periscope looks like Kibana for relational stores, also cool to see.

Thanks again for great post!

potatosareok··on Launching NginScript
tengine fork has application health checks, although I'd still probably recommend haproxy
potatosareok··on Better Java – Resources for Writing Modern Java
Looking at Spark framework I'm wondering about your thought of Spark vs Spring Boot. I've not used Spark but I find Spring Boot lets you get an app of the ground quickly, is part of massive Spring ecosystem which gives you a lot of other advantages (for example, Mongo template might be very useful for Hackathon project). Beyond that RestController automatic integration with Jackson can quickly let you bring up a JSON based webservice.

Also I'm not a fan of how in your example the entire app routing/logic is basically crammed into a single main method. I know it might be simple demo app that you're trying to show off Twilo but I don't think you're doing favor by structuring like that.

What do you feel are the benefits of Spark vs Spring Boot (or Dropwizard I guess). In my mind the only reason I wouldn't use Spring-Boot for a new project in Java is if I wanted to use something like Play! since supposedly using Play!/Scala and futures integrate very nicely into that.

potatosareok··on Better Java – Resources for Writing Modern Java
Have you seen Goldman Sachs collection library? I've been using it for my Java work for last year and found it to work well. Put's a lot of useful methods onto the Collection objects themselves.
potatosareok··on A Web Crawler with Asyncio Coroutines
One question I have about this - and I might have missed in article is - I'm all for using asyncio to make HTTP requests. But I see they apparently also use asyncio for "parse_links". Since parselinks should be CPU op, would it make sense to use fibers to download links and pass them into a thread pool to actually parse them//add to queue?

I'm messing around with some of the ParallelUniverse Java fiber implementation and what I do is spam fibers to download pages and send the String response over to another fiber over a channel that maintains a thread pool to parse response body as they come in//create new fibers to read these links.

I'm really just doing this to get more familiar with async programming and specifically the paralleluniverse Java libs but one thing I'm struggling a bit with is how to best make it well behaved (e.g right now there's no bound on number of outstanding HTPT requests).

potatosareok··on I'm Begging for Work
I am really bothered by your comment esp. since you call yourself "anonfounder", which I assume means you are also a startup founder.

I agree brokdev did many things wrong, namely not communicating concretely what he expected his salary to be. I've been in that position before where, because of in my case were insecurities, I did not communicate clearly what pay I was expecting. Secondly, I agree he should have looked for another job before things came to a head like that. Thirdly, he may have been lucky to get that job opportunity initially, although I'm not too familiar with tech hiring markets.

However, you clearly say "EVERYTHING", and I think that the company too did things wrong. Just as he did not communicate, the CEO did not communicate what he was projecting. The CEO should have, in my opinion, given a ballpark range at least. I think that it is reasonable otherwise for brokedev to have expected comparable salary to his coworkers, unless something is missing from this story.

Secondly, for the CEO, I am bothered that he did not buy the equipment for the guy. How much is 1.5k for company to spend, consider they spend it on every other employee really? That in my opinion is very disrespectful of them.

Thirdly, and again I'm giving brokdev the benefit of doubt in how he portrayed the story, the way the CEO handled the firing was in my opinion very unprofessional.

Just because a person is in a situation where maybe they do not have a lot of options, doesn't mean that you should take advantage of them. I think brokdev was taken advantage of. Maybe you think same which is why you make throwaway account for your post?

to brokdev, my 2 cents: - You should have communicated your salary requirements clearly, even though it might be scary to hear no. Better to get the no sooner rather than later. - Doesn't do much for you but good luck! I unfortunately don't know any positions atm.

potatosareok··on Node.js v4 Release Timeline
Am I doing something wrong? I find NPM very slow and buggy compared to maven which just works for me. It could be that I'm on Windows or just more familiar with Maven. Use an internal nexus for both proxying NPM and maven.
potatosareok··on I Can't Wait for NoSQL to Die (2010)
Even in places outside SV e.g. where I currently work, we're trying to move away from these solutions in some case. We have PB of data in DB2 and most core data goes through Oracle RAC along with SQL Server and Teradata.

But we still have use cases where we don't use these DB - partly for cost reasons and partly because we want different functionality. Berkeley DB ldap for accounts, ETL and analytics moving into Hadoop, some apps use Mongo and even other smaller apps use MySQL, and those are just the projects I know about from my view. We still pay for support contracts on all these projects but obviously costs are significantly lower.

Even in a company that doesn't mind paying large amounts for enterprise database, I don't think that that reaching for one of these major commerical DB is always the right solution. Not all projects need the support you're paying for from them, and beyond that for some useage patterns I don't think they're even the right solution to reach for, regardless the cost.

potatosareok··on Intermediate Python
Another useful brief overview - http://python.net/~goodger/projects/pycon/2007/idiomatic/han...
potatosareok··on Pyxley: Python Powered Dashboards
Except tons of Python code depends on C. This project depends on Pandas. Pandas has C dependency.

So to run this there's code that needs to be compiled anyway.

potatosareok··on Ask HN: Freelancers in the US: What do you do for health insurance?
$450 a deducted per paycheck. Paycheck every two weeks?
potatosareok··on Handling 1M Requests per Minute with Go
Heap sizes 32gb+ can't use compressed pointers so don't forget about that bit of overhead. 48gb is just in that annoying zone where you need to go above 48gb heap to get real benefits of 32gb+ effecive heap.

But I only maintain EE apps on at most 10gb heaps, so I'm not hugely experienced with tuning this. All I can recommend is heap size and CMS thresholds (no G1 exp) set so that at steady state you don't end up hitting full GCs.

potatosareok··on Boiling frog, or when did we lose it with /etc?
This seems like how I read some old unix guide on compiling software. I put it all in ~/local/$software/$version with $software/latest symlink. I really prefer it as I can wipe software just with removing the directory.

I hate software like MySQL though which seems to ignore me setting --prefix in configure and still insisting to be default look in random directories.

With software with a good makefile and pkgconfig file, I've not had major trouble compiling all the software I use from source.

potatosareok··on Java 8: Replace traditional for loops with IntStreams
Ya I thought it might mark it as dead but even if I append the result to something like a List and print the list at the end (so it can't just not run the code?), Stream wins. Anyway I'm off to work for today, maybe I'll post in evening.

edit: https://gist.github.com/anonymous/ed0d8f4a5c6553fe8435

Is there some way in this example it could not actually run the code here?

potatosareok··on Java 8: Replace traditional for loops with IntStreams
Echoing everyone else, Java microbenchmarking is annoying. You should proably use Caliper or whatever anyone else posts.

Of course since I've never used any of them, here's my terrible example with stream beating for loop.

https://gist.github.com/anonymous/2395fb0728e491bc54f5

Warmup Warming up done 9262288 # for loop 6156414 # stream Done

edit: tuning WARMUP_RUNS to something lower (like 500 vs 10k) and for loop wins consistently vs warmup runs at 10k.

If I put on -XX:+PrintCompilation I see some extra compilation output but I don't really understand the output. I assume some of this contributes but there's way more output then I expected tbh

     4929  263       3       java.lang.invoke.LambdaForm$DMH/1581781576::invokeStatic_L_L (14 bytes)   made not entrant
   4929  339       4         java.util.function.Predicate::isEqual (20 bytes)
potatosareok··on Ask HN: Wanted – a D3.js mentor
Hi Colin - I had to implement something with d3 force before that might be kind of similar. I hadn't used d3 before so my solution is pretty hacky.

- http://bl.ocks.org/mbostock/3750558 - for basis of pinning nodes.

- setting CSS marker-end attribute on the line to get arrow (based off this example but in the end I didn't need as fancy as them so I just set it on all .link instead of dynamically: http://bl.ocks.org/mbostock/1153292)

I basically throw my data into there and let force directed work it out. Then I manually pin any of the nodes I want and basically have a save functionality, so next time I load the graph, any pinned nodes are back in the same place. I'd share the code but it's work and besides which, it's pretty simple (each graph has an id, there's a db I have where I store (id) => text(string(graph => json))).

As for boxes of text it shoudn't be too different then with circles - I personally went with onHover using qTip.s for extra data (my node are either circle or some custom images, and they all have a text besides them that is server fqdn).

Not entirely sure where you want the buttons to be in this graph though.

potatosareok··on Ask HN: Who uses Oracle and why?
We have Oracle RAC clusters with GoldeGate for cross data center replication.

What's the alternative in the Postgres/MySQL world?

potatosareok··on Ask HN: How do you log application events?
Sorry if I'm misunderstanding yours or GPs point but I think GP was recommending storing app session in some 3rd party cache outside your app server tier, not having nothing stored in session at all.

But reconstructing session from cookie value would work just as well I suppose, at the tradeoff of having everything you want stored in cookie (vs storing just session ID in cookie and having that ID mapped to data in one of the aforementioned caches or other alternative)?

potatosareok··on Race conditions on Facebook, DigitalOcean and others (fixed)
I've always wondered, (but apparently not enough to figure it out by reading the Spanner whitepaper), but how do these systems typically handle it?

I guess if you were using an append only log that recorded the exact timestamp of the transcation, your datastore would eventually reconcile that for example promo code 1 was applied twice. But what do you do then? Rollback the 2nd application of promo code and deduct the credit from user account?

Where would the logic for that be programmed?

potatosareok··on Ask HN: How do you log application events?
Just wondering b/c where I work, sessions are persisted to a single host (there's load balancing but cookie based persistence through Citrix netscalars). Admittedly it's not great b/c if that host goes down, user session is lost, but it does simplify matter a bit.

Do you persist sessions in some global cache (We'd use Oracle coherence at my work, but I guess you could use redis/memcache/infinispan?). Side note...does anyone have experience with Infinispan?

potatosareok··on Point of Sale Register Outage at Starbucks Stores in U.S. and Canada
While I did learn something new from your comment, I can't imagine any enterprise shop that's not running Oracle DB or MSSQL. Maybe it's just the bias I have from my job history, but for standard enterprise shops and their OLTP data, is there any competitor to Oracle DB & MSSQL? I know that at my employer they use berekleydb/teradata/hadoop/mainframe systems for different workloads, but the bread and butter is Oracle RAC clusters.

Not saying that I think Oracle DB & MSSQL is unbeatable, I'm asking because I am trying to see what exists outside my little biased view.

potatosareok··on Inception: DMA Attack Against Linux, Windows, and Mac
You can disable paging if you really care about that but setting swapiness to 0.

Or use something like https://github.com/LucidWorks/mlockall-agent

potatosareok··on Foreign Linux: Run Linux binaries on Windows without drivers or modification
Do you know how to echo text in ASCII or UTF-8? > "text" or > echo "text" For me both come out with weird character encoding
potatosareok··on Ask HN: How do you manage your passwords?
I don't particularly favor putting all my passwords in an online password manager. So I have some JavaFX gui I made that encrypts a password file (passphrase => PKDF => AES). In total it's like 200 lines of code - GUI, storing pass, generating pass, and rotating master password. The encrypted file I keep synced in my cloud storage.

But in retrospect I don't know if this makes any real difference from something like keepass. My encrypted file is transferred over some secure socket, so an attacker can at least a copy of the encrypted file if they either hack the cloud storage provider or somehow hijack my connection.

It's not exactly super portable but for sites I care about, I wouldn't log onto them on untrusted computers anyway.

potatosareok··on SkyBlue – Small SASS framework
Always nice to have more basic tools out there, esp. simple ones you can customize, and it looks nice.

Thanks for putting it out there.

One issue I have with table is on hover, they get a bit janky (hovered row resizes entire table a bit). I think it's b/c you are removing cell border on hover so everything shifts a pixel or two (or however many column - 1).

Chrome on windows Version 41.0.2272.76 m.

http://imgur.com/7B99Zu2,K1HwU5f

potatosareok··on Pixie: A sweet Clojure-ish language
Upvoted you because I agree. JVM has many strong points but I don't think anyone is disputing that startup time is a weakness. I've used some java tools that you invoke from a command line and I'm always slightly annoyed by how slow they are.

As an aside - I was trying to reduce -Xmx to improve HelloWorld startup (lol idk...) and Xmx smaller then 1024k and it couldn't start up with less then 1024k so there's that.

On my windows computer (also I barely know what I'm doing so probably even timing it wrong).

  [Mon Mar 09 03:22:31 zebra@ZEBRA:~ ]
  $ time a.exe
  Hello, world
  real    0m0.098s
  user    0m0.015s
  sys     0m0.015s
  [Mon Mar 09 03:22:34 zebra@ZEBRA:~ ]
  $ time java Hello
  Hello, world!

  real    0m0.285s
  user    0m0.000s
  sys     0m0.031s
potatosareok··on Google Contributor
How do you think this encourages click bait "even more". How would you avoid click bait? Magazines that you deem "not click bait" get granted more money? Who decides what's in this worthy category?

Even before online advertising, it's not like tabaloid magazines didn't exist and make a lot of money.

If people spend their time on a website, why shouldn't that website be worthy of money.

If you went to a site and didn't like it - don't go back there again. Why is it fair for you to visit a site repeatedly and only give money when it publishes an article you like? It's not like you can sign up to the NYT and only pay for the articles you liked that month.

← PreviousPage 2 of 3Next →