HNHacker News
TopNewBestAskShowJobs

mydpy

325 karma · joined August 22, 2012

Researching applications of finance, mathematics and computer science and designing algorithms for financial software. Specialized in computational operations research, large scale data analytics that utilizes high performance computing techniques, and simulation.

Ex-NASA scientist. Triathlete. Gamer.

submissionscomments
mydpy··on Ask HN: Are you more likely to apply for a job that discloses salary upfront?
Traditional salary negotiation, which generally hurts the applicant, heavily favors a salary black-box. So, a job board like this would help people who are not interested in negotiating their salary but want to stay competitive.
mydpy··on How a Zara Coat Went from Design to Fifth Avenue in 25 Days
I posted mine because this didn't work (the first link directed back to WSJ). Also, your suggestion is missing the boom. That's no fun.
mydpy··on How a Zara Coat Went from Design to Fifth Avenue in 25 Days
In before 'wah wah paywall'. Here's how you bypass it:

1. Open a Google Chrome Incognito or Sarafi private browsing session

2. Paste the URL

3. #boom

mydpy··on Cassandra is not row level consistent
As others have noted, this blog uses an approach to data modeling that is considered an anti pattern for an AP data store like Cassandra.
mydpy··on Apache Spark: A Unified Engine for Big Data Processing
If you follow the Spark community closely, you won't find any new information here. However, as a software consultant, I find this to be a useful nontechnical overview to send to partners and clients.
mydpy··on Can We Put the 16GB “Pro” Myth to Rest?
My machines are currently 16GB each (I have two MBPs). I imagine increasing the amount of RAM I use in my next machine upgrade.

Anyone working on large scale data problems or doing advanced analytics (Spark, R, Python, etc.) would appreciate having more memory to allocate to their problems.

The analysis in this blog underestimates the complexity of various compute environments.

mydpy··on Begin LaTeX in minutes
LaTeX is much deeper than this "mastery" document conveys. Although, LaTeX is significantly easier to pick up if you learn to program first. I appreciate the author sharing this here though :)
mydpy··on Curl author asks Microsoft to remove 'curl' and 'wget' aliases from PowerShell
This is kinda awesome. This repo has been public for less than 24 hours and Daniel Stenberg (@bagder) already put in a PR to remove wget and curl? That's amazing. What a Swede.
mydpy··on We Should Not Accept Scientific Results That Have Not Been Repeated
I agree in principle. There are a few concerns:

1. How should we receive costly research that took special equipment and lots of time to develop and cultivate? I.e., CERN?

2. A lot of research is published, ignored, and then rediscovered. In this case, we may want to accept the research until it cannot be repeated (i.e., in another journal publication).

3. Reviewers of academic publications probably are not qualified or have the time to recreate all scientific research.

4. Isn't the academic system at its core kinda... broken?

mydpy··on Ask HN: Why don't companies hire programmers for fewer hours per day?
Exactly. This pains me all the time. I would love to take a 25% salary cut for a 25% reduction in working hours.
mydpy··on Why Online Voting Is a Danger to Democracy
In fact, online voting is such a dangerous idea that computer scientists and security experts are nearly unanimous in opposition to it.

I hate when articles make these ridiculous claims in order to inflate their credibility. Are there problems the security community needs to address before using technology to vote in a democracy? Yes. Is online voting a danger to democracy? No, but there are bigger problems that need to be solved before online voting should be implemented.

Point: I just tried to temporarily remove a freeze on my credit report after the Office of Personal Management (aka, the office for federal employees) lost all of my PII in a large-scale hack that occurred more than a year ago. For those of you interested, all of my credit is essentially frozen indefinitely as a result of this hack. Now, in order for me to validate my own identity, I had to reproduce (sometimes unsuccessfully) a series of data points that anyone with a hard copy of my credit report combined with my OPM breached data could reproduce. The real issue is the fallacy that a human being is uniquely identified by a set of data points (paper or otherwise). This is fundamentally the issue that must be overcome before we can breach issues like online voting reliably. We continue to create systems based on this fallacy of personal identification, and it is creating more problems than it is solving. Again, paper or otherwise.

mydpy··on Ask HN: How long did it take you to get your first dev job?
Post your resume for feedback. You need to "sell" yourself. It didn't take me long, but I applied to a lot of positions that I didn't really qualify for. And I got offers at places I didn't think I would qualify for, but I have some name recognition on my resume that helped.
mydpy··on Ask HN: Who is hiring? (May 2016)
Do you have a link for this one?
mydpy··on Apply HN: Bubblin Superbooks
Chrome/Mac OSX (latest)
mydpy··on Apply HN: Bubblin Superbooks
ARGGHHHHH! Poor zrebak!

http://imgur.com/dc4Ek81

mydpy··on Apply HN: Bubblin Superbooks
My concern is that the relationship between time to create content and financial reward will dissuade people from adopting your platform.
mydpy··on Ask HN: First time giving a speech at a conference. How do I prepare best?
Prepare early. Present often to someone else and get feedback. Be honest about what you know and what you don't. Know your audience and engage with them. Make your slides and code available online and tell people that so they pay attention.

Good luck!

mydpy··on Pokemon Direct: Sun and Moon Announced to Celebrate 20th Anniversary
I know this isn't exactly relevant - but - for me and probably many others, games like Pokemon, and software like Gameshark/Gamegenie were my first introduction to software. So, this is a really meaningful announcement to me, and it probably set me off on my career in software engineering.

Congratulations Pokemon! Thanks for continuing to bring out the kid in me!

mydpy··on 2016 Spark Summit East Keynote
Did you read the proposal? https://issues.apache.org/jira/secure/attachment/12775265/St...
mydpy··on 2016 Spark Summit East Keynote
Infinitely. Yes. The addition of Dataframes in 1.3 and numerous enhancements to SparkSQL have made it as easy as:

  val myDF = sqlContext.read.format("com.databricks.spark.csv") //allows you to read a csv file (for simplicity)
    .option("header", "true")
    .option("delimiter", "\\t")
    .option("mode", "PERMISSIVE")
    .option("inferSchema", "true")
    .load(filename)
    .where(filter_query)
    .cache()
  
  myDF.registerTempTable("myDF")
  sqlContext.sql("SELECT COUNT(*) FROM myDF").show()
  sqlContext.sql("SELECT COUNT(*) FROM myDF where filter_query").show()
mydpy··on 2016 Spark Summit East Keynote
At Spark Summit East there are a lot of people evangelizing GraphX and trying to convince people to think about their problems using graphs.
mydpy··on 2016 Spark Summit East Keynote
He means the other way around: I/O improvements are outpacing CPU improvements.

Native refers to (I think) the following issues: https://issues.apache.org/jira/browse/SPARK-12785 https://issues.apache.org/jira/browse/SPARK-8641

Code generation is enabled by SPARK-8641, but not sure exactly what it entails. I think it is related to some of the RDD transformation/action merging they do to optimize runtime operations in 2.0.

Your thoughts?

mydpy··on 2016 Spark Summit East Keynote
I think the more exciting announcement was Databricks community edition, which allows you to use 2.0:

https://news.ycombinator.com/item?id=11126179

mydpy··on 2016 Spark Summit East Keynote
Me too. Matei said that Spark 2.0 should be released (stable) late-April or early May.

But you can always download and build the source!

mydpy··on Ask HN: How to contact John Carmack
That sounds really interesting to me. What size is your company? Would it make sense to work at a large company and get immersed? Do some mobile development? Design Mario maker levels?

I've done basic game development before (built centipede). Really like the design considerations involved in VR. Would love to start playing with that.

mydpy··on Ask HN: How to contact John Carmack
Thanks for the feedback. It feels like making that move would uproot my life. It's scary.

I wish I had a collaborator or someone I should bounce ideas off of.

My background is in advanced mathematics and I've gravitated towards data science and engineering. Would love to be a part of the game development process, even if not developing directly.

If I were to use my skill set in game development it would probably be in MMO games, or something with lots of active users interacting.

I have been following the handmade quake blog. I like it, just don't have enough time to really do anything meaningful.

Advice?

mydpy··on Ask HN: Is Python dying?
If anything, it is growing. Large companies are now adopting Python.
mydpy··on The NICAM Codec replacement project
Sorry this should be: http:// www.bbc.co.uk/rd/blog/2016-01-35-million-people-didnt-notice-a-thing-dot-dot-dot
mydpy··on The NICAM Codec replacement project
The name of the url is even click-baity: http://www.bbc.co.uk/rd/blog/2016-01-35-million-people-didnt...
mydpy··on Jack Dorsey addresses Twitter's character limit
Which is hilariously fitting.
← PreviousPage 2 of 6Next →