1,210 karma · joined February 4, 2015
It is full of spam.
Email was single best method I had if I needed to ask professor anything, some professors would reply promptly and some would take weeks to answer an email.
Even if Students don't work fulltime many of them rely on part time jobs (at least here in Australia) - for example one of my housemates worked as a delivery driver for a freight company and another worked in a call center. I think sometimes the professors assume students have more time to spare in the middle of the day then they do.
History (maybe exception for scientific history), politics and current affairs I would say falls outside the scope of "scientific knowledge". I do not think it is possible to avoid bias in those topics.
A significant question is what the cutoff point would be for a model based on "scientific knowledge"? Should subjects like economics, philosophy etc be included as Scientific knowledge or Should it be limited to "hard" sciences only?
We had the occasional teacher who was enthusiastic, for example I had an English teacher who arranged for us to be email pen-pals with students from a school in Japan but for the most part the majority of teachers were utterly clueless about technology.
One vivid memory I have is from grade 10. I elected to do a tech drawing class, we were supposed to have some lessons on using CAD and the school had presumably paid money for CAD software in the computer lab but the instructor (maybe 50 years old) had no clue how to use the software. So after maybe 2 lessons of him fumbling around and no one accomplishing anything it was back to drawing in pencil with a compass and a protractor for the rest of the semester.
As a rule of thumb the more blue collar the pub the better the food will be - Builders Clubs and Trade Union associated places tend to have the best food followed by Sports clubs. These places have their own issues though namely poker/slot machines (Gambling is a big problem in this country).
I think the differences are mostly cultural I have zero desire to go out drinking with people from my workplace. We have exactly one social event a year - which is the work Christmas Party and that is a fairly tame event.
In the later novels it introduces the concept of "Arafel" a word which comes from the Hebrew word for darkness. It represents the apocalypse (the end of humanity) and the idea is that through the golden path humanity is steered away from Arafel, so there is a thin veneer of a moral justification beyond power..
It has been a very long time since I read all the novels so I can't recall all the details. It is a major plot point in book 5 "Heretics of Dune" zensunni leads to the alliance between the Bene Gesserit and the Tleilaxian's. The Tleilaxu follow a strict interpretation of the religion in secret and during a meeting between the faction leaders one of the reverend mothers is able to deduce this from their speech patterns and manipulate them into an alliance which has some ramifications.
Considering the Tleilaxu aren't introduced until book 2 (I think) I assume it was planned out ahead of time by Herbert.
I see these products as tools for data visualization and reporting i.e. presenting prepared datasets to users in a visually appealing way. They aren't as well suited for serious analytics.
I can't comment on Superset or Tableau but I am familiar with Power BI (it has been rolled out across my org), the type of statistics you can do with it are fairly rudimentary. If you need to do any thing beyond summarizing (counts, averages, min, max etc). It is not particularly easy.
For data analysis I use SAS or R. This software allows you do things like multivariate regression, timeseries forecasting, PCA, Cluster analysis etc. There is also plotting capability.
Both these products are kind of old school, I've been using them since early 2000's, the "new school" seems to be Python. Pretty much all the recent data science people in my organization use Python. Particularly Pandas and libraries like Seaborn (https://seaborn.pydata.org/).
The "power" users of Power BI in my organization tend to be finance/HR people for use cases like drill down into cost figures or Interactively presenting KPI's and other headline figures to management things like that.
I think the rhyming slang part comes from Cockney slang my Dad always used to say "Dogs Eye and Dead Horse" to mean Meat Pie and Tomato Sauce.
He had other strange slang he'd use too like "Oxford Scholar" to mean "One Dollar" - UK uses pounds though so no idea where that one originated...
What is the American pronunciation of Sauce? If I had to guess maybe they pronounce it so it sounds like "Sores" or "Saws".
I don't know if I've ever heard an American say Sauce. On most American tv shows they talk about 'Ketchup'. Eg Hot Dog and Ketchup, which is a Frankfurt with Tomato sauce on a bun (doesn't really have the same ring...).
I'm in this group (I'm a Materials/Chem eng). We have recently started using media wiki internally for all sorts of documentation related things it has taken off very quickly.
Over the years there has been other solutions pushed onto us like confluence and sharepoint those never really gained any traction.
Having plugins enabled (like math equation editor) is important - Engineering documentation involves Math equations. The wiki lets you use markup like this "\frac{dC}{dO} = \frac{10}{\alpha+\frac{\beta}{([C]-C_{min})^{DC}}}" but also has visual editor.
https://learn.microsoft.com/en-us/azure/machine-learning/com...
Once the model has run it uses something called a mimic to generate model explainability, which lets you explore things like feature importance etc in the final model. As far as the user interface goes I mostly used SAS in the past and it feels quite similar.
edit: I've Also seen a lot of pitches about predictive maintenance / automated anomaly detection. I think the appeal lies in having a one size fits all solution you can apply to multiple pieces of equipment (fans, conveyor belt drives, pumps etc) and not needing to develop/deploy/maintain bespoke models.
A lot of manufacturing sites won't have a data person on tap (or even people who can write python). Also there are challenges with deployment etc especially in remote sites where access is difficult, data connectivity is bad etc (think like oil/gas pipelines). Most of the pitches seem to combine running ML models and using some kind of iot device with something like lorawan for connectivity..
More recently Machine learning has really enhanced what you can do with regression. For example multivariate regressions when there are non-linear (or partially linear) relationships between feature and target variables.
For example recent regression problem involved a chemical reaction. It was suspected that a particular feature above a threshold began to display non linear behavior but it was difficult to pinpoint exactly where it began departing from linearity. ML was very helpful analyzing this.
Other than regressions and timeseries forecasting I think it's worth knowing about K-means clustering and PCA (Principal Component Analysis)/ PLS (Projection to latent structures) as well.
I've found PCA to be pretty unknown but very useful I've had success using it in the past and found it useful to explain the relationship not just between the data features and the target variable but also how the features relate to each other.
For example >PowerBI - microsoft business analytics
I don't think I would classify Power BI as an analytics tool - In my limited experience with using it I have found that it has some nice ways to build reports and visualize data graphically but only very rudimentary statistical functions and is not really suited for performing data analysis.
My organization is travelling along the "modern data" pipeline so I'm grappling with some of the same confusion myself about what everything is in the new world...
In the "old data" world I'm familiar with - I would use stuff like SAS or R to perform ad-hoc analytics i.e. analyze data using statistics, perform regressions, Timeseries forecasting, distribution analysis etc.
For reporting and visualizing data: that would fall to things like excel, Cognos, ggplot2, Proc report and Some javascript plotting packages like d3js etc.
To Extract data would involve running SQL query against databases (Oracle, DB2 or Microsoft SQL Server etc directly) directly then using sas or R to transform the data as needed.
Modern approach seems to be Databricks to ingest data into datalake, Python via Juypter notebooks to perform analytics hosted on Azure ML studio running in cloud on a "compute instance" for another level of Indirection...Then Power BI to visualize and build reports.
It used to happen almost daily. I would get into my car reverse out of my driveway. I would drive towards my workplace for about 2 to 5 minutes until I hit first red traffic light and as I'm waiting at traffic lights I would get this sinking feeling that I'd forgotten to close my garage door.
This is despite the fact I do not have a remotely operated garage door it is manual. I have to reverse out of garage, get out of my car, manually close the garage door and get back into car and reverse out of driveway.
I would wrack my short term memory while sitting at traffic lights and have no recollection of closing the garage door. It was as if my journey (in my memory) would always begin with turning out of my driveway.
Nowadays I force myself to look over shoulder and check the garage door as I turn out of my driveway and onto the street.
So if there is a lower energy way of producing green steel it is at least worth exploring.
I'm a non software type of engineer in my world a lot of tables are structured as timeseries data (such as readings from a device or instrument) which uses timestamp as a key.
Then we have other tables which log event or batch data (such as an alarm start and end time, or Machine start/machine stop etc).
So a lot of queries end up being of the form
Select A.AlarmId, B.Reading, B.Timestamp from Alarms A, Readings B where A.StartTime >= B.Timestamp and A.EndTime < B.Timestamp
A lot of people seem to have problems grasping these kinds of joins.
For example in the US they have their elections on a Tuesday (in Australia it is a Saturday), this strikes me as suboptimal if you want the most people to vote then you should hold the election at a time that is convenient for the largest number of people, which is not in the middle of a regular working day.
Australia also has pre-polling (i.e. you can turn up to a polling station and vote before the nominated "election day") and Postal voting (both of which are to my understanding extremely controversial in the US).
I believe in the US you also need to register to vote and you have to take steps to maintain your registration. again that is an added barrier that creates more friction.
Australia also has Preferential voting, I do not believe US elections use this method.
I work at an industrial plant we have been able to measure a lot of things simply by analyzing the pixels in the video. For example one application we have a camera pointed down at a conveyor belt. The conveyor belt is one color and objects on the belt are a distinct different color.
- we just count how many pixels in a given frame are a specific color/brightness. Then you can easily work out how much of the conveyor belt has material on it in any given frame.
So if you are tying to work out what section of a video has fish in it you could count how many pixels are a different color to the normal background color.
I wanted to study Engineering at university so was required to have a certain amount of advanced Mathematics courses as well as physics.
We had two Math Streams, the advanced stream and regular stream. I was in the advanced stream but I had friends who were in the normal stream I remember feeling jealous because the normal stream got to do lots of excursions and other "fun" activities. For example my friend's entire math class played ten pin bowling at local bowling ally (ostensibly so they could compare scores and learn about median and distributions). Their class also got to visit the horse racing track to learn about odds and probability.
I think these were ham-fisted attempts to make mathematics "fun". Meanwhile my advanced class got to enjoy none of this and were stuck in the classroom all the time. At the time it felt more like a punishment then a reward.
Here there is a huge amount of public pressure to regulate behavior of banking sector targeting things like deceptive practices, predatory lending etc. See for example the 2017 Royal Commission (https://en.wikipedia.org/wiki/Royal_Commission_into_Miscondu...). The conservative government fought tooth and nail against and were heavily pressured into it due to massive public support for it.
I am unsure what the US equivalent of a Royal Commission is (it is essentially a Public Enquiry with the power to compel witnesses to give evidence under oath and investigative powers to gather evidence etc.) I don't think the same kind of attitude exists for a targeted investigation into the US banking sector, at least the messaging we get over here is US is very against stricter regulations.
I think "Linear Optimization" might be a better term, or maybe "Linear Solving".
My next computer after the dx4 was a Pentium 166 MHZ - it could play mp3's and Quake simultaneously.
I still like to chill out with a good single player game from time to time like Civilization or Total War series. I enjoyed Baldur's Gate 3 when it came out earlier this year.
I'd say gaming went from something I did often in my early 20's to occasionally by the time I was in my 30's.
I studied Engineering a STEM subject, this was sometime ago (2000's) and at that time we were required to take a "statistics for engineers" course in the second year of the degree. The subject was mostly useless (it pretty much boiled down to "plug this data into Excel and this is how you interpret the ANOVA output").
What I really wish they focused on was regression analysis and especially non-linear regression, logistic regression etc. I had to learn all about it in the workplace after graduation.
Even the statistics knowledge we were taught was incomplete - for example I did not learn about Cross-validation at university.
talking to more recent graduates I don't think the situation has improved all that much in the intervening years.
In one instance we wanted to use a FLIR camera to measure temperature as part of a control loop - had to provide guarantees about the cameras reliability (i.e. mean time between failure), have redundancy and fallbacks in place etc. In order to satisfy the SIL process.