Decision Mechanics

Insight. Applied.

  • Services
    • Decision analysis
    • Big data analysis
    • Software development
  • Articles
  • Blog
  • Privacy
  • Hire us

Dimensionality reduction using R

February 10, 2016 By editor

Learning Tree published my article on using Principal Component Analysis to reduce the dimensionality of data.

Filed Under: Data science Tagged With: dimensionality reduction, PCA, R

Worst passwords of 2015

January 30, 2016 By editor

SplashData, a purveyor of password managers, has produced its annual list of the year’s worst passwords.

The top ten are

  1. 123456
  2. password
  3. 12345
  4. 12345678
  5. qwerty
  6. 123456789
  7. 1234
  8. baseball
  9. dragon
  10. football

I guess we should all be shocked at how poor these passwords are. However, there’s no breakdown of which sites these passwords came from.

If they are all from bank accounts then, yes—OMG! However, if the bulk of them are from “sign up to read this article” sites then, meh. If I create an account just to download a free PDF, I don’t care in the slightest if my account is hacked.

To draw conclusions about behavior we need to play close attention to context.

Filed Under: Behavioral economics, Data science

Don’t trust the polls

January 28, 2016 By editor

2016 is the year of the US presidential election. Prepare to be besieged by polls. The embarrassment of the 2015 UK parliamentary election predictions is a distant memory. We get to start over.

However, Mona Chalabi reminds us, via the Guardian’s Datablog, of the challenges facing pollsters. She lists five:

  • The media are fallible. They follow fashion and make the news.
  • Journalists are fallible. They are biased—just like the rest of us.
  • Predicting the future is hard. Context shifts.
  • It’s difficult to reach people. There’s no longer a household landline.
  • People don’t want to be polled. The few who do probably have something in common.

That’s a pretty damning list—and it’s far from exhaustive.

Of course, if we don’t have poll results we’ll have to have news stories about the issues…and who’s got time for that?

Filed Under: Data science Tagged With: polling

Election polling errors blamed on bias

January 19, 2016 By editor

UK polling station sign

A report has concluded that the spectacular failure of pollsters to predict the result of the 2015 UK Parliamentary elections was largely due to

systematic over-representation of Labour voters and under-representation of Conservative voters

The report, compiled by a panel of academics and statisticians, was commissioned by the polling industry to determine why they had predicted a “photo-finish” in an election where Conservatives outpolled Labour by 36.9% to 30.4%—a crushing defeat for Labour that lead to the resignation of their leader.

Pollsters apparently used collection methods that were more likely to be used by young (Labour-leaning) voters than older (Conservative-leaning) voters. Frankly, not realising that online surveys are going to under-represent the over 70s is a shocking oversight.

While betting markets also under-estimated the extent of the win, they did better than the polling industry—without the expense.

Filed Under: Data analysis, Data science Tagged With: betting, bias, polling, prediction market

Data science with Microsoft

December 22, 2015 By editor

Jan Mulkens recently published an article on Microsoft’s recent rush to enhance it’s data science offering. And, as he illustrates, they have been very busy this year.

He highlights a number of their flagship data science initiatives.

  • Azure Machine Learning
  • Power BI
  • Cortana Analytics Suite
  • Acquisition of Datazen & Revolution Analytics
  • Integration of R in SQL Server

Other significant data science activities at Microsoft this year, in my opinion, include:

  • Prajna
  • The rise of F# as a data science platform
  • The introduction of the Data Science Virtual Machine on Azure

I’m looking forward to what they come up with in 2016.

Filed Under: Big data, Data analysis, Data science

  • « Previous Page
  • 1
  • …
  • 14
  • 15
  • 16
  • 17
  • 18
  • Next Page »

Copyright © 2026 · Decision Mechanics Limited · info@decisionmechanics.com