The Social and Behavioral Science Team, established by Barack Obama, has produced its first annual report. The unit applies insights from behavioral science in an attempt to make government more effective. David Cameron, the UK Prime Minister, set up a similar unit in 2010 which has now been spun off as an independent entity. Questions studied by the US team include Does the design of an email … [Read more...]
Prajna—Microsoft’s response to Spark
Microsoft are developing an open-source distributed analytics platform---codename "Prajna". It's apparently inspired by Spark, but will also make it easy for developers to deploy cloud servies that exploit the processing capabilities of the platform. It's written in F# and the project is hosted on GitHub. … [Read more...]
F# for Scala Developers
Scala has gained prominence in the data science community due to the rapid growth of Spark. Functional languages are well-suited to data science work so, if you find Scala productive, you might be interested in looking at F#. There's a project devoted to promoting F# as an effective data science language---FsLab. Those with Scala experience who wish to dip a toe into the F# waters should have a … [Read more...]
2015 Data Science Salary Survey
O'Reilly have published their 2015 Data Science Salary Survey. SQL, Excel, R and Python remain the top tools. Spark (and, consequently, Scala) have been the big climbers---and people with these skills are getting paid well. R remains popular, but might be an intermediate step to other tools. Those using Python and Spark are less likely to use R. This makes intuitive sense. R is a great … [Read more...]
The top three spreadsheet errors of the decade
IBM just published an article describing what they claim to be the top three spreadsheet errors of this decade---so far. Spreadsheets errors caused the sale price of Tibco Software to be overstated by $100m fatal errors in an oft-quoted fiscal austerity research project 10,000 sports fans to miss a synchronised swimming event at the 2012 Olympics Some companies I work with have started taking … [Read more...]