Decision Mechanics

Insight. Applied.

  • Services
    • Decision analysis
    • Big data analysis
    • Software development
  • Articles
  • Blog
  • Privacy
  • Hire us

RStudio 1.0 released

November 2, 2016 By editor

RStudio have released version 1.0 of their eponymous R IDE. They are calling it their ...biggest [release] ever! It certainly has a number of very significant features. Integrated support for Spark Spark and R are core tools for data scientists. While Spark has an R API, support for the machine learning libraries is lagging. So, it's great to hear that RStudio now has integrated support … [Read more...]

Filed Under: Data analysis, Machine learning Tagged With: R, R Notebooks, RStudio, Spark, sparklyr

RDDs, DataFrames and Datasets

July 14, 2016 By editor

There are now three Spark APIs for working with large volumes of data RDD DataFrame Dataset Which one should we use? Good question. Jules Damji provides a pretty comprehensive answer in an article on the Databricks blog. RDD was the original API for working with large volumes of data. The first thing to note is that the RDD API is not being deprecated. It has an important role to play. RDDs … [Read more...]

Filed Under: Big data, Data science, Machine learning Tagged With: DataFrame, dataset, RDD, Spark

Status of Spark MLlib wrappers in SparkR

July 14, 2016 By editor

Wrappers for Spark's MLlib machine learning library in SparkR have been slow to arrive. However, the future looks bright. The imminent 2.0 release will bring k-means support to SparkR and the 2.1 release is scheduled to include wrappers for the following machine learning stalwarts Alternating Least Squares (ALS) Decision Trees Gaussian Mixture Models Isotonic Regression Latent Dirichlet … [Read more...]

Filed Under: Machine learning Tagged With: mllib, Spark, sparkr

Free Apache Spark Analytics Made Simple e-book

March 31, 2016 By editor

Databricks have just published a free e-book entitled "Apache Spark Analytics Made Simple". Contents include An introduction to the Spark API for analytics Tips and tricks to simplify unified data access Real-world case studies of how various companies are using Spark with Databricks to transform their business There are more to come. Titles are Mastering Advanced Analytics with Apache … [Read more...]

Filed Under: Big data, Data analysis Tagged With: e-book, Spark

Search

Subscribe to blog via e-mail

Subscribe via RSS

Recent posts

  • Data Wrangler
  • The Trolley Problem
  • Counting votes using Excel
  • Accuracy vs precision
  • It’s not because we have insufficient data…

Copyright © 2025 · Decision Mechanics Limited · info@decisionmechanics.com