Decision Mechanics

Insight. Applied.

  • Services
    • Decision analysis
    • Big data analysis
    • Software development
  • Articles
  • Blog
  • Privacy
  • Hire us

RDDs, DataFrames and Datasets

July 14, 2016 By editor

There are now three Spark APIs for working with large volumes of data RDD DataFrame Dataset Which one should we use? Good question. Jules Damji provides a pretty comprehensive answer in an article on the Databricks blog. RDD was the original API for working with large volumes of data. The first thing to note is that the RDD API is not being deprecated. It has an important role to play. RDDs … [Read more...]

Filed Under: Big data, Data science, Machine learning Tagged With: DataFrame, dataset, RDD, Spark

Microsoft announces major commitment to Apache Spark

June 8, 2016 By editor

Microsoft have just announced an extensive commitment for Spark to power Microsoft’s big data and analytics offerings including Cortana Intelligence Suite, Power BI, and Microsoft R Server Spark 1.6.1 is available on Azure HDInsight and integration with R Server is following. This will allow R functions to be run at scale over thousands of Spark nodes. … [Read more...]

Filed Under: Big data, Data science, Machine learning

Microsoft R Open 3.2.5 released

May 30, 2016 By editor

Microsoft R Open 3.2.5 is now available. While there are no substantial changes to core R, the CRAN snapshot includes some new packages, such as deeplearning---a deep neural network implementation for regression and classification. … [Read more...]

Filed Under: Data science, Machine learning Tagged With: deep learning, R.Microsoft R Open

Microsoft R Server documentation is now online

May 17, 2016 By editor

The complete Microsoft R Server documentation is now available on MSDN---and is publicly accessible. It includes comprehensive details of the RevoScaleR High Performance Analytics package. RevoScaleR includes the following analysis functions rxSummary (basic summary statistics) rxLinMod (linear modeling) rxLogit (logistic regression modeling) rxGlm (generalized linear modeling) rxCovCor … [Read more...]

Filed Under: Big data, Data science Tagged With: documentation, Microsoft R Server, RevoScaleR

Designing a data strategy

May 2, 2016 By editor

Learning Tree just published my article on why it's important to think carefully about the data and techniques employed in data-driven decision-making. Throwing machine learning at existing data doesn't cut it. … [Read more...]

Filed Under: Data analysis, Data science Tagged With: strategy

  • « Previous Page
  • 1
  • …
  • 11
  • 12
  • 13
  • 14
  • 15
  • …
  • 18
  • Next Page »

Search

Subscribe to blog via e-mail

Subscribe via RSS

Recent posts

  • Data Wrangler
  • The Trolley Problem
  • Counting votes using Excel
  • Accuracy vs precision
  • It’s not because we have insufficient data…

Copyright © 2025 · Decision Mechanics Limited · info@decisionmechanics.com