The agenda for Spark Summit East 2015 (18-19 March) in New York City has just been published. I've listed the topics being covered and highlighted the ones that piqued my interest. Developer stream Beyond SQL: Spark SQL Abstractions For The Common Spark Job Streaming Big Data Analytics with Team Apache: Spark & Spark Streaming, Kafka and Cassandra Spark User Concurrency and Context/RDD … [Read more...]
Computer says, “No.” (to snacks)
Big data creates opportunities for all sorts of new services---good, bad or just wacky. It's difficult to be sure which category the Luce X2 TouchTV from Rhea Vendors falls under. They have a snack-vending machine that could, in principle, access your medical records via facial recognition. Cross-referencing this with your purchase history would determine if you'd been naughty and, if so, no … [Read more...]
2015—the year of domain expertise?
CrowdFlower have produced a thought-provoking infographic that considers what’s going to be hot in data science during 2015. It’s interesting that four of the eight topics point to the importance of domain expertise in data analysis: Integrated data scientists—people who are in the thick of the problems, as opposed to external analysis who just see numbers Rich … [Read more...]