Thank you Meredith for posting this! With respect to the "modeling" stage, what we currently have with AutoAI Experiment on Cloud Pak for Data (and IBM Cloud) is truly impressive. It selects the right model, applies hyperparameter optimization, ensembles, and pick the best model in terms of a metric that you can choose. That brings the question, can it be done 100% automated? I think the answer is no. There are a few things that you should know before you go into AutoAI (well, having AutoAI Experiment in mind). Basically, I think there are three basically things you should know before you can use AutoAi (Experiment) succesfully. And the nice thing, it has nothing to do with statistics or math. Unless, of course, you want to dive into
hyperparameter optimization, which will take you years of study to understand what they are doing exactly. But, as said, no stats or math required to apply Auto AI successfully. But there a few other things to know before you start (still, with AutoAI Experiment in mind as a representative instance of AutoAI). Also, with the respect to the "Preparation" stage, I think it cannot be 100% automated. Well, interesting questions, and the cliffhanger, of course, is the question: "what three things are required to apply AutoAI in the modeling stage successfully?" :-). Once again, thank you for posting this Meredith!
------------------------------
JOS den RONDEN
------------------------------
Original Message:
Sent: Thu March 12, 2020 04:57 PM
From: Meredith Mante
Subject: AutoAI's Impact on the Data Science Workflow
An emerging trend in AI is the availability of technologies in which automation is used to select a best-fit model, perform feature engineering and improve model performance via hyperparameter optimization. Automated solutions are becoming available to address each step in the Data Science workflow. Market research firms have predicted automation will help address the skills gap in Data Science and improve the productivity of Data Scientists. What are your thoughts about the capabilities of AutoAI? Where within the Data Science workflow do you expect it to have the most impact?
------------------------------
Meredith Mante
------------------------------
#AIandDSSkills
#DataandAILearning