Create an ML Pipeline

Prerequisites

1. Create Resource Group

2. Create an ML Workspace

3. Create a Storage Account

4. Create a Datastore

5. Create Datasets

Creating an ML Pipeline

1. Select Pipeline in left pane of Azure ML Studio and click on "Create a new pipeline using classic prebuilt components".

2. Creating a pipeline will create a blank canvas for connecting various components of ML. Click "ph_and_hr_dataset" or another dataset that you have uploaded and drag it to the blank canvas. Note that the "Data" tab below will show all available datasets that were uploaded and the "Components" tab will display all ML components that are available for use in the ML pipeline.

3. Before proceeding further, set up a compute instance. Follow the tutorial on "Create Compute Instance"

4. Right click on the dataset block and click "Preview data".

4. Preview will show not only a preview of the data but it allows some visualisations of the data as well.

5. Click on the Profile tab as shown in the image below.

6. The profile option shows the histogram of all features in the data.

7. Click on any one of the feature row and it will display the Boxplot of that particular feature.

8. Click on the next feature and observe the boxplot visualisation.

9. Select the components and connect them together as shown in the image below.

10. Double click the "Linear Regression" component and select the hyperparameters of the Linear Regression algorithms. Use the Solution method "Gradient descent" instead of "Ordinary Least Squares". Other parameters can be left at default values for this experiment.

11. Double click the "Split Data" component and change "Fraction of rows in the first output dataset" field to 0.8.

12. Set the "Random seed" value to 1.

13. Next, double click "Train Model" and click on "Edit column".

14. Click the "Enter column name" field and enter the name of the outcome column e.g. pH for the pH dataset.

15. Type "pH" and click "Save".

16. Click "Submit"

17. After clicking "Submit" in the previous step, a pop-up will appear asking to create a new "Experiment" or select "Existing Experiment". Click "Create new"

18. Click the "Enter new experiment name" field and type "predicting-ph-from-hr"

19. Click "Submit"

20. Once the job has been submitted. Select "Pipelines" in the left pane of the Azure ML Studio and select the submitted pipeline under the "Pipeline jobs" tab.

21. Right click "Scored dataset" and select "Preview data"

22. Observe the actual and predicted values side-by-side.

23. Right click on the "Evaluate Model" component and click on "Evaluation results" in "Preview data" option.

24. Observe the error metrics.