The purpose of this assignment is to build and train multilayer fully connected dense layer neural network with different techniques to prevent overfitting

INSTRUCTIONS TO CANDIDATES

ANSWER ALL QUESTIONS

Assignment 3 – CS 6304 Deep Learning

Purpose: The purpose of this assignment is to build and train multilayer fully connected dense layer neural network with different techniques to prevent overfitting.

 

What to submit: Submit Jupiter notebook that contains code and proper comments. You do not need to submit the data sets.

 

 

Refer to the Overfitting.ipynb jupyter notebook under week 2. This notebook illustrates how to build and train a multi-layer perceptron to recognize handwritten digits (0, 1, 2, ….9) using “drop out” technique to prevent overfitting.

In this assignment, you will use the same data sets used in the same notebook, but you will experiment other techniques to prevent overfitting.

In the notebook, you are already given three four model architectures

- Model with L1 regularization

- Model with L2 regularization

- Model with L1L2 regularization

- Model with Batch normalization

 

 

Train these four models (early stopping should be applied) using the same training parameters used with the “dropout” technique in the notebook. Report predictions on the testing set from these four models.

Plot the training/validation loss and accuracy vs epochs from the four training procedures.

[25 points for successful training and plot for each model]

 

 

Attachments:

Expert's Answer

343 Times Downloaded

Related Questions

. Introgramming & Unix Fall 2018, CRN 44882, Oakland University Homework Assignment 6 - Using Arrays and Functions in C

DescriptionIn this final assignment, the students will demonstrate their ability to apply two ma

. The standard path finding involves finding the (shortest) path from an origin to a destination, typically on a map. This is an

Path finding involves finding a path from A to B. Typically we want the path to have certain properties,such as being the shortest or to avoid going t

. Develop a program to emulate a purchase transaction at a retail store. This program will have two classes, a LineItem class and a Transaction class. The LineItem class will represent an individual

Develop a program to emulate a purchase transaction at a retail store. Thisprogram will have two classes, a LineItem class and a Transaction class. Th

. SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of Sea Ports. Here are the classes and their instance variables we wish to define:

1 Project 1 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of

. Project 2 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of Sea Ports. Here are the classes and their instance variables we wish to define:

1 Project 2 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of