Develop a web links scraper program in Python that extracts all of the unique web links that point out to other web pages

INSTRUCTIONS TO CANDIDATES

ANSWER ALL QUESTIONS

Develop a web links scraper program in Python that extracts all of the unique web links that point out to other web pages from the HTML code of the 'Current Estimates' web link, both from the 'US Census Bureau' website (see web link below) and outside that domain, and that populates them in a comma-separated values (CSV) file as absolute uniform resource indicators (URIs).

 

A.    Explain how the Python program extracts the web links from the HTML code of the 'Current Estimates,' found in web links section.

 

B.    Explain the criteria you used to determine if a link is a locator to another HTML page. Identify the code segment that executes this action as part of your explanation.

 

C.    Explain how the program ensures that relative links are saved as absolute URIs in the output file. Identify the code segment that executes this action as part of your explanation.

 

D.    Explain how the program ensures that there are no duplicated links in the output file. Identify the code that executes this action as part of your explanation.

 

Note: Please consider weblinks that point to the same web pages as identical  (e.g. www.commerce.gov and www.commerce.gov).

 

E.    Provide the Python code you wrote to extract all the unique web links from the HTML code of the 'Current Estimates' (in the web links section), that point out to other HTML pages.

 

F.    Provide the HTML code of the 'Current Estimates' web page scrapped at the time when the scraper was run and the CSV file was generated.

 

G.    Provide the CSV file that your script created.

 

H.    Run your script and provide a screenshot of the successfully executed results.

 

I.     Acknowledge sources, using in-text citations and references, for content that is quoted, paraphrased, or summarized.

 

J.    Demonstrate professional communication in the content and presentation of your submission.

Related Questions

. Introgramming & Unix Fall 2018, CRN 44882, Oakland University Homework Assignment 6 - Using Arrays and Functions in C

DescriptionIn this final assignment, the students will demonstrate their ability to apply two ma

. The standard path finding involves finding the (shortest) path from an origin to a destination, typically on a map. This is an

Path finding involves finding a path from A to B. Typically we want the path to have certain properties,such as being the shortest or to avoid going t

. Develop a program to emulate a purchase transaction at a retail store. This program will have two classes, a LineItem class and a Transaction class. The LineItem class will represent an individual

Develop a program to emulate a purchase transaction at a retail store. Thisprogram will have two classes, a LineItem class and a Transaction class. Th

. SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of Sea Ports. Here are the classes and their instance variables we wish to define:

1 Project 1 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of

. Project 2 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of Sea Ports. Here are the classes and their instance variables we wish to define:

1 Project 2 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of