6.2 Inspect this page

Use Ctrl + Shift + Ior right click anywhere in the page and select Inspect. A HTML page source is open for this web page. Now for fetchingthe relevant data from the page, select the element from the page whom you want to inspect and press Ctrl + Shift + C or choose the extreme left arrow icon as shown in the picture.You will see the html code associated with the item you are selecting is visible. Hola! You have made it through this. Now next step is to extract that relevant data using Selenium module. That will be discussed in next coming segment.

6.3 Find the data you want to scrap

First, We have to find the title and comments data from the web pages. The title of the page is inside the 'div' tagof class attribute as “container” of 'h1' tag. The XPath for the title will be ‘//div[@class = “container”]/h1’. The element is fetch by one function called find_element_xpath() of class driver. Passing the xpath value here resulting in fetching the data. Scrape the comments data in the similar way.