Web Scraping Using Python

  1. Requests: It allows you to send HTTP/1.1 requests with ease and it does not require to manually add query strings to your URLs, or to form-encode your POST data.
  2. Beautiful Soup : is used for web scraping purposes to pull the data out of HTML and XML files. It creates a parse tree from page source code that can be used to extract data in a hierarchical and more readable manner.
  3. Pandas: Pandas is mainly used for data analysis. Pandas allows importing data from various file formats such as comma-separated values, JSON, SQL, Microsoft Excel. Pandas allows various data manipulation operations such as merging, reshaping, selecting, as well as data cleaning, and data wrangling features.
  1. Find the URL that you want to scrape.
18IT134_P1.csv file.

--

--

--

IT Engineering at Charusat University

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Wind Energy Trade with Deep Learning — Time Series Forecasting

WhatsApp with that?

Going green with Aerial Imagery & Picterra

Cognitive Hollywood: Data Reveals Box Office Economics in Turmoil

Clustering Geo-location : DBSCAN

Portfolio and Investment Analysis with Python

3 Ways to Be Creative with Your Deep Learning and Programming Skills

Statistics for data science

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Thakkar Krunal Balkrishna

Thakkar Krunal Balkrishna

IT Engineering at Charusat University

More from Medium

Learn basics of numpy library in 5 mins

How to Scrape Google Maps in Python?

Web scrapping Instagram with Python & Selenium

Tutorial — How to setup your windows computer to get started with Machine Learning / Data Science…