Git Product home page Git Product logo

primenumtech_scrapingproject's Introduction

PrimeNumTech Scraping Project

This project scrapes information from a specific webpage and extracts data from the table. The extracted information includes post date, quest number, category code, bid/request name, and bid closing date.

Table of Contents

About

This Python project utilizes Selenium and BeautifulSoup to scrape data from a webpage and extract relevant information from the table. The extracted data can be used for various purposes, such as analysis or tracking upcoming bids.

Getting Started

Prerequisites

Installation

  1. Clone the repository:

    git clone https://github.com/vatsrounak/PrimeNumTech_ScrapingProject
  2. Change to the project directory:

    cd Scrapping_PrimeNumTech
  3. Create a virtual environment:

    python3 -m venv .venv
  4. Activate the virtual environment:

    • On Windows:

      .venv\Scripts\activate
    • On macOS/Linux:

      source .venv/bin/activate
  5. Install dependencies:

    pip install -r requirements.txt

Usage

Run the following command to execute the scraper script:

python scrape.py

Output:

Output_Image

The script will print the extracted information from the table.

Dependencies

  • beautifulsoup4==4.10.0
  • pandas==1.3.3
  • selenium==3.141.0

Contributing

If you'd like to contribute to the project, follow these steps:

  1. Fork the repository.
  2. Create a new branch: git checkout -b feature-name
  3. Make your changes and commit them: git commit -m 'Description of changes'
  4. Push to the branch: git push origin feature-name
  5. Submit a pull request.

License

This project is licensed under the MIT License.


primenumtech_scrapingproject's People

Contributors

vatsrounak avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.