Git Product home page Git Product logo

cav-scrapers's Introduction

Installation

To install dependencies type the following into your terminal from this directory:

pip install -r requirements.txt

If using MacOS or Linux type pip3 instead of pip in the command

Overview

The Cav Scrapers repo is a collection of tools for the manipulation of data on the 7Cav.us forums and it's Milpacs system.

Files

milpacsScraper.py

milpacEditor.py

This file is used to:

  • Add award entries
  • Add service record entries
  • Upload uniform files

Currently, if the file is executed directly it will give you instructions for doing a bulk processing of any of the options listed above. To perform a bulk processing you need to have a .csv file with the correct items in each row. The requirements for each type of bulk processing are listed below.

The format for the row listing is: <index number> (<variable type>): <description>

Bulk Service Records

Each row must contain the following:

0 (int): Trooper's Milpac ID.

1 (int): Trooper's roster ID.

2 (str): Service record entry text.

3 (str): Service record entry date. Must be following Format: yyyy-mm-dd (Ex: "2020-01-19")

4 (str) [OPTIONAL]: Path to citation file. Not the folder, the actual file.

Bulk Awards

Each row must contain the following:

0 (int): Trooper's Milpac ID.

1 (int): Trooper's roster ID.

2 (str): Award name, as it appears in Milpacs. Case sensitive.

3 (str): Service record entry date. Must be following Format: yyyy-mm-dd (Ex: "2020-01-19").

4 (str): Path to citation file. Not the folder, the actual file. If not using a citation, put an empty string.

5 (str) [OPTIONAL]: Award details.

Bulk Uniform Upload

Each row must contain the following

0 (int): Trooper's Milpac ID.

1 (int): Trooper's roster ID.

2 (str): Path to uniform file. The file, not the folder.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.