Topic: data-cleaning Goto Github

👇 Here are 2991 public repositories matching this topic...

aai-institute / pydvl
data-cleaning,pyDVL is a library of stable implementations of algorithms for data valuation and influence function computation
Organization: aai-institute
Home Page: https://pydvl.org
data-valuation shapley-value machine-learning transferlab least-core influence-functions game-theory data-quality robust-machine-learning data-centric-ai

ajaymache / data-analysis-using-python
data-cleaning,Exploratory data analysis 📊using python 🐍of used car 🚘 database taken from ⓚ𝖆𝖌𝖌𝖑𝖊
User: ajaymache
data-science data-analysis data-visualization data-cleaning data-cleansing data-wrangling data-science-python data-analytics data-analysis-python eda exploratory-data-analysis kaggle-competition kaggle-dataset kaggle-used-cars-dataset

akanz1 / klib
data-cleaning,Easy to use Python library of customized functions for cleaning and analyzing data.
User: akanz1
Home Page: https://medium.com/p/97191d320f80
data-science data-analysis klib data-visualization python feature-selection data-cleaning data-preprocessing

akvo / akvo-lumen
data-cleaning,Make sense of your data
Organization: akvo
Home Page: https://akvo.org/akvo-lumen
clojure akvo d3 react agplv3 akvo-lumen data-visualization data-cleaning

awesome-mlops / awesome-ml-monitoring
data-cleaning,A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀
Organization: awesome-mlops
mlops aiops dataops datascience machine-learning concept-drift data-cleaning data-drift data-management data-monitoring

bdr76 / csvlint
data-cleaning,CSV Lint plug-in for Notepad++ for syntax highlighting, csv validation, automatic column and datatype detecting, fixed width datasets, change datetime format, decimal separator, sort data, count unique values, convert to xml, json, sql etc. A plugin for data cleaning and working with messy data files.
User: bdr76
csv csv-to-sql data-cleaning data-quality data-wrangling datasets fixed-width metadata mysql notepad-plus-plus plugin postgresql quality sorting sql syntax-highlighting tabular-data validate validation validator

cambioml / uniflow-llm-based-pdf-extraction-text-cleaning-data-clustering
data-cleaning,LLM-based text extraction from unstructured data like PDFs, Words and HTMLs. Transform and cluster the text into your desired format. Less information loss, more interpretation, and faster R&D!
User: cambioml
Home Page: https://www.cambioml.com
data-cleaning generative-ai llm

charlesdedampierre / bunkatopics
data-cleaning,🗺️ Data Cleaning and Textual Data Visualization 🗺️
User: charlesdedampierre
Home Page: https://charlesdedampierre.github.io/BunkaTopics/index.html
natural-language-processing nlp topic-modeling cartography llms machine-learning summarization data-cleaning explainability fine-tuning

chrismuir / refinr
data-cleaning,Cluster and merge similar string values: an R implementation of Open Refine clustering algorithms
User: chrismuir
openrefine fuzzy-matching ngram approximate-string-matching data-cleaning data-clustering clustering cran r rstats

cleanlab / cleanlab
data-cleaning,The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Organization: cleanlab
Home Page: https://cleanlab.ai
weak-supervision data-cleaning data-quality data-science noisy-labels data-centric-ai out-of-distribution-detection outlier-detection active-learning data-labeling

cosbidev / pytrack
data-cleaning,a Map-Matching-based Python Toolbox for Vehicle Trajectory Reconstruction
Organization: cosbidev
Home Page: https://pytrack-lib.readthedocs.io/en/latest/#
map-matching python tracking intelligent-transportation-systems snapping data-cleaning network-graph networkx maps openstreetmap street-view topology visualization gps-tracker map-match computer-vision graph trajectory-analysis

data-cleaning / validate
data-cleaning,Professional data validation for the R environment
Organization: data-cleaning
r validation data-cleaning

data-forge / data-forge-ts
data-cleaning,The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.
Organization: data-forge
Home Page: http://www.data-forge-js.com/
data-wrangling data-forge data data-analysis javascript nodejs linq pandas visualization data-visualization data-management data-manipulation data-munging data-cleaning data-cleansing csv json

desbordante / desbordante-core
data-cleaning,Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
Organization: desbordante
data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-profiling data-science data-wrangling data-preprocessing

ecnu-icalk / educhat
data-cleaning,An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM
Organization: ecnu-icalk
Home Page: http://educhat.top/
belle chinese-nlp data-cleaning education llama llm moss open-models

ekstroem / datamaid
data-cleaning,An R package for data screening
User: ekstroem
data-cleaning data-screening reproducible-research

encord-team / encord-active
data-cleaning,The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.
Organization: encord-team
Home Page: https://encord.com/active
computer-vision data data-science data-validation deep-learning machine-learning ml mlops python active-learning

genomoncology / fuzztypes
data-cleaning,Pydantic extension for annotating autocorrecting fields.
Organization: genomoncology
Home Page: https://genomoncology.com
data-cleaning fuzzy-string-matching named-entity-linking pydantic

hi-primus / bumblebee
data-cleaning,🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)
Organization: hi-primus
Home Page: https://hi-bumblebee.com/
data-profiling data-cleaning bumblebee gui data-preparation python dask optimus gpu cudf dask-cudf prepare-data datasets

hi-primus / optimus
data-cleaning,:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Organization: hi-primus
Home Page: https://hi-optimus.com
spark pyspark data-wrangling bigdata big-data-cleaning data-science data-cleansing data-cleaner data-transformation machine-learning data-profiling data-extraction data-exploration data-analysis data-preparation cudf dask dask-cudf data-cleaning

holoclean / holoclean-legacy-deprecated
data-cleaning,A Machine Learning System for Data Enrichment.
Organization: holoclean
Home Page: http://www.holoclean.io
data-cleaning data-enrichment data-science inference-engine machine-learning pytorch

iam-mhaseeb / skytrax-data-warehouse
data-cleaning,A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
User: iam-mhaseeb
python python3 database data-visualization data-analysis data-warehouse data-warehousing redshift airflow docker sql data-orchestration data-analytics s3 s3-bucket metabase data-engineering data-cleaning data-processing

ibug-group / fpage
data-cleaning,FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild
Organization: ibug-group
age-estimation age-classification imdb-wiki-dataset data-cleaning face-analysis facial-attributes gender-classification face-parsing attention-mechanism ibug

iqrar99 / data-analytics-portfolio
data-cleaning,Portfolio of data science and data analyst projects completed by me for academic, self learning, and hobby purposes.
User: iqrar99
python data-science data-analyst data-analysis data-visualization-project data-visualisation data-mining data-cleaning data-visualization data-analytics

jim-schwoebel / allie
data-cleaning,🤖 An automated machine learning framework for audio, text, image, video, or .CSV files (50+ featurizers and 15+ model trainers). Python 3.6 required.
User: jim-schwoebel
machine-learning deep-learning machine-learning-library machine-learning-api automl tpot data-augmentation data-cleaning datasets machine-learning-models

jim-schwoebel / voicebook
data-cleaning,🗣️ A book and repo to get you started programming voice computing applications in Python (10 chapters and 200+ scripts).
User: jim-schwoebel
Home Page: https://neurolex.ai/voicebook
voice voice-assistant voice-recognition voice-recording transcription featurization data data-cleaning visualization generation

johnkerl / miller
data-cleaning,Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
User: johnkerl
Home Page: https://miller.readthedocs.io
data-processing data-cleaning csv csv-format streaming-data streaming-algorithms tsv json json-data data-reduction

justmarkham / dat8
data-cleaning,General Assembly's 2015 Data Science course in Washington, DC
User: justmarkham
data-science machine-learning scikit-learn data-analysis pandas jupyter-notebook python course linear-regression logistic-regression

justmarkham / pandas-videos
data-cleaning,Jupyter notebook and datasets from the pandas video series
User: justmarkham
Home Page: https://courses.dataschool.io/pandas-in-30-days
data-science jupyter-notebook python pandas tutorial data-analysis data-cleaning

kulikdm / pythresh
data-cleaning,Outlier Detection Thresholding
User: kulikdm
Home Page: https://pythresh.readthedocs.io/en/latest/?badge=latest
contamination-detection outlier-detection thresholding data-cleaning filtering-algorithm outlier-selection

librarycarpentry / lc-open-refine
data-cleaning,Library Carpentry: OpenRefine
Organization: librarycarpentry
Home Page: https://librarycarpentry.org/lc-open-refine/
carpentries library-carpentry lesson openrefine data-cleaning data-management english stable

lolei / redditcleaner
data-cleaning,Cleans Reddit Text Data :scroll: :broom:
User: lolei
reddit pushshift data-cleaning text-data nlp python praw psaw hacktoberfest

msamogh / nonechucks
data-cleaning,Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
User: msamogh
pytorch data-processing data-preprocessing data-pipeline data-cleaning preprocessing machine-learning torch

msberends / clean
data-cleaning,Fast and Easy Data Cleaning (in R)
User: msberends
Home Page: https://msberends.github.io/clean
r data-cleaning

opendataval / opendataval
data-cleaning,OpenDataVal: a Unified Benchmark for Data Valuation in Python (NeurIPS 2023)
Organization: opendataval
Home Page: https://opendataval.github.io/
data-valuation machine-learning python research statistics data-centric-ai data-cleaning game-theory

probcomp / pclean
data-cleaning,A domain-specific probabilistic programming language for scalable Bayesian data cleaning
Organization: probcomp
probabilistic-programming probabilistic-graphical-models data-cleaning data-cleansing bayesian-inference

rasgointelligence / feature-engineering-tutorials
data-cleaning,Data Science Feature Engineering and Selection Tutorials
Organization: rasgointelligence
Home Page: https://www.rasgoml.com/
notebook tutorials tutorial python pandas data-science machine-learning scikit-learn feature-engineering feature-selection

renumics / sliceguard
data-cleaning,A library for detecting problematic data segments in structured and unstructured data with few lines of code.
Organization: renumics
data-analysis data-cleaning data-curation data-exploration data-science data-visualization deep-learning exploratory-data-analysis machine-learning python

ropensci / taxa
data-cleaning,taxonomic classes for R
Organization: ropensci
Home Page: https://docs.ropensci.org/taxa
taxonomy taxon data-cleaning rstats r r-package

rvanasa / pandas-gpt
data-cleaning,Power up your data science workflow with ChatGPT.
User: rvanasa
Home Page: https://pypi.org/project/pandas-gpt
chatgpt data-cleaning data-engineering data-science data-visualization jupyter-notebook low-code matplotlib numpy openai pandas productivity scipy seaborn

sail-sg / sailcraft
data-cleaning,🚢 Data Toolkit for Sailor Language Models
Organization: sail-sg
Home Page: https://sailorllm.github.io/
data-cleaning data-deduplication

schema-inspector / schema-inspector
data-cleaning,Schema-Inspector is a simple JavaScript object sanitization and validation module.
Organization: schema-inspector
Home Page: http://schema-inspector.github.io/schema-inspector/
javascript validation sanitization data-cleaning

scottythered / gratefuldata
data-cleaning,Grateful Data isn't programming code, but an online tutorial about data acquisition, cleaning and enriching, using publicly accessible data on the band the Grateful Dead as examples. Read the Wiki to find out how to use the sample data.
User: scottythered
grateful-dead grateful-data data-acquisition digital-humanities open-refine data-cleaning

sfirke / janitor
data-cleaning,simple tools for data cleaning in R
User: sfirke
Home Page: http://sfirke.github.io/janitor/
data-analysis data-cleaning data-science dirty-data excel pivot-tables r spss tabulations tidyverse

sharad461 / nepali-translator
data-cleaning,Neural Machine Translation on the Nepali-English language pair
User: sharad461
data-cleaning machine-translation nepali-english parallel-corpus

sharmaroshan / drugs-recommendation-using-reviews
data-cleaning,Analyzing the Drugs Descriptions, conditions, reviews and then recommending it using Deep Learning Models, for each Health Condition of a Patient.
User: sharmaroshan
recommendation-system data-visualization data-analysis data-mining data-cleaning feature-engineering feature-selection machine-learning deep-learning hybrid-model

skrub-data / skrub
data-cleaning,Prepping tables for machine learning
Organization: skrub-data
Home Page: https://skrub-data.org/
machine-learning data-science data-cleaning data data-preparation data-preprocessing data-analysis dirty-data data-wrangling

skupriienko / ukrainian-stopwords
data-cleaning,the list of ~2000 ukrainian stopwords (with numbers)
User: skupriienko
ukrainian ukrainian-language ukrainian-nlp nlp stopwords ukrainian-stopwords webscraping data-cleaning python

unionai-oss / pandera
data-cleaning,A light-weight, flexible, and expressive statistical data testing library
Organization: unionai-oss
Home Page: https://www.union.ai/pandera
pandas validation schema dataframes testing pandas-validation pandas-dataframe data-validation data-cleaning data-check

voxel51 / fiftyone
data-cleaning,The open-source tool for building high-quality datasets and computer vision models
Organization: voxel51
Home Page: https://fiftyone.ai
machine-learning artificial-intelligence deep-learning computer-vision developer-tools data-science python active-learning data-centric-ai data-cleaning