hazim93 / auto_word_collect Goto Github PK

Word Collect is a mobile game where the goal is to form words based on the letters given.

Goal: To use machine learning to cheat i.e. suggest possible words to solve the Word Collect game from a screenshot

This project will be split to a few parts:

Phase 1: Word suggestion is done on the PC
Phase 2: Word suggestion is done on an Android device
Phase 3: Live suggestion using a smartphone camera??

For Phase 1, we'll further break it down to a few parts:

Part 1: Detect tiles from the screenshots provided & crop tiles
Custom object detection from image using PyTorch / Detecto
Image manipulation using OpenCV

Part 2: Feed into an OCR
Will start by testing using PyTesseract
If it fails, train a model to classify the letters

Part 3: Get an English library and suggest words from there based on what the letters we get from the OCR

Shield:

This work is licensed under a Creative Commons Attribution 4.0 International License.