sketch2code's Introduction

Sketch2code

Generating HTML Code from a hand-drawn wireframe

a simple deep learning model that takes hand-drawn web mockups and converts them into working HTML code. It uses an image captioning architecture to generate its HTML markup from hand-drawn website wireframes.

Heavily inspired by Ashwin Kumar's blog post, For more information, check out his post: Automating front-end development with deep learning

Model architecture

Download the data

bash get_data.sh

Docker demo settings

docker pull mzbac/sketch2code
docker run -p 5000:5000 mzbac/sketch2code

browser to localhost:5000

Load pre-trained weights

encoder = torch.load('model_weights/encoder_resnet34_0.061650436371564865.pt')
decoder = torch.load('model_weights/decoder_resnet34_0.061650436371564865.pt')

Pre-trained weight preview:

Pre-trained model's BLEU score

0.974

sketch2code's Issues

It does not work as expected

When I tried with my sketch image, it returns wrong template (still the default template)
I attached my file in this post.

where to load pretrained weights ?

We have successfully run the docker containers but we don't know how to load pre-trained weights
encoder = torch.load('model_weights/encoder_resnet34_0.061650436371564865.pt')
decoder = torch.load('model_weights/decoder_resnet34_0.061650436371564865.pt')
what is use of this and where to insert it??

Recommend Projects

mzbac / sketch2code Goto Github PK

sketch2code's Introduction

Sketch2code

Generating HTML Code from a hand-drawn wireframe

Model architecture

Download the data

Docker demo settings

Load pre-trained weights

Pre-trained weight preview:

Pre-trained model's BLEU score

sketch2code's People

Contributors

Stargazers

Watchers

Forkers

sketch2code's Issues

Recommend Projects

Recommend Topics

Recommend Org