Git Product home page Git Product logo

Comments (1)

l-k-11235 avatar l-k-11235 commented on May 23, 2024

The docker image for this experiment is ghcr.io/opennmt/opennmt-py:3.4.3-ubuntu22.04-cuda11.8 but the PYTHONPATH refers to the commit 0436cdd.
We encountered an error at the loading of a checkpoint when trying to infer from a file with the inference engine (so the issue is not specifically related to LM prior).

from onmt.inference_engine import InferenceEnginePY

import json
import time
import onmt.opts as opts
from onmt.utils.parse import ArgumentParser
from onmt.utils.misc import use_gpu, set_random_seed


def _get_parser():
    parser = ArgumentParser(description="simple_inference_engine_py.py")
    opts.config_opts(parser)
    opts.translate_opts(parser, dynamic=True)
    return parser
  
def main():
  
  # Required arguments
  parser = ArgumentParser()
  parser.add_argument(
    "-inference_config_file", help="Inference config file", required=True, type=str
  )
  args = parser.parse_args()
  inference_config_file = args.inference_config_file
  base_args = ["-config", inference_config_file]
 
  parser = _get_parser()
  opt = parser.parse_args(base_args)
  ArgumentParser.validate_translate_opts(opt)
  ArgumentParser._get_all_transform_translate(opt)
  ArgumentParser._validate_transforms_opts(opt)
  ArgumentParser.validate_translate_opts_dynamic(opt)
  set_random_seed(opt.seed, use_gpu(opt))

  opt.model_task = 'seq2seq'
  engine = InferenceEnginePY(opt)
  scores, preds = engine.infer_file()
  print(list(zip(scores, preds)))
  engine.terminate()


if __name__ == "__main__":
    main()

from opennmt-py.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.