microsoft / conversational-speaker Goto Github PK

Whenever I run dotnet run and say the keyword, it just gives me the following set of text on loop until I stop the program.

[12:54:32] info: Listening...
[12:54:33] warn: Speech recognizer session canceled.
[12:54:33] warn: Error: RuntimeError

Every time I ask for a joke(s), it will always reply with the same ones in the same order. I set the temperature to 1.0 and nothing changes. Also, the way it says goodbye is also always the same. Does someone can help me add randomness to the completion? Is it something inherent of the Semantic Kernel?

Thanks

Hi!

I created a custom wake work phrase and named it "hey-samantha.table". I put the file in /src/ConversationalSpeaker/Handlers/WakePhrases and set the "WakePhraseModel" in configuration.json to "hey-samantha.table"

With that I get

Unhandled exception. System.ApplicationException: Exception with an error code: 0x8 (SPXERR_FILE_OPEN_FAILED)
   at Microsoft.CognitiveServices.Speech.Internal.SpxExceptionThrower.ThrowIfFail(IntPtr hr)
   at Microsoft.CognitiveServices.Speech.KeywordRecognitionModel.FromFile(String fileName)
   at ConversationalSpeaker.AzCognitiveServicesWakeWordListener..ctor(IOptions`1 options, ILogger`1 logger) in /home/kamil/conversational-speaker/src/ConversationalSpeaker/Handlers/AzCognitiveServicesWakeWordListener.cs:line 28
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Span`1& arguments, Signature sig, Boolean constructor, Boolean wrapExceptions)
   at System.Reflection.RuntimeConstructorInfo.Invoke(BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitIEnumerable(IEnumerableCallSite enumerableCallSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType)
   at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProvider provider, Type serviceType)
   at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProvider provider)
   at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Program.<Main>$(String[] args) in /home/kamil/conversational-speaker/src/ConversationalSpeaker/Program.cs:line 50
   at Program.<Main>(String[] args)

If I rename my custom wake word file to "hey-computer.table" and overwrite the existing file that's already there, it works fine.

Why is that?

Cheers

Kamil

hi .need to help ..dont know whats the reason when i dotnet run.

A colon seems to end the voice, and a program waits for another command / voice... see example below.. it doesn't allow gpt to say the joke. is there a solution for that ?

[03:13:04] info: Waiting for wake phrase...
[03:13:07] info: Wake phrase detected.
/bin/bash: line 1: mpg123: command not found
[03:13:07] info: Speaking (none): Hello!
[03:13:09] info: Listening...
[03:13:13] info: Recognized: Tell me a joke.
[03:13:16] info: Speaking (none): Sure, here's a classic one for you:
[03:13:19] info: Listening...
[03:13:24] info: Recognized: Talk.

I try to run the project following the instruction and got following exception. Any idea how to solve this is appreciated.

Which OpenAI Model is being used and how to change it?

I keep running into this issue. (see screenshot)

Hi, I need help, the program become non responsive after I say "Hello, I am xx and from yy". I had to do Ctrl + C a few times before it exit.

Any help would be appreciated, I could hear "Hello" when it first started, so the speaker shall not have issue. For the mic, I tested with other program and is working fine too on the RPI.

I am running on RPI 4 and using a normal mic + headset with USB input to the RPI.

Hi!

How to stop the conversation? Is there an equivalent to the wake word to stop the conversation?

Kamil

When I run the project on Windows, and I ask Alex to "tell me a joke", it manages to tell me the whole joke. However, on my Raspberry PI with Raspberry OS 64 bits, it will always stop the completion after the character ":".

For example:

[02:18:36] info: Listening...
[02:18:38] info: Recognized: Tell me a joke.
[02:18:39] info: Speaking (none): Of course, I'm always up for a good laugh! Here's one for you:

After I built and run, here is what I got.
Unhandled exception. System.ApplicationException: Exception with an error code: 0x8 (SPXERR_FILE_OPEN_FAILED)
at Microsoft.CognitiveServices.Speech.Internal.SpxExceptionThrower.ThrowIfFail(IntPtr hr)
at Microsoft.CognitiveServices.Speech.KeywordRecognitionModel.FromFile(String fileName)
at ConversationalSpeaker.AzCognitiveServicesWakeWordListener..ctor(IOptions1 options, ILogger1 logger) in /home/pi/conversational-speaker/src/ConversationalSpeaker/Handlers/AzCognitiveServicesWakeWordListener.cs:line 28
at System.RuntimeMethodHandle.InvokeMethod(Object target, Span1& arguments, Signature sig, Boolean constructor, Boolean wrapExceptions) at System.Reflection.RuntimeConstructorInfo.Invoke(BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor2.VisitCallSite(ServiceCallSite callSite, TArgument argument) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor2.VisitCallSite(ServiceCallSite callSite, TArgument argument) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitIEnumerable(IEnumerableCallSite enumerableCallSite, RuntimeResolverContext context) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor2.VisitCallSite(ServiceCallSite callSite, TArgument argument) at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope) at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType) at System.Collections.Concurrent.ConcurrentDictionary2.GetOrAdd(TKey key, Func`2 valueFactory)
at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProvider provider, Type serviceType)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProvider provider)
at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)
at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
at Program.