Ok, I recently fall again on a keyboard I did not know about from a Kickstarter.
So maybe it is time to try to make a small list of what I found on the web and how they deal with the software part to see how I could link those a hardware to OMI.

Maybe a solution for the project would be to read the input outside Unity to send them to Unity to generate the logic and the filter. And to send back the logic to the application for execution.

I am have some doubt about the transition delay with UDP event if it is on the same PC.

The questions are, if i decide to do that:

• can I do it with java to be multi-platform ?
• what library or official code would allow me to do that in java ?
• Does it exist a library that is doing that with the "permissive" license ?

https://github.com/T-vK/ESP32-BLE-Keyboard

https://maker.pro/arduino/tutorial/how-to-use-an-ldr-sensor-with-arduino

Ok, I need to prototype models with some CNC.
What FabLab exist ? How has the most fitting solution for the project ?

Glossry

• CNC = fraiseus numérique

Could be cleaner or could be more abstract. But for the moment it is perfect compare to initial bullshit i done 6 months ago.

What are SMD Resistor ?

• https://youtu.be/_DsCdOaRUPM
• https://www.youtube.com/watch?v=pKOxVmEa6ec

https://youtu.be/vJF3dzMavhU

Would we connect OMI with EGG brain scan that are commercial for customer use.

• What are the price ?
• What is available ?
• What are the constrain ?

Good resume of the product and concept

https://youtu.be/8Hyhljnq9Z4

This file allow you to switch a Boolean based on the intensity of microphone intensity.

In the following example, we create booleans that check if the user in the microphone 1 is speaking correctly or not.

It can be used if you have several microphone on your computer and want to make a feed back when the participant is not tuned properly to the microphone intensity.
It can also display the user that he is considered as speaking by the software.

It can be use for ton of alternative tools. For example:

• if you want to make a tool that countdown the time of each participant
• if you want to trigger some action based on morse you do with your pencil
• wait for error to occur to launch a script
• be able to control by "voice" your computer when doing away-from-keyboard actions
• ...

Microphone1♦Mic1NotUsed♦0.1♦1
Microphone1♦Mic1Used♦0.1♦1
Microphone1♦Mic1Medium♦0.5♦1
Microphone1♦Mic1TooHigh♦0.9♦1

One way I am using it is to fishing in world of Warcraft:

Stereo♦FishingSound♦0.1♦1

See #47 .wowfishingsetting

How to set it up ?

This one is a bit tricky because for the moment, my code allows only to listen to microphone.

Low cost computer

In some computer you don't have tools to listen to the ouput sound as an input sound.

In my old computer the trick is simple... I use a jack cable that go from the microphone jack and the speaker jack. And track the microphone of window.

"If it is stupid by it work... It ain't that stupid."

By changing your Window preference

Open the sound configuration system of Window.

Check for the name of the input you want to listen. You have one for each microphone detected of virtual audio input in your computer.

If you don't want to use the name of the audio Window gave to your microphone you can renamed it.

Java OMI is a small Java "Runtime" that listen to a port of you computer.
When he received a message (not security yet) he try to translate it.
If he does, it converts it to a mouse move/click/wheel, keyboard stroke.

Required Java Runtime on your computer.
Generally install by default, if not download it here

You can easily interact with is in Unity using this package:
be.eloistree.javaopenmacroudp

Default Port:2501
Commands (P ress, R elease, S troke) :

• ks:[keyname:string]: // type a key on the keyboard
• ms:[0,1,2] // click the mouse left, middle or right
• wh:[wheel:int] // Do a scroll mouse
• mm:[x:int]:[y:int] // Move your mouse at the x:y pixel of the screen

Download last stable version:
V2020_04_10_JavaOMI.zip

• https://shop.playtronica.com/touchme

If I give you this boolean:
IsHandsOverHead
IsHandsStandingStill
IsHandOnLeftSide
IsHandOnRightSide
IsHandLeftNearHead
IsHandRightNearHead
Could you check if the player is holding his hand in the air ?
Could you check if the player is asking a question ?
Could you check if the player is crossing hands ?
Yes by doing combination.

But to do that you need to connect the dote in a way or an other that the programme can understand.
That the idea of this thread to check around what has been done with boolean state machine and how I could write my "own" converter to allow user to know learn a coding language but still use logic to do they own input trigger.

Ok I lost a night on this one.
Was trying to make the HC06 bluetooth work on my Arduino Mega.
Impossible when on the ARduino Uno, no problem.
After lot's and lot's of forum not answering my question I fall on that:
https://www.arduino.cc/en/Reference/softwareSerial

Thanks to:

Those video explain how to use ATMega328 instead of the Arduino:

• https://youtu.be/Sww1mek5rHU
• https://youtu.be/cebMSJrNntI

Should I use it ?
Does it still allows keyboard input ?
Is it hard to do in practice ?

Same question that for #38 Egg:

• what are muscle sensors ?
• How will I have to connect them to OMI ?
• What are the constraint ?
• What are the cost ?

Ouh... That a hard topic.

To read

You can find my code here that is based on some else code:
https://github.com/EloiStree/XInputDotNet

To Write

To write is an other story...
You can't write just by calling a windowfile.dll like for mouse and screen.

You need to create a fake controller using:

• https://github.com/bayangan1991/PYXInput/tree/master/pyxinput/ScpVBus-x64
• https://github.com/bayangan1991/PYXInput/tree/master/pyxinput/ScpVBus-x86

The tool is apparently created by "vXbox by vJoy".

• http://vjoystick.sourceforge.net/site/index.php/vxbox

And then use some wrapper like the following:

• https://github.com/mogzol/ScpDriverInterface
• https://github.com/TybaIt/vXboxInterfaceWrap

To interface the DLL.

(I am new to this weird situation. So feel free to correct me and don't take my word for trust.)

There are also a x360ce Library but I am not sure of how to use it or if it is free to use in the license therm.

The question is simple, in what ways can I support auto Hotkey with Unity OMI or Java Runtime OMI.

Work like a charm. Thread give 200-500 tick per second to read the keyboard input. And boolean history is my need boolean baby. It is crazy good. (Except that is need to be optimist for the garbage collector.)

If you think an application is similar or a competitor of Open Macro input.
Feel free to put it here.

I need to convert the screen(s) to Texture2D in unity to be able to make pixel condition and shadergraph filtering to improve the toolbox OMI.
You can use the classic C# and user32 dll to copy the screen but it often crash and is very very slow 400-1000 milliseconds.
I use also a java version that take 100-600 ms.

I need something more smooth. Because of performance but also because I would like to create my own virtual desktop version in Unity in an open source way in the future to make working environment.

So apparently they are ways of doing it. But that in skills I don't own.
So let's learn new skills.

Regex

Basically, a Regular Expression is a small line of text that represent a format.
You can use it to sort, replace, found, identify, validate text ...

There are tons of reason to study Regex in your life.

Why should you study Regex to use Open macro input ?

• Because it allows you to create your own input state listener without having to learn code.
• Because you can create "format" of text that can trigger the macro & commands you want.

How ?

1.For the the trigger, you can for example do this:
Regex: (?=([Aa]rcher|[Ss]oldiers?)).*([Bb]ig)
Command: Stroke 10 time key Z
Text:
Can you spawn archer soldiers. A Big group. Can you spawn archer soldiers. A Small group. Can you spawn one archer soldier.

Ok, so one of the hardware I have is, Tap With Us:
https://www.tapwithus.com/

It is a good example of OMI support complex case:

• I need it to works on my phone when I am not on my PC.
• I need it to interact with my PC when I am on it
• I need it to only interact when I press some button on my keyboard
• I could make the phone switch mapping depending on what app I am focusing

So... Lot's of work.

But if it works properly without too much "bug" it means that OMI is almost ready to be massively used

For the moment you can find:

• Tap Official API for Unity
  • My unity package manager adaptation
• My Tap With Us toolbox for Unity
• Demo of Tap with direct bridge to Java OMI

Find the APK demo of Java Toolbox here:
TapWithUsToolboxDemo.zip

Installation & Use

A bit complex, I should do a video about the subject.
In the big line:

1. Download the last Zip
2. You should have an APK and a jar file in it
3. Install the APK on your phone
4. Launch the applicatoin
5. Launch the jar file by clicking on it
6. Add the ip & port info in your phone app from the app on your PC
7. You should be able ton control your PC.

Feel free to learn how to install APK on your phone.
Then to come on the discord to ask me how to do it (until I have a video about it)

Check if Rewired can ready controller from outside Unity. If yes, check if it would be a good idea to make a pipe to the tool for user that want a good controller input entry but at the cost of buying the tool.

Youtube playlist:
https://www.youtube.com/playlist?list=PLFAQMlaJo92ILFY-wjatU6yyFb1TWvCqF

Wow Fishing Setting file can be use to start a block of logic that allow a player of World of Warcraft to auto-fish when they don't need to use their computer.

// That is the macro we will execute if a fishing is detected
☗fishingcastcommandline macro:wow:collectandrestartfishing

//This is the condition that will trigger if the fish has been detected
☗fishingtriggercastcondition wow + fishingsound

//This condition allow to define when the user want to fish automaticaly
☗fishingactivecondition wow + isfishing 

// This is the time in millisecond that we want the detection of the fishing to be in pause when we re-cast the line
☗fishingcastpause 4000

//This is the time in millisecond before the cast will be re-cast if it was not triggered before
☗fishingrecallduration 22000

To work you need an other part.

• Pixel detection that will be present in near future.
• Sound detection

For the moment I use the sound of the computer.
Like this:

// Set the boolean "FishingSound" to on/off based on the intensity  of the sound, from 10% to 100% of it for true, that is out of a audio channel with "Stereo" in his name.
Stereo♦FishingSound♦0.1♦1

Look in the documentation on ".audiointensity" to check how to set it up.

https://www.unifiedremote.com/

Ok, I remember by talking with IOT guys and during hackathons that they use lot's of different service for dealing with device around the house and buildings.

That where I learn the first time about MQTT Server.
What what else exist in the field.

The idea is that simple webcam can know where you are in the room.
So it would be good to have if the I am in the bed room of the room and click on play button. I play music and put window screen in low mode or black.

I know that at the start IFTTT should be that but they are so greedy with sponsors that it is unusable.

So the question of this Topic is:
How does people using IOT trigger actions from so many devices on the web.

https://dreampuf.github.io/GraphvizOnline/?fbclid=IwAR0XQ68D4Xqc343Me54zgS56gVVwnhXlXCEytfKEC4LeUhfWjiPJdGKkZi4#digraph%20G%20%7B%0A%0A%20%20start%20-%3E%20a0%3B%0A%20%20start%20-%3E%20b0%3B%0A%20%20a1%20-%3E%20b3%3B%0A%20%20b2%20-%3E%20a3%3B%0A%20%20a3%20-%3E%20a0%3B%0A%20%20a3%20-%3E%20end%3B%0A%20%20b3%20-%3E%20end%3B%0A%0A%20%20start%20%5Bshape%3DMdiamond%5D%3B%0A%20%20end%20%5Bshape%3DMsquare%5D%3B%0A%7D

https://zapier.com/home

https://youtu.be/y0v2clCVw9k

From the moment it is working. Could be cleaner or fancier. But good.