adynathos / augmentedunreality Goto Github PK

Ｉdownload the OpenCV from opencv.org and its version is 2.4.13. When I installed it I can not find the OpencvWrapper.h. Why ?

Hi, thank you for making this code available. I am putting together a similar, but much simpler, plugin that spawns cubes in the viewport from static aruco marker positions. My issue is, I cannot get the coordinate spaces to line up properly. I have tried swapping and negating axes, and just cant get it right. If you have a moment, could you please run me through how you solved this problem? Do you use the rVecs and tVecs returned from markerdetect? Or do you start with the matrix?

Is this:

const FTransform FAURArucoTracker::CameraAdditionalRotation = FTransform(FQuat(FVector(0, 1, 0), -M_PI / 2), FVector(0, 0, 0), FVector(1, 1, 1));

the only transformation that I should need?

Thank you!

Hello
Im' trying to compile the plugin for EU4.21 and it failed.
Do you have any build for ue4.21 ?
Thanks a lot for your work !! :)

not able to get video sources for the build generated with target SDK android - 26. When I open the app it shows the white overlay. Can someone help me to fix this?

`
Fatal error: [File:D:\Build++UE4+Release-4.18+Compile\Sync\Engine\Source\Runtime\Core\Private\GenericPlatform\GenericPlatformMemory.cpp] [Line: 183] Ran out of memory allocating 21873295360 bytes with alignment 0

KERNELBASE
UE4Editor_ApplicationCore
UE4Editor_Core
UE4Editor_AugmentedUnreality!TArray<TScriptDelegate,TInlineAllocator<4,FDefaultAllocator> >::ResizeForCopy() [d:\program files\epic games\ue_4.18\engine\source\runtime\core\public\containers\array.h:2276]
UE4Editor_AugmentedUnreality!TMulticastScriptDelegate::ProcessMulticastDelegate() [d:\program files\epic games\ue_4.18\engine\source\runtime\core\public\uobject\scriptdelegates.h:457]
UE4Editor_AugmentedUnreality!UE4Function_Private::TFunctionRefCaller<<lambda_fc10205e902d606e267dd2e3de1eb022>,void __cdecl(void)>::Call() [d:\program files\epic games\ue_4.18\engine\source\runtime\core\public\templates\function.h:245]
`

Error after launching Example project with plugin 1.2.03.

This error came when Launched project in Editor , No error with standalone Launch

ok.. so I followed some fixes mentioned earlier, but Im stuck at this error, and cant seems to find these files:

clang++.exe: error: no such file or directory:...AugmentedUnrealityEx/Plugins/AugmentedUnreality/ThirdParty/opencv/install/Android/sdk/native/libs/armeabi-v7a/libopencv_augmented_unreality.a'
UATHelper: Packaging (Android (ASTC)): clang++.exe: error: no such file or directory:
clang++.exe: error: no such file or directory:'...AugmentedUnrealityEx/Plugins/AugmentedUnreality/ThirdParty/opencv/install/Android/sdk/native/libs/armeabi-v7a/libopencv_aruco.a'
UATHelper: Packaging (Android (ASTC)): ERROR: UBT ERROR: Failed to produce item: ....AugmentedUnrealityEx\Binaries\Android\AugmentedUnrealityEx-armv7-es2.so

Would really appreciate if anybody can help...

Is their any support for Unreal Engine 4.16?
Also, I was using Unreal4AR but since it's paid I can't deploy to android & test my application. Can I develop an AR application with this plugin and deploy on my android phone?

When I try to use this plugin in a larger project (which contains additional plugins and works without this plugin) I'm getting the below error. Your example project does work however with the same engine build and on the same device. Any ideas? The same error occurs with both versions of your plugin.

Thanks!

02-12 14:35:13.744 5290 5290 E AndroidRuntime: java.lang.UnsatisfiedLinkError: dlopen failed: cannot locate symbol "_ZSt24__throw_out_of_range_fmtPKcz" referenced by "/data/app/com.d6.D6UI_000-1/lib/arm/libUE4.so"...
02-12 14:35:13.744 5290 5290 E AndroidRuntime: at java.lang.Runtime.loadLibrary0(Runtime.java:977)
02-12 14:35:13.744 5290 5290 E AndroidRuntime: at java.lang.System.loadLibrary(System.java:1567)
02-12 14:35:13.744 5290 5290 E AndroidRuntime: at com.epicgames.ue4.GameActivity.(GameActivity.java:4189)

Hi adynathos,

Your Plugin is awesome !
Will you be able to create a version supporting UE 4.20 ?

Hello,

Thank you very much for the plugin, I am able to load the example projects and it works well.

The next I wanted to do was create a new C++ class "Trackable Object" that already comes with the proper mesh and tracking target. I want to do this so I can generate the objects on the fly later.

What is the proper method to add the AURTrackingComponent to a C++ class?

CreateDefaultSubobject gives me a linker error. I've tried a few other things to no avail.

Is it possible to do this and what's the best way?

Thank you

Hi,

I'm looking at adding an NDI(https://www.newtek.com/ndi/) video source to your plugin. I would love to hear your input about what's the best way to go about it i.e. what methods to override and how to make sure I don't break your code.

Thanks!

Hi adynathos,

i am trying to hide the blueprints when ever the tracker is not finding in viewport.. is there any method to check the whether the blueprint is tracking state / idle state?

• Windows 10 x64
• Unreal Engine 4.20.2 MSVC 2017
• Android NDK & SDK 22
• 1.2.05 example project

Testing under Windows works fine but when I try to export the project for android it crashes:
I tried with a empty UE project to verify that US Android is properly configured and it worked without errors.

UATHelper: Packaging (Android (ATC)):   Libraries - dynamic:
UATHelper: Packaging (Android (ATC)):   Android modification: E:\Projects\UnrealEngine\AugmentedUnrealityEx\Plugins\AugmentedUnreality\Source\AugmentedUnreality\AugmentedUnrealityAndroid_UPL.xml
UATHelper: Packaging (Android (ATC)):   Compiling Native code with NDK API 'android-22'
UATHelper: Packaging (Android (ATC)):   Building 3 actions with 16 processes...
UATHelper: Packaging (Android (ATC)):     [1/3] Module.AugmentedUnreality.cpp [armv7-es2]
UATHelper: Packaging (Android (ATC)):     error: exception handling was disabled in PCH file but is currently enabled
UATHelper: Packaging (Android (ATC)):     1 error generated.
UATHelper: Packaging (Android (ATC)):     [2/3] Module.AugmentedUnreality.gen.cpp [armv7-es2]
UATHelper: Packaging (Android (ATC)):     error: exception handling was disabled in PCH file but is currently enabled
UATHelper: Packaging (Android (ATC)):     1 error generated.
UATHelper: Packaging (Android (ATC)):   ERROR: UBT ERROR: Failed to produce item: E:\Projects\UnrealEngine\AugmentedUnrealityEx\Binaries\Android\AugmentedUnrealityEx-armv7-es2.so
UATHelper: Packaging (Android (ATC)):          (see C:\Users\Eli\AppData\Roaming\Unreal Engine\AutomationTool\Logs\E+Apps+Unreal+Engine+UE_4.20\UBT-AugmentedUnrealityEx-Android-Development_2.txt for full exception trace)
PackagingResults: Error: exception handling was disabled in PCH file but is currently enabled
PackagingResults: Error: exception handling was disabled in PCH file but is currently enabled
PackagingResults: Error: UBT ERROR: Failed to produce item: E:\Projects\UnrealEngine\AugmentedUnrealityEx\Binaries\Android\AugmentedUnrealityEx-armv7-es2.so
UATHelper: Packaging (Android (ATC)):   Total build time: 3,12 seconds (Parallel executor: 0,00 seconds)
UATHelper: Packaging (Android (ATC)): Took 3,4121057s to run UnrealBuildTool.exe, ExitCode=5
UATHelper: Packaging (Android (ATC)): ERROR: UnrealBuildTool failed. See log for more details. (C:\Users\Eli\AppData\Roaming\Unreal Engine\AutomationTool\Logs\E+Apps+Unreal+Engine+UE_4.20\UBT-AugmentedUnrealityEx-Android-Development_2.txt)
UATHelper: Packaging (Android (ATC)):        (see C:\Users\Eli\AppData\Roaming\Unreal Engine\AutomationTool\Logs\E+Apps+Unreal+Engine+UE_4.20\Log.txt for full exception trace)
PackagingResults: Error: UnrealBuildTool failed. See log for more details. (C:\Users\Eli\AppData\Roaming\Unreal Engine\AutomationTool\Logs\E+Apps+Unreal+Engine+UE_4.20\UBT-AugmentedUnrealityEx-Android-Development_2.txt)
UATHelper: Packaging (Android (ATC)): AutomationTool exiting with ExitCode=5 (5)
UATHelper: Packaging (Android (ATC)): BUILD FAILED
PackagingResults: Error: Unknown Error

We are working on Aruco marker detection with opencv like you did (by implementing the detection and tracking part inside a custom opencv contrib module). unfortunately we are facing continuous crashing when using our code within unreal. It seems like the problem is due to garbage collection and/or memory allocation not working correctly between unreal and opencv's dlls. we found your plugin and it is working.
Could you please give us some information about how you handled this kind of issues ?

for example in your code you mention "crashing memory deallocator" :

Thank you!

Hello @adynathos @SanchezSobrino @gordeevbr !

I am working on an university project and need your help. I am trying to package the project for Linux using the AugmentedUnrealityEx_for425. I can successfully build, run and package for Windows but could not achieve for Linux.

Could you please help me with this or Share your project so that I can run and verify?

The errors are the following:

PackagingResults: Error: linker command failed with exit code 1 (use -v to see invocation) PackagingResults: Error: undefined symbol: cv::error(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, char const*, char const*, int) PackagingResults: Error: undefined symbol: cv::FileStorage::FileStorage(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) PackagingResults: Error: undefined symbol: cv::operator<<(cv::FileStorage&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) PackagingResults: Error: undefined symbol: cv::internal::WriteStructContext::WriteStructContext(cv::FileStorage&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) PackagingResults: Error: undefined symbol: cv::write(cv::FileStorage&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, cv::Mat const&) PackagingResults: Error: undefined symbol: cv::FileStorage::releaseAndGetString() PackagingResults: Error: undefined symbol: cv::aur::setLogCallback(std::__1::function<void (cv::aur::LogLevel, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >)>) PackagingResults: Error: undefined symbol: cv::imwrite(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, cv::_InputArray const&, std::__1::vector<int, std::__1::allocator<int> > const&) PackagingResults: Error: undefined symbol: cv::putText(cv::_InputOutputArray const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, cv::Point_<int>, int, double, cv::Scalar_<double>, int, int, bool) PackagingResults: Error: undefined symbol: cv::VideoCapture::open(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) PackagingResults: Error: undefined symbol: cv::FileNodeIterator::readRaw(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, void*, unsigned long) PackagingResults: Error: undefined symbol: cv::FileStorage::writeRaw(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, void const*, unsigned long)

Hi, first thank you for providing this amazing plugin.

I am new to unreal engine and not very familiar with the lib you used. I am wandering can I directly launch your example project to a supported android phone? I have tried this, by I got launch failed error. Do you have any suggestions?

Thank you very much.

I wanna thank you for such a great plugin and project, I downloaded the example and it worked properly with me, but when i try to add the plugin to another project i get this message

When trying to run the game on Android, the plugin won't work because of an invalid root. I'm using Android 6.0 and I've tried both the example project as my own custom project. I've included the full output log.
WWAR.log

Hi!

First, I'd like to say that this is not an issue, it's more a question.

I see in this plugin and in many other tutorials that is easy to convert a stream from the camera to Unreal using OpenCV.

But I've never seen the opposite, how to convert an image from the Unreal Scene (FTextureRenderTargetResource, UTextureRenderTarget2D, UTexture2D, USceneCaptureComponent2D) to OpenCV (cv::Mat).

Do you know how we could do this?

Hi, would you please fix compilation for 4.23?
Thanks!

Thank you for sharing the pretty powerful plugin. And everything goes well except using the gstreamer to streaming the video. And I use raspberry pi to hold the rtp host. If I just launch gstreamer by using cmd in my pc, I can get the realtime video from raspberry pi. But when I use your plugin in ue4 to display the video from raspberry pi, the ue4 crash after several seconds. I hope you can give me some resolutions to fix the problem. Also, I can't package my project using your plugin by using ue4.15.1. Thank you again!

Hi Adynathos,

Im using 4.19, when im opening the Example project it is saying this error, pls help me out.

AugmentedUnrealityEx could not be compiled. Try rebuilding from source manually

Hi,
I am using Unreal Engine 4.21 in the Ubuntu environment.
I tried to directly open your sample project, but it failed to compile C++ source code because of the following linking errors.

/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_core
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_augmented_unreality
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_aruco
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_calib3d
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_features2d
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_flann
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_imgcodecs
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_imgproc
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_video
/home/jinhan/Desktop/UnrealEngine-release/Engine/Extras/ThirdPartyNotUE/SDKs/HostLinux/Linux_x64/v12_clang-6.0.1-centos7/x86_64-unknown-linux-gnu/bin/x86_64-unknown-linux-gnu-ld: cannot find -lopencv_videoio

I suspect that I need to build Unreal Engine again with special opencv for Android sdk.
I just wondered if you have similar experience building opencv for special Android sdk in Linux environment? I have opencv 3.4 already installed. But I don't know how to compile it with Unreal Engine.

Hello,

I can't compile on any Android SDK greater than SDK-22, if i do the camera doesn't work.

My device is a samsung galaxy s8 using android v8.0.0 (oreo), so i would like to compile using SDK: Android-26 but the camera is connected if i do.

Any advice?

Hello.

I'm compiling your plugin with OpenCV as you have suggested in Readme on Ubuntu and running into the following errors:

In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/src/FiducialTracker.cpp:17: In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/include/opencv2/augmented_unreality.hpp:19: /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/include/opencv2/augmented_unreality/FiducialPattern.hpp:41:10: error: no viable conversion from returned value of type 'cv::aruco::Dictionary' to function return type 'cv::Ptr<cv::aruco::Dictionary>' return board->dictionary; ^~~~~~~~~~~~~~~~~ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/cvstd.hpp:331:5: note: candidate constructor not viable: no known conversion from 'cv::aruco::Dictionary' to 'const cv::Ptr<cv::aruco::Dictionary> &' for 1st argument Ptr(const Ptr& o); ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/cvstd.hpp:415:5: note: candidate constructor not viable: no known conversion from 'cv::aruco::Dictionary' to 'cv::Ptr<cv::aruco::Dictionary> &&' for 1st argument Ptr(Ptr&& o); ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/cvstd.hpp:337:5: note: candidate template ignored: could not match 'Ptr<type-parameter-0-0>' against 'cv::aruco::Dictionary' Ptr(const Ptr<Y>& o); ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/src/FiducialTracker.cpp:26:20: error: no member named 'create' in 'cv::aruco::DetectorParameters'; did you mean 'StereoBM::create'? : arucoParameters(cv::aruco::DetectorParameters::create()) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ StereoBM::create /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/calib3d/include/opencv2/calib3d.hpp:1658:34: note: 'StereoBM::create' declared here CV_WRAP static Ptr<StereoBM> create(int numDisparities = 0, int blockSize = 21); ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/src/FiducialTracker.cpp:134:39: error: no viable conversion from 'cv::Ptr<cv::aruco::Dictionary>' to 'cv::aruco::Dictionary' cv::aruco::detectMarkers(imageGrey, markerDictionary, out_corners, out_ids, arucoParameters); ^~~~~~~~~~~~~~~~ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/aruco/include/opencv2/aruco/dictionary.hpp:61:18: note: candidate constructor (the implicit move constructor) not viable: no known conversion from 'cv::Ptr<cv::aruco::Dictionary>' to 'cv::aruco::Dictionary &&' for 1st argument class CV_EXPORTS Dictionary { ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/aruco/include/opencv2/aruco/dictionary.hpp:61:18: note: candidate constructor (the implicit copy constructor) not viable: no known conversion from 'cv::Ptr<cv::aruco::Dictionary>' to 'const cv::aruco::Dictionary &' for 1st argument /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/aruco/include/opencv2/aruco/dictionary.hpp:71:5: note: candidate constructor not viable: no known conversion from 'cv::Ptr<cv::aruco::Dictionary>' to 'const cv::Mat &' for 1st argument Dictionary(const Mat &_bytesList = Mat(), int _markerSize = 0, int _maxcorr = 0); ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/cvstd.hpp:395:5: note: candidate function operator T* () const; ^ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/aruco/include/opencv2/aruco.hpp:174:60: note: passing argument to parameter 'dictionary' here CV_EXPORTS void detectMarkers(InputArray image, Dictionary dictionary, OutputArrayOfArrays corners, ^ In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/src/FiducialTracker.cpp:17: In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/include/opencv2/augmented_unreality.hpp:18: In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/include/opencv2/augmented_unreality/log.hpp:24: In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core.hpp:54: In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/base.hpp:56: In file included from /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/cvstd.hpp:1067: /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv/modules/core/include/opencv2/core/ptr.inl.hpp:141:48: error: cannot initialize a member subobject of type 'cv::aruco::DetectorParameters *' with an lvalue of type 'cv::StereoBM *const' Ptr<T>::Ptr(const Ptr<Y>& o) : owner(o.owner), stored(o.stored) ^ ~~~~~~~~ /home/gordeevbr/Projects/TestProject/Plugins/AugmentedUnreality/ThirdParty/opencv/src/opencv_contrib/modules/augmented_unreality/src/FiducialTracker.cpp:26:4: note: in instantiation of function template specialization 'cv::Ptr<cv::aruco::DetectorParameters>::Ptr<cv::StereoBM>' requested here : arucoParameters(cv::aruco::DetectorParameters::create()) ^ 4 errors generated. modules/augmented_unreality/CMakeFiles/opencv_augmented_unreality.dir/build.make:62: recipe for target 'modules/augmented_unreality/CMakeFiles/opencv_augmented_unreality.dir/src/FiducialTracker.cpp.o' failed make[2]: *** [modules/augmented_unreality/CMakeFiles/opencv_augmented_unreality.dir/src/FiducialTracker.cpp.o] Error 1 CMakeFiles/Makefile2:2656: recipe for target 'modules/augmented_unreality/CMakeFiles/opencv_augmented_unreality.dir/all' failed make[1]: *** [modules/augmented_unreality/CMakeFiles/opencv_augmented_unreality.dir/all] Error 2 Makefile:160: recipe for target 'all' failed make: *** [all] Error 2

It seems to me that some conversions are failing.
The Ubuntu is a fresh install of the latest LTS version and so are all the packages and tools.
I'm trying some manual fixes right now. Are there any known workarounds?
Is this a mistake on my side or are there any incompatibilities for this project now?

Could you please provide inputs to build the plugin ?

I didn't find any information on the build process in the repository.

Thanks

FTexture2DResource is not defined when building manually from VS 2017,i know i am missing something but what.I have never worked with C++
Any help.

Hi,
I'm trying to run the example project (v 1.2.03) on an android device.
When launching the app it gave me this error:

impossible to find path "... \Plugins\AugmentedUnreality\ThirdParty\opencv\install\Android\sdk\native\3rdparty\libs\armeabi-v7a'."

so I downloaded the OpenCV Android SDK from https://github.com/opencv/opencv/releases/tag/3.2.0 and I put the sdk folder into "... \Plugins\AugmentedUnreality\ThirdParty\opencv\install\Android"

Now, when building it gave me this error:

fatal error: '../../../Core/Public/Android/AndroidApplication.h' file not found

So, as suggested in this thread (#11) I changed Core to ApplicationCore (line 21 of AURVideoSourceAndroidCamera.cpp)

Compilation was ok this time, but building the project failed again:

no such file or directory: '... /AugmentedUnreality/ThirdParty/opencv/install/Android/sdk/native/libs/armeabi-v7a/libopencv_augmented_unreality.a'

no such file or directory: ... /Plugins/AugmentedUnreality/ThirdParty/opencv/install/Android/sdk/native/libs/armeabi-v7a/libopencv_aruco.a'

So, I decided to try to rebuild OpenCV manually instead of using the downloaded SDK:
I deleted sdk from Install folder, downloaded opencv-3.2.0 and opencv_contrib-3.2.0, put the content inside ... Plugins\AugmentedUnreality\ThirdParty\opencv\src and then I run

python build.py build android --build_dir C:\AndroidOpenCV_Build

Pyton script fails with this error:

Task: build
- platform: android
- build directory: F:\TestBuild
- install directory: C:\...\Plugins\AugmentedUnreality\ThirdParty\opencv\install\Android
Running  CMake

Traceback (most recent call last):
  File "build.py", line 207, in <module>
    main()
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\site-packages\click\core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\site-packages\click\core.py", line 697, in main
    rv = self.invoke(ctx)
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\site-packages\click\core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\site-packages\click\core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\site-packages\click\core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "build.py", line 99, in build
    out_code = subprocess.call(cmd_cmake)
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "C:\...\AppData\Local\Programs\Python\Python36-32\lib\subprocess.py", line 997, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] The system cannot find the file specified

I don't know python and I have no idea of what is missing at this step.
Any hint?

Thanks

Is their any support for Unreal Engine 4.17?

I hope you can tell me. How can I do？

The example project file contains broken symlinks

I extracted the example project to

/home/mari/Dokumente/Unreal Projects

but it contains broken files, e. g.

/home/mari/Dokumente/Unreal Projects/AugmentedUnrealityEx/Plugins/AugmentedUnreality/Binaries/Linux/libopencv_core.so

is a binary file with the content

00000000  21 3C 73 79  6D 6C 69 6E   6B 3E FF FE  2F 00 6D 00  !<symlink>../.m.
00000010  65 00 64 00  69 00 61 00   2F 00 61 00  64 00 79 00  e.d.i.a./.a.d.y.
00000020  6E 00 61 00  74 00 68 00   6F 00 73 00  2F 00 64 00  n.a.t.h.o.s./.d.
00000030  61 00 74 00  61 00 2D 00   6E 00 74 00  66 00 73 00  a.t.a.-.n.t.f.s.
00000040  2F 00 75 00  6E 00 72 00   65 00 61 00  6C 00 5F 00  /.u.n.r.e.a.l._.
00000050  70 00 72 00  6F 00 6A 00   65 00 63 00  74 00 73 00  p.r.o.j.e.c.t.s.
00000060  2F 00 41 00  75 00 67 00   6D 00 65 00  6E 00 74 00  /.A.u.g.m.e.n.t.
00000070  65 00 64 00  55 00 6E 00   72 00 65 00  61 00 6C 00  e.d.U.n.r.e.a.l.
00000080  69 00 74 00  79 00 45 00   78 00 2F 00  50 00 6C 00  i.t.y.E.x./.P.l.
00000090  75 00 67 00  69 00 6E 00   73 00 2F 00  41 00 75 00  u.g.i.n.s./.A.u.
000000A0  67 00 6D 00  65 00 6E 00   74 00 65 00  64 00 55 00  g.m.e.n.t.e.d.U.
000000B0  6E 00 72 00  65 00 61 00   6C 00 69 00  74 00 79 00  n.r.e.a.l.i.t.y.
000000C0  2F 00 54 00  68 00 69 00   72 00 64 00  50 00 61 00  /.T.h.i.r.d.P.a.
000000D0  72 00 74 00  79 00 2F 00   6F 00 70 00  65 00 6E 00  r.t.y./.o.p.e.n.
000000E0  63 00 76 00  2F 00 2E 00   2E 00 2F 00  2E 00 2E 00  c.v./...../.....
000000F0  2F 00 42 00  69 00 6E 00   61 00 72 00  69 00 65 00  /.B.i.n.a.r.i.e.
00000100  73 00 2F 00  4C 00 69 00   6E 00 75 00  78 00 2F 00  s./.L.i.n.u.x./.
00000110  6C 00 69 00  62 00 6F 00   70 00 65 00  6E 00 63 00  l.i.b.o.p.e.n.c.
00000120  76 00 5F 00  63 00 6F 00   72 00 65 00  2E 00 73 00  v._.c.o.r.e...s.
00000130  6F 00 2E 00  33 00 2E 00   32 00 00 00               o...3...2...

Somehow, the packaging process went wrong as this is not a symlink.

Hi Adynathos,
First of all I wanted to thank you for this wonderful work of yours.

I need just some help to compiling libs for arm64-v8a architecture, I tried by myself but failed.
I went through the opencv repository also, I could compile opencv libs but couldn't compile the aruco module as it's not available in opencv.

Could you please tell the exact version of openCV you are using, so that I can add the openCV libs for arm64-v8a platform.

I know this is not an issue, but there is no other way to contact you and get help from you.
Thanking you in anticipation.

Regards.

Is this plugin supported unreal 4.25?

Hi, thanks for making this code available. I have loaded the example project, and printed the markers. I see the cube and candle overlaid in the game, but I do not see the shadows. Do I need to enable them somehow? Thanks again.

Love the plugin!
It's working perfectly with 4.16 using my webcam using the most recent update, thanks very much for putting this out there for us to use.

I'm having a small problem when trying to use the example video files in the example project.

When I click on the menu choice to select the aur_example.webm file, I get the log error below saying that it can't open the video file.
I did notice that the file in that directory had an extra period in it (aur._example.webm) which I fixed, but that didn't solve the issue.

I've got gstreamer installed, I'm able to view the webm file, I made sure gstreamer was in my path and I checked permissions on the video file path since I wasn't sure what else to look at.
Gstreamer installed automatically to my D: drive and my Unreal project folders are also on the D: drive, in case that matters. Unreal Engine itself is installed in C:\Program Files.
If I change the name of the video files, I get a warning about them not being present instead of the failure to open error.

Here is the error from the log:
LogAUR:Error: UAURVideoSourceVideoFile::Connect: Failed to open video file D:/Collateral/UnrealProjects/AugmentedUnrealityEx/Content/AugmentedUnrealityVideos/aur_example.webm

Hoping you can help point me in the right direction, figure I must be doing something wrong but not sure where to start looking.
Thanks in advance!

Attached please find the entire output log from the latest runtime.
UnrealOutputLog-AugmentedUnreality_1.2.02run.txt

UE4.19 tested both on android and also occuring with PIE.

Editor crashes when game is stopped with PIE maybe 1/3 times.
On Android app crashes when minimzed.

This project didn't work on 4.17 or 4.18. Is there a way to make it run?.. Thanks for the amazing project!!