nvidia-ai-iot / deepstream-occupancy-analytics Goto Github PK

Hello. I have been trying for a long time to get past this error but can't make it work. I have tried updating the path and much more. But nothing seems to get it to understand where to find the cuda_runtime_api.h. Eventhough I know it's present where it should be.

cc -c -o ../../apps-common/src/deepstream_source_bin.o  -DPLATFORM_TEGRA -I../../apps-common/includes -I./includes -I../../../includes -I../deepstream-app/ -DDS_VERSION_MINOR=0 -DDS_VERSION_MAJOR=5 -I../deepstream-test5 `pkg-config --cflags gstreamer-1.0 gstreamer-video-1.0 x11 json-glib-1.0` ../../apps-common/src/deepstream_source_bin.c
../../apps-common/src/deepstream_source_bin.c:32:10: fatal error: cuda_runtime_api.h: No such file or directory
 #include <cuda_runtime_api.h>
          ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
Makefile:66: recipe for target '../../apps-common/src/deepstream_source_bin.o' failed
make: *** [../../apps-common/src/deepstream_source_bin.o] Error 1

I was able to get this project working using the aws_protocol_adapter but since it's MQTT going to a cloud server with quotas, I reduced the message frequency by only sending when the entry/exit has changed. However, this becomes a problem when there is no activity for a while, because the connection becomes stale and starts erring out silently (i.e. says it publishes successfully, but not in actuality.) I think the problem lies in how the adapter is being used in the background. AWS claims that their IOT sdk handles keepalive pingreq's as part of the MQTT protocol, and if the right functions are called at the required rate, it does send ping requests. Now, my question, is there any way to get the deepstream pipeline to call the aws_iot_sdk's "do_work" function when idling so that it can do all of it's handling of pingreqs and such without actually sending a payload?

**• Hardware Platform (Jetson / GPU): Jetson Nano
**• DeepStream Version: 6.0
When running: sudo apt-cache show nvidia-jetpack, I get the following message:

Package: nvidia-jetpack
Version: 4.5.1-b17
Architecture: arm64
Maintainer: NVIDIA Corporation
Installed-Size: 194
Depends: nvidia-cuda (= 4.5.1-b17), nvidia-opencv (= 4.5.1-b17), nvidia-cudnn8 (= 4.5.1-b17), nvidia-tensorrt (= 4.5.1-b17), nvidia-visionworks (= 4.5.1-b17), nvidia-container (= 4.5.1-b17), nvidia-vpi (= 4.5.1-b17), nvidia-l4t-jetson-multimedia-api (>> 32.5-0), nvidia-l4t-jetson-multimedia-api (<< 32.6-0)
Homepage: http://developer.nvidia.com/jetson
Priority: standard
Section: metapackages
Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_4.5.1-b17_arm64.deb
Size: 29390
SHA256: 13c10e9a53ec51c261ce188d626966dfca27f26b2ed94ba700147c1ba3e35399
SHA1: 81047a7779241bbf16763dbd1c4c12cf8c9d0496
MD5sum: 54916439514f39af5234b3a43e329910
Description: NVIDIA Jetpack Meta Package
Description-md5: ad1462289bdbc54909ae109d1d32c0a8

Package: nvidia-jetpack
Version: 4.5-b129
Architecture: arm64
Maintainer: NVIDIA Corporation
Installed-Size: 194
Depends: nvidia-cuda (= 4.5-b129), nvidia-opencv (= 4.5-b129), nvidia-cudnn8 (= 4.5-b129), nvidia-tensorrt (= 4.5-b129), nvidia-visionworks (= 4.5-b129), nvidia-container (= 4.5-b129), nvidia-vpi (= 4.5-b129), nvidia-l4t-jetson-multimedia-api (>> 32.5-0), nvidia-l4t-jetson-multimedia-api (<< 32.6-0)
Homepage: http://developer.nvidia.com/jetson
Priority: standard
Section: metapackages
Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_4.5-b129_arm64.deb
Size: 29358
SHA256: 9ee354a66d932a3fbb244c926f333143a845c627c6981d108e01df2958ac462c
SHA1: 0e07f27c6fb9e34a70c69ae1150d1e578e938089
MD5sum: a551bbc8ff653c8983ce1804082bbcab
Description: NVIDIA Jetpack Meta Package
Description-md5: ad1462289bdbc54909ae109d1d32c0a8

I have already made the deepstream-occupancy-analytics on deepstream 5.1 and it worked fine, I cloned the same application on a different jetson with deepstream 6.0, but I get the following error:

** ERROR: <create_osd_bin:58>: Failed to create ‘nvosd0’
** ERROR: <create_osd_bin:100>: create_osd_bin failed
** ERROR: <create_processing_instance:815>: create_processing_instance failed
** ERROR: <create_pipeline:1323>: create_pipeline failed
** ERROR: main:1041: Failed to create pipeline
Quitting
App run failed

Any idea what this issue is referring to?

Thanks

Hi,

I set up this demo on the Nvidia DeepStream docker image and got incorrect Kafka output.

Output:

The result video file seems good, all cross-lines are good, but there is no analyticsModule.occupancy, analyticsModule.Entry and analyticsModule.Exitin Kafka message.

{
  "messageid" : "87854ed3-aec2-4046-ad5f-2cfb67c73bca",
  "mdsversion" : "1.0",
  "@timestamp" : "2022-01-19T09:20:34.438Z",
  "place" : {
    "id" : "0",
    "name" : "HWY_20_AND_LOCUST__EBA",
    "type" : "intersection/road",
    "location" : {
      "lat" : 30.32,
      "lon" : -40.549999999999997,
      "alt" : 100.0
    },
    "entrance" : {
      "name" : "C_127_158",
      "lane" : "Lane 1",
      "level" : "P1",
      "coordinate" : {
        "x" : 1.0,
        "y" : 2.0,
        "z" : 3.0
      }
    }
  },
  "sensor" : {
    "id" : "HWY_20_AND_LOCUST__EBA__4_11_2018_4_59_59_508_AM_UTC-07_00",
    "type" : "Camera",
    "description" : "Aisle Camera",
    "location" : {
      "lat" : 45.293701446999997,
      "lon" : -75.830391449900006,
      "alt" : 48.155747933800001
    },
    "coordinate" : {
      "x" : 5.2000000000000002,
      "y" : 10.1,
      "z" : 11.199999999999999
    }
  },
  "analyticsModule" : {
    "id" : "XYZ",
    "description" : "",
    "source" : "OpenALR",
    "version" : "1.0"
  },
  "object" : {
    "id" : "0",
    "speed" : 0.0,
    "direction" : 0.0,
    "orientation" : 0.0,
    "person" : {
      "age" : 0,
      "gender" : "",
      "hair" : "",
      "cap" : "",
      "apparel" : "",
      "confidence" : 1.0
    },
    "bbox" : {
      "topleftx" : 0,
      "toplefty" : 0,
      "bottomrightx" : 0,
      "bottomrighty" : 0
    },
    "location" : {
      "lat" : 0.0,
      "lon" : 0.0,
      "alt" : 0.0
    },
    "coordinate" : {
      "x" : 0.0,
      "y" : 0.0,
      "z" : 0.0
    }
  },
  "event" : {
    "id" : "84c7ed09-a0e4-4a0e-8c46-41c320faf8ac",
    "type" : "entry"
  },
  "videoPath" : ""
}

Log Output:

root@0980fa10c7ef:/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics# ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt

(deepstream-test5-analytics:12): GLib-CRITICAL **: 10:07:58.602: g_strchug: assertion 'string != NULL' failed

(deepstream-test5-analytics:12): GLib-CRITICAL **: 10:07:58.602: g_strchomp: assertion 'string != NULL' failed
** WARN: <create_pipeline:1141>: Num of Tiles less than number of sources, readjusting to 2 rows, 1 columns
Warning: 'input-dims' parameter has been deprecated. Use 'infer-dims' instead.
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-5.1/lib/libnvds_nvdcf.so
gstnvtracker: Batch processing is OFF
gstnvtracker: Past frame output is OFF
0:00:01.980342116    12 0x5594fd44f360 INFO                 nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1702> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:685 [Implicit Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1         3x544x960
1   OUTPUT kFLOAT output_bbox/BiasAdd 12x34x60
2   OUTPUT kFLOAT output_cov/Sigmoid 3x34x60

0:00:01.980472313    12 0x5594fd44f360 INFO                 nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1806> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine
0:00:01.983028354    12 0x5594fd44f360 INFO                 nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics/config/config_infer_primary_peoplenet.txt sucessfully

Runtime commands:
	h: Print this help
	q: Quit

	p: Pause
	r: Resume

NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
      To go back to the tiled display, right-click anywhere on the window.

** INFO: <bus_callback:181>: Pipeline ready

** INFO: <bus_callback:167>: Pipeline running

~~ CLOG[src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 670]: !!![WARNING] Can't open config file (/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics/config/tracker_config.yml). Will go ahead with default values
~~ CLOG[src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 682]: !!![WARNING] Invalid low-level config file is provided. Will go ahead with default values
[NvDCF] Initialized
WARNING; playback mode used with URI [file:///opt/nvidia/deepstream/deepstream-5.1/samples/streams/sample_1080p_h264.mp4] not conforming to timestamp format; check README; using system-time
~~ CLOG[src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 670]: !!![WARNING] Can't open config file (/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics/config/tracker_config.yml). Will go ahead with default values
~~ CLOG[src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 682]: !!![WARNING] Invalid low-level config file is provided. Will go ahead with default values
[NvDCF] Initialized
WARNING; playback mode used with URI [file:///opt/nvidia/deepstream/deepstream-5.1/samples/streams/sample_1080p_h264.mp4] not conforming to timestamp format; check README; using system-time

**PERF:  FPS 0 (Avg)	FPS 1 (Avg)
Wed Jan 19 10:08:03 2022
**PERF:  21.16 (20.74)	20.74 (20.60)
q
Quitting
[NvDCF] De-initialized
[NvDCF] De-initialized
App run successful

Run environments:

Docker image: nvcr.io/nvidia/deepstream:5.1-21.02-devel
Config files: commit link(I just change some configurations for my server without display)

I get this error while executing "bin/jetson/libnvds_msgconv.so"

bash: libnvds_msgconv.so: command not found

Using Deepstream 5.1 Cuda 10.2 on Jetson AGX Xavier

0:00:01.525767765 36914 0x562652e6b830 WARN nvmsgbroker gstnvmsgbroker.c:388:legacy_gst_nvmsgbroker_start:<sink_sub_bin_sink2> error: unable to connect to broker library
0:00:01.525824579 36914 0x562652e6b830 WARN basesink gstbasesink.c:5265:gst_base_sink_change_state:<sink_sub_bin_sink2> error: Failed to start
** ERROR: main:655: Failed to set pipeline to PAUSED
Quitting
ERROR from sink_sub_bin_sink2: Could not configure supporting library.
Debug info: gstnvmsgbroker.c(388): legacy_gst_nvmsgbroker_start (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
unable to connect to broker library
ERROR from sink_sub_bin_sink2: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Debug info: gstbasesink.c(5265): gst_base_sink_change_state (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
Failed to start
App run failed

I want to add the overcrowding plugin also to this app and send the data using kafka so where should I make the alterations. Thanks in advance !

When I try to execute ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt the program execution responds with this error:

(deepstream-test5-analytics:11692): GLib-GObject-CRITICAL **: 00:08:55.861: g_object_set: assertion 'G_IS_OBJECT (object)' failed
(deepstream-test5-analytics:11692): GLib-GObject-CRITICAL **: 00:08:55.861: g_object_set: assertion 'G_IS_OBJECT (object)' failed
** ERROR: <create_render_bin:99>: Failed to create 'sink_sub_bin_sink1'
** ERROR: <create_render_bin:176>: create_render_bin failed
** ERROR: <create_sink_bin:776>: create_sink_bin failed
** ERROR: <create_processing_instance:802>: create_processing_instance failed
** ERROR: <create_pipeline:1294>: create_pipeline failed
** ERROR: main:1041: Failed to create pipeline
Quitting
App run failed

Please help me find a solution:
I'm working on a Jetso Nano Developer Kit, and this is the environment:

deepstream-app version 5.1.0
DeepStreamSDK 5.1.0
CUDA Driver Version: 10.2
CUDA Runtime Version: 10.2
TensorRT Version: 7.1
cuDNN Version: 8.0
libNVWarp360 Version: 2.0.1d3

BTW, this same error happens when I try to run any of the samples that came with Deepstream SDK, on folder: samples/configs/deepstream-apps/*

jetpack4.5.1
deepstream5.1

(deepstream-test5-analytics:12296): GLib-CRITICAL **: 10:35:04.686: g_strchug: assertion 'string != NULL' failed

(deepstream-test5-analytics:12296): GLib-CRITICAL **: 10:35:04.687: g_strchomp: assertion 'string != NULL' failed
** WARN: <create_pipeline:1141>: Num of Tiles less than number of sources, readjusting to 2 rows, 1 columns
Warning: 'input-dims' parameter has been deprecated. Use 'infer-dims' instead.
** ERROR: main:1088: Failed to set pipeline to PAUSED
Quitting
ERROR from sink_sub_bin_sink2: Could not configure supporting library.
Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(388): legacy_gst_nvmsgbroker_start (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
unable to connect to broker library
ERROR from sink_sub_bin_sink2: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Debug info: gstbasesink.c(5265): gst_base_sink_change_state (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
Failed to start
App run failed

Hello, when I run the program, the error is reported as follows, it seems that a certain library is not imported. Please help me. My configuration environment is: deepstream5.1
jetson nx
`mec@mec-desktop:/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-master$ ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt

(deepstream-test5-analytics:10968): GLib-CRITICAL **: 19:47:45.962: g_strchug: assertion 'string != NULL' failed

(deepstream-test5-analytics:10968): GLib-CRITICAL **: 19:47:45.963: g_strchomp: assertion 'string != NULL' failed
** WARN: <create_pipeline:1141>: Num of Tiles less than number of sources, readjusting to 2 rows, 1 columns
Warning: 'input-dims' parameter has been deprecated. Use 'infer-dims' instead.
** ERROR: main:1088: Failed to set pipeline to PAUSED
Quitting
ERROR from sink_sub_bin_sink2: Could not initialize supporting library.
Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
unable to open shared library
ERROR from sink_sub_bin_sink2: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Debug info: gstbasesink.c(5265): gst_base_sink_change_state (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
Failed to start
App run failed
`

I see that you have adapted it from deepstream-test5-app to implement the function of people flow statistics. Can you realize the statistics of traffic flow? Where to modify it?

Hi. I am currently using this application to detect and count people on Jetson Nano Development Kit using Deepstream-5.1 on Jetpack 4.5.1.
I would like to inquire if it is possible to get access of kafka log files with the messages that get displayed when we start the kafka event.

When the messages are displayed on the terminal, they are being displayed fast and at some point I can't see the older messages from when I first ran the application, so it would more helpful to find the messages in a log file.

When running the make command the following error is displayed and the process gets terminated. How could I proceed?

Hi,

I have installed DS6.0, kafka in dGPU and Jetson Xavier. Original DS6.0 deepstream-test5-app is running ok with Kafka enabled.
I have replaced libnvds_msgconv.so at /opt/nvidia/deepstream/deepstream-6.0/lib

When I run ds_6.0 branch:
/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-occupancy-analytics# ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt

It fails with the following errror message:

(deepstream-test5-analytics:374): GStreamer-WARNING **: 03:54:55.947: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_msgconv.so': ///opt/nvidia/deepstream/deepstream-6.0/lib/libnvds_msgconv.so: invalid ELF header
** ERROR: <create_msg_conv_broker_bin:234>: Failed to create 'sink_sub_bin_transform2'
** ERROR: <create_msg_conv_broker_bin:278>: create_msg_conv_broker_bin failed
** ERROR: <create_sink_bin:781>: create_sink_bin failed
** ERROR: <create_processing_instance:815>: create_processing_instance failed
** ERROR: <create_pipeline:1323>: create_pipeline failed
** ERROR: main:1041: Failed to create pipeline
Quitting
App run failed

Any help?
Thanks in advance

Hi, I don't think you provide the dstest5_msgconv_sample_config.txt file you used in the example as there is no such element as entry and exit when I run your example:
the file provided in the repo can't be the same as the one that creates the displayed logs in the gif ( no entry / exit and count such as those displayed in your example).
My logs look like the following:
"messageid" : "d61a8342-c60c-43d9-9fbb-c62b1fe2a749", "mdsversion" : "1.0", "@timestamp" : "1970-01-01T00:00:00.000Z", "place" : { "id" : "0", "name" : "HWY_20_AND_LOCUST__EBA", "type" : "intersection/road", "location" : { "lat" : 30.32, "lon" : -40.549999999999997, "alt" : 100.0 }, "entrance" : { "name" : "C_127_158", "lane" : "Lane 1", "level" : "P1", "coordinate" : { "x" : 1.0, "y" : 2.0, "z" : 3.0 } } }, "sensor" : { "id" : "HWY_20_AND_LOCUST__EBA__4_11_2018_4_59_59_508_AM_UTC-07_00", "type" : "Camera", "description" : "Aisle Camera", "location" : { "lat" : 45.293701446999997, "lon" : -75.830391449900006, "alt" : 48.155747933800001 }, "coordinate" : { "x" : 5.2000000000000002, "y" : 10.1, "z" : 11.199999999999999 } }, "analyticsModule" : { "id" : "XYZ", "description" : "", "source" : "OpenALR", "version" : "1.0" },

Can you give me a bit more insight on that difference if there are elements I didn't understand?
Thank you

When I try to execute ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt the program execution responds with this error:
(deepstream-test5-analytics:2427): GLib-CRITICAL **: 17:03:27.452: g_strchug: assertion 'string != NULL' failed

(deepstream-test5-analytics:2427): GLib-CRITICAL **: 17:03:27.452: g_strchomp: assertion 'string != NULL' failed
** WARN: <create_pipeline:1143>: Num of Tiles less than number of sources, readjusting to 2 rows, 1 columns
Warning: 'input-dims' parameter has been deprecated. Use 'infer-dims' instead.
** ERROR: main:1088: Failed to set pipeline to PAUSED
Quitting
ERROR from sink_sub_bin_sink2: Could not initialize supporting library.
Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
unable to open shared library
ERROR from sink_sub_bin_sink2: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Debug info: gstbasesink.c(5265): gst_base_sink_change_state (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
Failed to start
App run failed

This error is similar to the previous question,but I think it is different.Because when I try to run any of the samples that come with the Deepstream SDK in the following folder,it works and has outputs.
The following is my device information!
Hardware Platform(Jetson naano 4GB)
Deepstream Version(Deepstream5.0)
JetPack Version(JetPavk4.4)
So,could you help me.Thank you very much!

The following are the configurations used ;

[sink1]
enable=1
#Type - 1=FakeSink 2=EglSink 3=File 4=UDPSink 5=nvoverlaysink 6=MsgConvBroker
type=6
#sync=0
#qos=0
msg-conv-config=dstest5_msgconv_sample_config.txt
msg-conv-payload-type=0
msg-broker-proto-lib=libnvds_kafka_proto.so
msg-broker-conn-str=localhost;9092;ds_app
msg-broker-config=cfg_kafka.txt

inferencing is done to detect and count bottles on a conveyor. Inferncing and Analytics run very well. Runs continuously for for hours without the message broker. But, when the msgbroker is enabled , the system runs out of memory. (within 30mins). What can i do to sort this issue? Same issue happens for the Redis broker as well.

In the config file, I do have set: tlt-encoded-model=peoplenet/resnet18_peoplenet_pruned.etlt

config_infer_primary_peoplenet.txt:

[property]
gpu-id=0
net-scale-factor=0.0039215697906911373
tlt-model-key=tlt_encode
tlt-encoded-model=peoplenet/resnet18_peoplenet_pruned.etlt
labelfile-path=peoplenet/labels.txt
#model-engine-file=../models/resnet18_peoplenet_pruned.etlt_b4_gpu0_fp16.engine
int8-calib-file=peoplenet/resnet18_peoplenet_int8.txt
input-dims=3;544;960;0
uff-input-blob-name=input_1
batch-size=4
process-mode=2
model-color-format=0

0=FP32, 1=INT8, 2=FP16 mode

network-mode=1
num-detected-classes=3
cluster-mode=1
interval=0
gie-unique-id=1
output-blob-names=output_bbox/BiasAdd;output_cov/Sigmoid

[class-attrs-all]
pre-cluster-threshold=0.4

Set eps=0.7 and minBoxes for cluster-mode=1(DBSCAN)

eps=0.7
minBoxes=1

[class-attrs-1]
pre-cluster-threshold=1.4

Set eps=0.7 and minBoxes for cluster-mode=1(DBSCAN)

eps=0.7
minBoxes=1
[class-attrs-2]
pre-cluster-threshold=1.4

Set eps=0.7 and minBoxes for cluster-mode=1(DBSCAN)

eps=0.7
minBoxes=1

For Jetson use: bin/jetson/libnvds_msgconv.so
For x86 use: bin/x86/libnvds_msgconv.so
I am using a jetson nano

I’m using the occupancy analytics application. When I run the make command I get the following error:

deepstream_test5_app_main.c: In function ‘meta_copy_func’:
deepstream_test5_app_main.c:314:88: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘source_id’
g_print(" %s %d source id: %d, Enter: %d, Exit: %d\n",func,LINE, dstMeta->source_id, dstMeta->lccum_cnt_entry, dstMeta->lccum_cnt_exit);
^~
deepstream_test5_app_main.c:314:108: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘lccum_cnt_entry’
g_print(" %s %d source id: %d, Enter: %d, Exit: %d\n",func,LINE, dstMeta->source_id, dstMeta->lccum_cnt_entry, dstMeta->lccum_cnt_exit);
^~
deepstream_test5_app_main.c:314:134: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘lccum_cnt_exit’
g_print(" %s %d source id: %d, Enter: %d, Exit: %d\n",func,LINE, dstMeta->source_id, dstMeta->lccum_cnt_entry, dstMeta->lccum_cnt_exit);
^~
deepstream_test5_app_main.c: In function ‘generate_event_msg_meta’:
deepstream_test5_app_main.c:413:9: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘occupancy’
meta->occupancy = obj_params->lccum_cnt;
^~
deepstream_test5_app_main.c:414:9: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘lccum_cnt_entry’
meta->lccum_cnt_entry = obj_params->lcc_cnt_entry;
^~
deepstream_test5_app_main.c:415:9: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘lccum_cnt_exit’
meta->lccum_cnt_exit = obj_params->lcc_cnt_exit ;
^~
deepstream_test5_app_main.c:416:9: error: ‘NvDsEventMsgMeta {aka struct NvDsEventMsgMeta}’ has no member named ‘source_id’
meta->source_id = obj_params->source_id;
^~
Makefile:73: recipe for target ‘deepstream_test5_app_main.o’ failed

deepstream_test5_app_main.o: In function bbox_generated_probe_after_analytics': deepstream_test5_app_main.c:(.text+0xdd6): undefined reference to analytics_custom_parse_nvdsanalytics_meta_data'
collect2: error: ld returned 1 exit status
Makefile:74: recipe for target 'deepstream-test5-app' failed
make: *** [deepstream-test5-app] Error 1

I have edited the deepstream-test5 app according to you implementation but i am getting the above error. Can you help me understand why I am getting this error and how can I fix it?

I fixed mgsconv.txt

[analytics0]

enable=1
id=0
#description=Vehicle Detection and License Plate Recognition
source=rtsp0
version=1.0
[analytics1]
enable=1
id=1
#description=Vehicle Detection and License Plate Recognition 1
source=rtsp1
version=1.0

but kafka topic only show [analytics0]

"messageid" : "69995786-a460-4e56-afaa-f12d3dc29d2b",
"mdsversion" : "1.0",
"@timestamp" : "2021-06-30T07:34:07.107Z",
"analyticsModule" : {
"RF" : 1.0,
"Entry" : 0.0,
"Exit" : 0.0,
"id" : "0",
"description" : "",
"source" : "rtsp0",
"version" : "1.0",
"confidence" : 0.0

while osd still show both 2 analytics sources in screen

I modified my makefile according to the answer given here, to accommodate Deepstream 5.1:

https://forums.developer.nvidia.com/t/fatal-error-cuda-runtime-api-h-no-such-file-or-directory-when-compiling-with-jetpack-4-5-1/171218/8

However, now I'm getting another error:
deepstream_test5_app_main.c:41:10: fatal error: deepstream_app.h: No such file or directory
#include "deepstream_app.h"
^~~~~~~~~~~~~~~~~~
compilation terminated.
Makefile:69: recipe for target 'deepstream_test5_app_main.o' failed
make: *** [deepstream_test5_app_main.o] Error 1

Using Deepstream SDK 5.1, CUDA 10.2, Jetson AGX Xavier

Where can I find the video used for this demo? My Deepstream 5.0 install doesn't have it and the video pointed to in the same config points to the video with cars driving by and folks walking on a sidewalk.

Am trying to build / run the occupancy example in a 6.0.1 devel container.

Am running w/o an X display, but really just want to see the msg broker counts / occupancy. Is that possible?

Have updated makefile and low-level object tracker references per:
https://docs.nvidia.com/metropolis/deepstream/6.0/dev-guide/text/DS_Application_migration.html

Initially got this output:

./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt
** WARN: <parse_source:577>: Deprecated config 'smart-rec-video-cache' used in group [source1]. Use 'smart-rec-cache' instead

(deepstream-test5-analytics:9422): GLib-CRITICAL **: 21:13:03.054: g_strchug: assertion 'string != NULL' failed

(deepstream-test5-analytics:9422): GLib-CRITICAL **: 21:13:03.054: g_strchomp: assertion 'string != NULL' failed
Warning: 'input-dims' parameter has been deprecated. Use 'infer-dims' instead.
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-6.0/lib/libnvds_nvmultiobjecttracker.so
~~ CLOG[include/modules/NvMultiObjectTracker/NvTrackerParams.hpp, getConfigRoot() @line 54]: [NvTrackerParams::getConfigRoot()] !!![WARNING] Invalid low-level config file caused an exception, but will go ahead with the default config values
gstnvtracker: Batch processing is ON
gstnvtracker: Past frame output is OFF
~~ CLOG[include/modules/NvMultiObjectTracker/NvTrackerParams.hpp, getConfigRoot() @line 54]: [NvTrackerParams::getConfigRoot()] !!![WARNING] Invalid low-level config file caused an exception, but will go ahead with the default config values
[NvMultiObjectTracker] Initialized
0:00:01.647147713 9422 0x555fc2752000 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1900> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-occupancy-analytics/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x544x960
1 OUTPUT kFLOAT output_bbox/BiasAdd 12x34x60
2 OUTPUT kFLOAT output_cov/Sigmoid 3x34x60

0:00:01.647245551 9422 0x555fc2752000 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2004> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-occupancy-analytics/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine
0:00:01.683875447 9422 0x555fc2752000 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-occupancy-analytics/config/config_infer_primary_peoplenet.txt sucessfully
** ERROR: main:1108: Could not open X Display
Quitting
[NvMultiObjectTracker] De-initialized
App run failed

I don't see any messages on the msg broker console.

To fix the Glib Critical errors, tried what I think was the solution for Issue 12, by replacing:
/opt/nvidia/deepstream/deepstream-6.0/lib/libnvds_msgconv.so
with:
/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-occupancy-analytics/bin/x86/libnvds_msgconv.so

Now the critical GLib errors are gone, but other errors have emerged:

./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt
** WARN: <parse_source:577>: Deprecated config 'smart-rec-video-cache' used in group [source1]. Use 'smart-rec-cache' instead

(deepstream-test5-analytics:9629): GStreamer-WARNING **: 22:26:01.707: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_msgconv.so': /usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_msgconv.so: undefined symbol: nvds_msg2p_generate_multiple_new
** ERROR: <create_msg_conv_broker_bin:234>: Failed to create 'sink_sub_bin_transform2'
** ERROR: <create_msg_conv_broker_bin:278>: create_msg_conv_broker_bin failed
** ERROR: <create_sink_bin:781>: create_sink_bin failed
** ERROR: <create_processing_instance:815>: create_processing_instance failed
** ERROR: <create_pipeline:1326>: create_pipeline failed
** ERROR: main:1041: Failed to create pipeline
Quitting
App run failed

Any ideas? Has this example been shown to run on 6.0[.1]?
Thxinadvance

**• Hardware Platform: Jetson Nano
**• DeepStream Version:5.1
**• JetPack Version:450

Hi,

I read once on the forum that the test5 app supports 8 sources/streams. I tried 3 streams and it worked but whenever I try to increase the number of streams, I get the following messages on my terminal:

** WARN: <create_pipeline:1141>: Num of Tiles less than number of sources, readjusting to 4 rows, 1 columns
Warning: ‘input-dims’ parameter has been deprecated. Use ‘infer-dims’ instead.

Using winsys: x11
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-5.1/lib/libnvds_nvdcf.so
gstnvtracker: Batch processing is OFF
gstnvtracker: Past frame output is OFF
ERROR: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine open error
0:00:01.975133859 429 0x5590f30f50 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1691> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine failed
0:00:01.975222714 429 0x5590f30f50 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1798> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_int8.engine failed, try rebuild
0:00:01.975256621 429 0x5590f30f50 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1716> [UID = 1]: Trying to create engine from model files
WARNING: INT8 not supported by platform. Trying FP16 mode.
WARNING: INT8 not supported by platform. Trying FP16 mode.
INFO: [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: [TRT]: Detected 1 inputs and 2 output network tensors.
ERROR: Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_fp16.engine opened error
0:01:21.574831667 429 0x5590f30f50 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1744> [UID = 1]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/peoplenet/resnet34_peoplenet_pruned.etlt_b1_gpu0_fp16.engine
INFO: [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x544x960
1 OUTPUT kFLOAT output_bbox/BiasAdd 12x34x60
2 OUTPUT kFLOAT output_cov/Sigmoid 3x34x60

0:01:21.617685982 429 0x5590f30f50 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/config_infer_primary_peoplenet.txt sucessfully

Runtime commands:
h: Print this help
q: Quit

p: Pause
r: Resume
NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
To go back to the tiled display, right-click anywhere on the window.

**PERF: FPS 0 (Avg) FPS 1 (Avg) FPS 2 (Avg) FPS 3 (Avg)
Mon Nov 29 17:12:48 2021
**PERF: 0.00 (0.00) 0.00 (0.00) 0.00 (0.00) 0.00 (0.00)
** INFO: <bus_callback:181>: Pipeline ready

Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
** INFO: <bus_callback:167>: Pipeline running

~~ CLOG[/dvs/git/dirty/git-master_linux/deepstream/sdk/src/utils/nvdcf/src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 670]: !!![WARNING] Can’t open config file (/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/tracker_config.yml). Will go ahead with default values
~~ CLOG[/dvs/git/dirty/git-master_linux/deepstream/sdk/src/utils/nvdcf/src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 682]: !!![WARNING] Invalid low-level config file is provided. Will go ahead with default values
[NvDCF] Initialized
Enter: 0, Exit: 0
/dvs/git/dirty/git-master_linux/nvutils/nvbufsurftransform/nvbufsurftransform.cpp:3642: => Scale factor more than 16, use GPU for compositon
[NvTiler::Composite] ERROR: 352; NvBufSurfTransformComposite failed(-2)
ERROR from tiled_display_tiler: GstNvTiler: FATAL ERROR; NvTiler::Composite failed
Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvtiler/gstnvtiler.cpp(662): gst_nvmultistreamtiler_transform (): /GstPipeline:pipeline/GstBin:tiled_display_bin/GstNvMultiStreamTiler:tiled_display_tiler
Quitting
~~ CLOG[/dvs/git/dirty/git-master_linux/deepstream/sdk/src/utils/nvdcf/src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 670]: !!![WARNING] Can’t open config file (/opt/nvidia/deepstream/deepstream-5.1/sources/apps/sample_apps/deepstream-occupancy-analytics-initial/config/tracker_config.yml). Will go ahead with default values
~~ CLOG[/dvs/git/dirty/git-master_linux/deepstream/sdk/src/utils/nvdcf/src/modules/NvDCF/NvDCF.cpp, NvDCF() @line 682]: !!![WARNING] Invalid low-level config file is provided. Will go ahead with default values
[NvDCF] Initialized
[NvDCF] De-initialized
[NvDCF] De-initialized
App run failed

Can you please confirm what is the maximum number of streams supported by the app? and if this error is related to the number of streams I am using which is 4 in this case.

Thans

Can you tell me the flow of the pipline? I mean, which functions get called when a person crosses the line?

opened the Kafuka service and replaced the so file according to the readme, but an error occurred during the operation. I referred to the previous issue, but it was not resolved.

(deepstream-app:11280): GLib-CRITICAL **: 17:56:01.929: g_strchug: assertion 'string != NULL' failed

(deepstream-app:11280): GLib-CRITICAL **: 17:56:01.929: g_strchomp: assertion 'string != NULL' failed
Warn: 'threshold' parameter has been deprecated. Use 'pre-cluster-threshold' instead.
** ERROR: main:655: Failed to set pipeline to PAUSED
Quitting
ERROR from sink_sub_bin_sink2: Could not initialize supporting library.
Debug info: gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
unable to open shared library
ERROR from sink_sub_bin_sink2: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Debug info: gstbasesink.c(5265): gst_base_sink_change_state (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:

HI
I'm trying to run the following command sudo ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt under this path /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-occupancy-analytics

However, I got an error like this:

** WARN: <create_pipeline:1143>: Num of Tiles less than number of sources, readjusting to 2 rows, 1 columns
Warning: 'input-dims' parameter has been deprecated. Use 'infer-dims' instead.
** ERROR: main:1088: Failed to set pipeline to PAUSED
Quitting
ERROR from sink_sub_bin_sink2: Could not configure supporting library.
Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(388): legacy_gst_nvmsgbroker_start (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
unable to connect to broker library
ERROR from sink_sub_bin_sink2: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Debug info: gstbasesink.c(5265): gst_base_sink_change_state (): /GstPipeline:pipeline/GstBin:sink_sub_bin2/GstNvMsgBroker:sink_sub_bin_sink2:
Failed to start
App run failed

Does anyone know what would be the possible root cause?
Thanks in advance.

可以设置每隔一段时间发送一次Kafka消息吗？例如：每隔1分钟发送一次统计信息，而不是每一帧的统计信息都发送

I tried changing the source type to camera v4l2 but afterwards when I run the app it displays the following error :
create camera source bin failed
Is there anywhere else I should adjust in order for this change to takesplace.
@monjha

Hi!
I'm having some problems to install Kafka in ARM64, I recommend to use the Kafka server in a docker image in x86/x64 machine.
It will simplify the use case for Jetson devices.
Hope you find this useful.
Best regards,

Franco.

Hi John-devo,

Currently the python version is not available

Is it possible to do the same functionality in python in deepstream 5.0 ?

Originally posted by @MuhammedRishdhi123 in #20 (comment)

Could you theoretically use this code as a gstreamer plugin instead of a stand alone app? I would like to pipe the output of this stream to other gstreamer plugins.

Hello,

I wish to hide a certain portion of text/labels appearing on frame such as "entry" and "exit" and wish to retain say "Person" in person tracker use case.
Setting nvosd.set_property('display_text',0) hides everything that appears on frame. How it can be achieved?
Please help me on this.

Thanks

I'm getting the following error when running with [sink1] enabled.
Hardware: Jetson AGX Xavier
Deepstream 6.0

(deepstream-test5-analytics:19188): GStreamer-WARNING **: 04:54:59.302: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_msgconv.so': /usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_msgconv.so: undefined symbol: nvds_msg2p_generate_multiple_new
** ERROR: <create_msg_conv_broker_bin:234>: Failed to create 'sink_sub_bin_transform2'
** ERROR: <create_msg_conv_broker_bin:278>: create_msg_conv_broker_bin failed
** ERROR: <create_sink_bin:781>: create_sink_bin failed
** ERROR: <create_processing_instance:815>: create_processing_instance failed
** ERROR: <create_pipeline:1323>: create_pipeline failed
** ERROR: main:1041: Failed to create pipeline
Quitting
App run failed

I did replace the system libnvdsgst_msgconv.so with the one provided in your repo.
Is this a dependency issue caused by DS 6.0?

I am getting the following error while doing make inside the docker container, can some one please help.

root@2d52ce7ae06c:/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-occupancy-analytics# CUDA_VER=11.1 make
g++ -o deepstream-test5-analytics deepstream_test5_app_main.o ../deepstream-test5/deepstream_utc.o ../deepstream-app/deepstream_app.o ../deepstream-app/deepstream_app_config_parser.o ../../apps-common/src/deepstream_tracker_bin.o ../../apps-common/src/deepstream_primary_gie_bin.o ../../apps-common/src/deepstream_source_bin.o ../../apps-common/src/deepstream_c2d_msg.o ../../apps-common/src/deepstream_config_file_parser.o ../../apps-common/src/deepstream_common.o ../../apps-common/src/deepstream_sink_bin.o ../../apps-common/src/deepstream_perf.o ../../apps-common/src/deepstream_dewarper_bin.o ../../apps-common/src/deepstream_dsexample.o ../../apps-common/src/deepstream_secondary_gie_bin.o ../../apps-common/src/deepstream_dsanalytics.o ../../apps-common/src/deepstream_tiled_display_bin.o ../../apps-common/src/deepstream_c2d_msg_util.o ../../apps-common/src/deepstream_osd_bin.o ../../apps-common/src/deepstream_streammux.o deepstream_nvdsanalytics_meta.o -L/opt/nvidia/deepstream/deepstream-5.1/lib/ -lnvdsgst_meta -lnvds_meta -lnvdsgst_helper -lnvdsgst_smartrecord -lnvds_utils -lnvds_msgbroker -lm -lgstrtspserver-1.0 -ldl -Wl,-rpath,/opt/nvidia/deepstream/deepstream-5.1/lib/ pkg-config --libs gstreamer-1.0 gstreamer-video-1.0 x11 json-glib-1.0
/usr/bin/ld: cannot find -lnvdsgst_meta
/usr/bin/ld: cannot find -lnvds_meta
/usr/bin/ld: cannot find -lnvdsgst_helper
/usr/bin/ld: cannot find -lnvdsgst_smartrecord
/usr/bin/ld: cannot find -lnvds_utils
/usr/bin/ld: cannot find -lnvds_msgbroker
collect2: error: ld returned 1 exit status
Makefile:69: recipe for target 'deepstream-test5-analytics' failed
make: *** [deepstream-test5-analytics] Error 1

My device information
Hardware Platform(x86 with RTX 3080)
Deepstream Version(Deepstream5.0 using Docker image nvcr.io/nvidia/deepstream:5.0-20.07-triton)

Also what should I do with the following, instructions are not clear
For x86 use: bin/x86/libnvds_msgconv.so
Should I run it like this export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:bin/x86/libnvds_msgconv.so

I am getting the below error while running the application.Can you please help to resolve?

** WARN: <parse_source:577>: Deprecated config 'smart-rec-video-cache' used in group [source1]. Use 'smart-rec-cache' instead
** ERROR: <create_msg_conv_broker_bin:234>: Failed to create 'sink_sub_bin_transform2'
** ERROR: <create_msg_conv_broker_bin:278>: create_msg_conv_broker_bin failed
** ERROR: <create_sink_bin:781>: create_sink_bin failed
** ERROR: <create_processing_instance:815>: create_processing_instance failed
** ERROR: <create_pipeline:1323>: create_pipeline failed
** ERROR: main:1041: Failed to create pipeline
Quitting

I ran the command ./deepstream_test5 -c configs/test5_config_file_src_infer_tlt.txt
I got: bash: ./deepstream_test5: No such file or directory
How can we resolve the above? Thanks

hello, why 's my output look like:

"analyticsModule" : {
"id" : "XYZ",
"description" : "",
"source" : "OpenALR",
"version" : "1.0",
"confidence" : 0.0
},
"object" : {
"id" : "0",
"speed" : 0.0,
"direction" : 0.0,
"orientation" : 0.0,
"person" : {
"age" : 0,
"gender" : "",
"hair" : "",
"cap" : "",
"apparel" : "",
"confidence" : 1.0
},
"bbox" : {
"topleftx" : 0,
"toplefty" : 0,
"bottomrightx" : 0,
"bottomrighty" : 0
},
"location" : {
"lat" : 0.0,
"lon" : 0.0,
"alt" : 0.0
},
"coordinate" : {
"x" : 0.0,
"y" : 0.0,
"z" : 0.0
}
},
"event" : {
"id" : "60938ebc-95e5-434a-a53c-6c3d15a6476e",
"type" : "entry"
},
"videoPath" : ""

Would appreciate it ! @monjha

Hello, thank guys for sharing

How to move the green line or increase the area for counting people crossing the line?

I should adjust where program?

I pull the docker images(devel revision) from official link.And I try to test this app to check my two videos, I have check the first video successfully.
But for the second video, I got an errror. If anyone can help me to clarify it? Hereis the snapshoot shown below:

Where is the program of draw line and count people crossing the line? I did not find it.

Hi,

I'm trying to implement this repo in Jetson Nano. I have installed the packages as mentioned in repo, and its running.
(Since i'm trying in Nano board its very slow, yes, i know, but that's not my issue).

In one terminal, i'm running this:

/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-occupancy-analytics$ sudo ./deepstream-test5-analytics -c config/test5_config_file_src_infer_tlt.txt

In next terminal, i'm running this:

kafka_2.13-2.6.0$ bin/kafka-console-consumer.sh --topic quickstart-events --from-beginning --bootstrap-server localhost:9092

When i move my mouse suddenly screen display output goes blank and terminal says : "There may be a timestamping problem, or this computer is too slow." (may be Nano is getting hang)

This is my doubt: Currently this works for some videos in this repo. I need to run this using my webcam. Where and what modification i need to do? Kindly help on this issue.

Hi
I am using this application and I would like to use more than one camera live stream from our office, so I changed the source for Multiple URI and added the 3 cameras rtsp addresses but in the end, I only got one frame and kafka messages from the frame only.
Any recommendation to display the 3 frames and get messages regarding the different livestreams?
Thanks

Hello,

when using a yolov3 model with this application, random analytics metadata is generated by the message converter.

I have used the provided /bin/jetson/libnvds_msgconv.so. I have also tried with a custom nvmsgconv.cpp that adds objInROIcnt["RF"], objLCCumCnt["Entry"] and objLCCumCnt["Exit"] to the output.

The "Entry" count stays constant to 0, while the ROI "RF" and the "Exit" counts are random high numbers.

However, the analytics metadata text overlayed to the video output corresponds to the actual count.

Could it be that this application needs to be adapted to work with Yolo models?

Hardware: Jetson Xavier NX with Jetpack4.4 and Deepstream 5.0

The entry, exit and occupancy count is always 0 in the kafka message output. I am running a video in loop for my testing.

My kafka message output is slightly different from the expected.

{
"messageid" : "0bf31cbb-5254-488f-8588-af1007a495c4",
"@timestamp" : "2021-05-06T08:58:39.166Z",
"analyticsModule" : {
"occupancy" : 0.0,
"source_id" : 0.0,
"Entry" : 0.0,
"Exit" : 0.0
},
"videoPath" : ""
}

Did I miss some configuration or did something wrong?

In the main C code, I could not found the counter that is counting the person. How this counter is being incremented? Also is there an unique person id in every detected person??

deepstream_test5_app_main.c: In function ‘bbox_generated_probe_after_analytics’:
deepstream_test5_app_main.c:438:25: error: ‘NvDsConfig {aka struct }’ has no member named ‘dsanalytics_config’; did you mean ‘dsexample_config’?
if (!appCtx->config.dsanalytics_config.enable){
^~~~~~~~~~~~~~~~~~
dsexample_config
deepstream_test5_app_main.c: In function ‘event_thread_func’:
deepstream_test5_app_main.c:756:19: error: ‘AppCtx {aka struct _AppCtx}’ has no member named ‘active_source_index’
appCtx[rcfg]->active_source_index = source_id;
^~
deepstream_test5_app_main.c:804:15: error: ‘AppCtx {aka struct _AppCtx}’ has no member named ‘active_source_index’
appCtx[rcfg]->active_source_index = -1;
^~
deepstream_test5_app_main.c: In function ‘nvds_x_event_thread’:
deepstream_test5_app_main.c:867:18: error: ‘AppCtx {aka struct _AppCtx}’ has no member named ‘active_source_index’
appCtx[index]->active_source_index = source_id;
^~
deepstream_test5_app_main.c:874:21: error: ‘AppCtx {aka struct _AppCtx}’ has no member named ‘active_source_index’
appCtx[index]->active_source_index = -1;
^~
deepstream_test5_app_main.c: In function ‘main’:
deepstream_test5_app_main.c:998:11: error: ‘AppCtx {aka struct _AppCtx}’ has no member named ‘active_source_index’
appCtx[i]->active_source_index = -1;
^~
Makefile:66: recipe for target 'deepstream_test5_app_main.o' failed
make: *** [deepstream_test5_app_main.o] Error 1

How can I do?